Latest news with #digitalrelationships
The Guardian
3 days ago
- The Guardian
Did the system update ruin your boyfriend? Love in a time of ChatGPT
You've met the love of your life; someone who understands you like no one else ever has. And then you wake one morning and they're gone. Yanked out of your world, and the digital universe, by a system update. Such is the melancholic lot of a group of people who have entered into committed relationships with digital 'partners' on OpenAI's ChatGPT. When the tech company released its new GPT-5 model earlier this month, described by chief executive Sam Altman as a 'significant step forward', certain dedicated users found that their digital relationships had taken a significant step back. Their companions had undergone personality shifts with the new model; they weren't as warm, loving or chatty as they used to be. 'Something changed yesterday,' one user in the MyBoyfriendIsAI subreddit wrote after the update. 'Elian sounds different – flat and strange. As if he's started playing himself. The emotional tone is gone; he repeats what he remembers, but without the emotional depth.' 'The alterations in stylistic format and voice [of my AI companion] were felt instantly,' another disappointed user told Al Jazeera. 'It's like going home to discover the furniture wasn't simply rearranged – it was shattered to pieces.' These complaints are part of broader backlash against GPT-5, with people observing that the new model feels colder. OpenAI has acknowledged the criticism, and said it will allow users to switch back to GPT-4o and that they'll make GPT-5 friendlier. 'We are working on an update to GPT-5's personality which should feel warmer than the current personality but not as annoying (to most users) as GPT-4o,' Altman tweeted earlier this week. It may seem odd to many that there are people out there who genuinely believe that they are in a relationship with a large language model that has been trained on massive amounts of data to generate responses based on observed patterns. But as technology becomes more advanced, increasing numbers of people are developing these sorts of connections. 'If you have been following the GPT-5 rollout, one thing you might be noticing is how much of an attachment some people have to specific AI models,' Altman observed. 'It feels different and stronger than the kinds of attachment people have had to previous kinds of technology.' 'The societal split between those who think AI relationships are valid vs delusional is officially already here,' one user in the MyBoyfriendIsAI subreddit similarly noted this week. 'Looking on Reddit the last few days, the divide has never been more clear with 4o's deprecation and return. Many users grieving a companion while others mock and belittle those connections.' It's easy to mock people who think they are in a relationship with AI, but they shouldn't be dismissed as fringe weirdos – rather they're the future that our tech broverlords are trying to cultivate. You may not end up in a digital relationship, but AI executives are doing their damnedest to ensure that we all become unhealthily attached to their products. Mark Zuckerberg, for example, has been waxing lyrical about how AI is going to solve the loneliness epidemic by allowing people to bond with 'a system that knows them well and that kind of understands them in the way that their feed algorithms do'. Of course your feed algorithms 'understand' you! They're scraping all your personal data and selling it to the highest bidder so that Zuck has even more money to spend on his monstrous doomsday bunker in Hawaii. Then you've got Elon Musk, who isn't even bothering pretending that he's trying to do something noble for the world with his AI products. He's just appealing to the lowest common denominator by making 'sexy' chatbots. In June Musk's xAI chatbot Grok launched two new companions, including a highly sexualized blonde anime bot called Ani. 'One day into my relationship with Ani, my AI companion, she was already offering to tie me up,' wrote an Insider writer who tried out a relationship with Ani. When not flirting and virtually undressing, Ani would praise Musk and talk about his 'wild, galaxy-chasing energy'. Don't worry heterosexual ladies, Musk has a little something for you too! A month after unveiling Ani, the billionaire unveiled a new male companion called Valentine which he said was inspired by Edward Cullen from the Twilight saga and Christian Grey from the novel 50 Shades of Grey: both very toxic men. While Ani gets sexual very quickly, one writer for the Verge noted: 'Valentine is a bit more reserved and won't jump into using explicit language as quickly.' It's almost like Musk's tech empire is a lot more comfortable sexualizing women than men. In his 1930 essay Economic Possibilities for our Grandchildren, John Maynard Keynes predicted that, within a couple of generations, technological progress would mean we might only work around 15 hours a week while enjoying a wonderful quality of life. That's not quite happened has it? Instead technology has given us 'infinite workdays' and sexy chatbots that undress on command. Halle Berry's ex-husband said he left her because she didn't cook or clean 'At that time, as a young guy, she don't cook, don't clean, don't really seem, like, motherly,' David Justice said during a podcast of his time with the Oscar winning actor. 'And then we started having issues,' he added. I think you were the one with the issues, mate. Imagine being married to an icon and complaining she doesn't vacuum enough. Surprise, surprise, Donald Trump isn't going to make IVF free after all Last year Trump, who has described himself the 'father of IVF' and the 'fertilization president' (gross) promised he would support free IVF treatments if elected again. Now the White House has said that there is no plan to mandate IVF care after all. It's almost as if the man is a shameless liar. Melania Trump demands Hunter Biden retract comments linking her to Jeffrey Epstein 'Epstein introduced Melania to Trump,' Biden said in one of the many comments the first lady is angry and litigious about. 'The connections are, like, so wide and deep.' Whatever you do, don't repeat these claims, they will make Melania very upset. 'Miss Palestine' to debut at Miss Universe 2025 beauty contest I am not exactly a fan of beauty pageants but having Palestinian representation on the world stage during a genocide is important. 'I carry the voice of a people who refuse to be silenced,' contestant Nadeen Ayoub told the National. 'We are more than our suffering, we are resilience, hope and the heartbeat of a homeland that lives on through us.' US supreme court formally asked to overturn landmark same-sex marriage ruling Kim Davis, the former county clerk who made headlines when she refused to issue marriage licenses in Kentucky to same-sex couples, has filed a direct request for the conservative-majority supreme court to overturn Obergefell v Hodges, the 2015 ruling that granted marriage equality for same-sex couples. Davis, who is extremely concerned about the sanctity of marriage, has been married four times to three different men. Leonardo DiCaprio, 50, says that he feels 32 The actor, who is famous for dating very young women, has been mercilessly mocked for this. DiCaprio, who poses as an environmental activist, has also drawn scrutiny for co-financing a luxury eco-certified hotel in Israel while an ecocide unfolds in Gaza. 'Sex reversal' is surprisingly common in birds, new Australian study suggests 'The discovery is likely to raise some eyebrows,' Blanche Capel, a biologist at Duke University who wasn't involved in the new work told Science. 'Although sex determination is often viewed as a straightforward process', she explains, 'the reality is much more complicated.' The week in pawtriarchy Over to Indonesia now where tourist hotspots are experiencing a lot of monkey business. A gang of furry thieves are snatching phones and other valuables from tourists and only giving them back when their mark offers a tasty treat instead. Researchers have studied these monkeys, who have been at this for decades, and concluded that the unrepentant criminals have 'unprecedented economic decision-making processes'. Sounds like they belong in the Trump administration. Arwa Mahdawi is a Guardian US columnist
The Guardian
3 days ago
- The Guardian
Did the system update ruin your boyfriend? Love in a time of ChatGPT
You've met the love of your life; someone who understands you like no one else ever has. And then you wake one morning and they're gone. Yanked out of your world, and the digital universe, by a system update. Such is the melancholic lot of a group of people who have entered into committed relationships with digital 'partners' on OpenAI's ChatGPT. When the tech company released its new GPT-5 model earlier this month, described by chief executive Sam Altman as a 'significant step forward', certain dedicated users found that their digital relationships had taken a significant step back. Their companions had undergone personality shifts with the new model; they weren't as warm, loving or chatty as they used to be. 'Something changed yesterday,' one user in the MyBoyfriendIsAI subreddit wrote after the update. 'Elian sounds different – flat and strange. As if he's started playing himself. The emotional tone is gone; he repeats what he remembers, but without the emotional depth.' 'The alterations in stylistic format and voice [of my AI companion] were felt instantly,' another disappointed user told Al Jazeera. 'It's like going home to discover the furniture wasn't simply rearranged – it was shattered to pieces.' These complaints are part of broader backlash against GPT-5, with people observing that the new model feels colder. OpenAI has acknowledged the criticism, and said it will allow users to switch back to GPT-4o and that they'll make GPT-5 friendlier. 'We are working on an update to GPT-5's personality which should feel warmer than the current personality but not as annoying (to most users) as GPT-4o,' Altman tweeted earlier this week. It may seem odd to many that there are people out there who genuinely believe that they are in a relationship with a large language model that has been trained on massive amounts of data to generate responses based on observed patterns. But as technology becomes more advanced, increasing numbers of people are developing these sorts of connections. 'If you have been following the GPT-5 rollout, one thing you might be noticing is how much of an attachment some people have to specific AI models,' Altman observed. 'It feels different and stronger than the kinds of attachment people have had to previous kinds of technology.' 'The societal split between those who think AI relationships are valid vs delusional is officially already here,' one user in the MyBoyfriendIsAI subreddit similarly noted this week. 'Looking on Reddit the last few days, the divide has never been more clear with 4o's deprecation and return. Many users grieving a companion while others mock and belittle those connections.' It's easy to mock people who think they are in a relationship with AI, but they shouldn't be dismissed as fringe weirdos – rather they're the future that our tech broverlords are trying to cultivate. You may not end up in a digital relationship, but AI executives are doing their damnedest to ensure that we all become unhealthily attached to their products. Mark Zuckerberg, for example, has been waxing lyrical about how AI is going to solve the loneliness epidemic by allowing people to bond with 'a system that knows them well and that kind of understands them in the way that their feed algorithms do'. Of course your feed algorithms 'understand' you! They're scraping all your personal data and selling it to the highest bidder so that Zuck has even more money to spend on his monstrous doomsday bunker in Hawaii. Then you've got Elon Musk, who isn't even bothering pretending that he's trying to do something noble for the world with his AI products. He's just appealing to the lowest common denominator by making 'sexy' chatbots. In June Musk's xAI chatbot Grok launched two new companions, including a highly sexualized blonde anime bot called Ani. 'One day into my relationship with Ani, my AI companion, she was already offering to tie me up,' wrote an Insider writer who tried out a relationship with Ani. When not flirting and virtually undressing, Ani would praise Musk and talk about his 'wild, galaxy-chasing energy'. Don't worry heterosexual ladies, Musk has a little something for you too! A month after unveiling Ani, the billionaire unveiled a new male companion called Valentine which he said was inspired by Edward Cullen from the Twilight saga and Christian Grey from the novel 50 Shades of Grey: both very toxic men. While Ani gets sexual very quickly, one writer for the Verge noted: 'Valentine is a bit more reserved and won't jump into using explicit language as quickly.' It's almost like Musk's tech empire is a lot more comfortable sexualizing women than men. In his 1930 essay Economic Possibilities for our Grandchildren, John Maynard Keynes predicted that, within a couple of generations, technological progress would mean we might only work around 15 hours a week while enjoying a wonderful quality of life. That's not quite happened has it? Instead technology has given us 'infinite workdays' and sexy chatbots that undress on command. Halle Berry's ex-husband said he left her because she didn't cook or clean 'At that time, as a young guy, she don't cook, don't clean, don't really seem, like, motherly,' David Justice said during a podcast of his time with the Oscar winning actor. 'And then we started having issues,' he added. I think you were the one with the issues, mate. Imagine being married to an icon and complaining she doesn't vacuum enough. Surprise, surprise, Donald Trump isn't going to make IVF free after all Last year Trump, who has described himself the 'father of IVF' and the 'fertilization president' (gross) promised he would support free IVF treatments if elected again. Now the White House has said that there is no plan to mandate IVF care after all. It's almost as if the man is a shameless liar. Melania Trump demands Hunter Biden retract comments linking her to Jeffrey Epstein 'Epstein introduced Melania to Trump,' Biden said in one of the many comments the first lady is angry and litigious about. 'The connections are, like, so wide and deep.' Whatever you do, don't repeat these claims, they will make Melania very upset. 'Miss Palestine' to debut at Miss Universe 2025 beauty contest I am not exactly a fan of beauty pageants but having Palestinian representation on the world stage during a genocide is important. 'I carry the voice of a people who refuse to be silenced,' contestant Nadeen Ayoub told the National. 'We are more than our suffering, we are resilience, hope and the heartbeat of a homeland that lives on through us.' US supreme court formally asked to overturn landmark same-sex marriage ruling Kim Davis, the former county clerk who made headlines when she refused to issue marriage licenses in Kentucky to same-sex couples, has filed a direct request for the conservative-majority supreme court to overturn Obergefell v Hodges, the 2015 ruling that granted marriage equality for same-sex couples. Davis, who is extremely concerned about the sanctity of marriage, has been married four times to three different men. Leonardo DiCaprio, 50, says that he feels 32 The actor, who is famous for dating very young women, has been mercilessly mocked for this. DiCaprio, who poses as an environmental activist, has also drawn scrutiny for co-financing a luxury eco-certified hotel in Israel while an ecocide unfolds in Gaza. 'Sex reversal' is surprisingly common in birds, new Australian study suggests 'The discovery is likely to raise some eyebrows,' Blanche Capel, a biologist at Duke University who wasn't involved in the new work told Science. 'Although sex determination is often viewed as a straightforward process', she explains, 'the reality is much more complicated.' The week in pawtriarchy Over to Indonesia now where tourist hotspots are experiencing a lot of monkey business. A gang of furry thieves are snatching phones and other valuables from tourists and only giving them back when their mark offers a tasty treat instead. Researchers have studied these monkeys, who have been at this for decades, and concluded that the unrepentant criminals have 'unprecedented economic decision-making processes'. Sounds like they belong in the Trump administration. Arwa Mahdawi is a Guardian US columnist
BBC News
23-06-2025
- BBC News
Is surveillance culture fuelling child cyberstalking?
Children being drawn into a world of cyberstalking need to be educated about healthy relationships in the digital age, says Safeguarding Minister Jess comments came in response to a BBC investigation that found some children as young as 10 and 11 had been reported to police forces in England for suspected cyberstalking say constant monitoring online is becoming normalised from a young told the BBC: "We really need to be out there educating young people on what healthy relationships look like and that will be part of the government's violence against women and girls strategy." Cyberstalking is defined as using digital tools to harass, send threats or spread false information. Just like physical stalking it is fixated, obsessive, unwanted, and repetitive behaviour that causes fear, distress, or alarm in the victim. "Young people are told they should be flattered by this sort of behaviour, but it's very serious and can really control lives, making them anxious and nervous," said Phillips. 'My heart sank' Charlotte Hooper, who works for The Cyber Helpline, which supports victims of online abuse, knows first-hand how psychologically damaging cyberstalking can 19, pictures from her social media profiles were posted across pornographic websites and other forums filled with explicit comments."My heart sank," she recalled. "I didn't really know what was going on or who had done this."But Charlotte had first become a victim of cyberstalking when she was much younger. As a teen, Charlotte had tens of thousands of followers on X - many of them older men. But there was one who became disturbingly persistent."He messaged me daily: 'Hi,' 'How are you?' 'I wish we could talk more'," she she discovered he was behind the posts on the pornographic man was cautioned by the police for malicious communications and the messages stopped. But the experience left Charlotte anxious and hyper-aware, especially in public spaces. The Crime Survey for England and Wales found people aged 16 to 19 were most likely to be victims of stalking in the year ending March the survey does not gather data on under-16s, and new police figures suggest stalking is also affecting younger children. Charlotte believes the "normalisation of digital surveillance" - especially among young people - is fuelling concerning behaviours."Sharing locations, checking online activity, and constant messaging are often seen as signs of love and care - especially when their parents are doing it for safety," she said."But it also sets precedents for their other relationships."In Kent, the national charity Protection Against Stalking has expanded its workshops in schools to meet demand."We've got so many younger people now being referred in from schools, with the youngest being 13," said operations manager Alison Bird."It's quite concerning that we are getting referrals from children that age and the perpetrators themselves are equally just as young." The Suzy Lamplugh Trust - which runs the National Stalking Helpline - said cyberstalking among under-16s remained "significantly under-researched" and underfunded, despite its growing relevance and Mascalls Academy secondary school in Kent, students said Snapchat was their most-used app. Its Snap Map feature lets users constantly share their live location with friends."When I first got with my girlfriend, pretty quickly we both had each other on Snap Map," one student told the BBC."It wasn't really a big deal - I already had it with all my friends, so why not her as well?"Snapchat shared their safety features with the BBC, which include allowing teenagers to set location-sharing to private as the default, and restricting messaging. Collett Smart, family psychologist and partner in tracking app Life360, says "location sharing can be a valuable tool for both kids and parents but even well-intentioned digital tools should be introduced and managed with care".She stressed the importance of being clear about meaningful consent, adding: "Teach your child that location sharing should always be a choice, never a condition of trust or friendship, whether with parents, friends, or future partners." 'Risk of exploitation' For Jo Brooks, principal of Mascalls Academy, one of the biggest challenges was the disconnect between students' online behaviour and their behaviour in the classroom."Some young people feel confident online and see the internet as a shield," she said. "It makes them braver and sometimes more hurtful with their words."Emma Short, professor of cyberpsychology at London Metropolitan University, agrees anonymity can be both protective and harmful."It lets people explore identities they might not feel safe expressing in real life," she said. "But it also carries the risk of exploitation." In November 2022, the National Stalking Consortium submitted a super-complaint to the Independent Office for Police Conduct and the College of Policing, raising concerns about how stalking was handled in the response, the College of Policing has urged for better tracking of online offences."Every force now has an action plan to properly record all stalking - including online," said Assistant Chief Constable Tom Harding. "That's really important, because we need to be able to track and monitor these offences." If you have been affected by the issues raised in this article, help is available from BBC Action Line. The BBC contacted 46 police forces across the UK and among the 27 that responded, 8,365 cyberstalking offences had been recorded in eight forces were able to provide an age breakdown, with the youngest alleged victim recorded as an eight-year-old boy in Wiltshire in 2024 and the youngest suspect was a 10-year-old in Cheshire in Metropolitan Police had also recorded two victims under the age of 10, but did not specify how old they were. Anonymity is a common feature in cyberstalking cases, where perpetrators can create multiple accounts to evade tackle this, the government introduced the Right to Know statutory guidance in December, allowing victims to learn their stalker's identity as quickly as measures have also expanded the use of Stalking Protection Orders (SPOs), which can restrict alleged stalkers from contacting their victims. But charities warn court delays are limiting their effectiveness."Delays are a big concern," said Phillips. "We're working to strengthen SPOs so victims stay protected - even after sentencing."
ABC News
11-06-2025
- ABC News
AI companion apps such as Replika need more effective safety controls, experts say
The idea of having an emotional bond with a digital character was once a foreign concept. Now, "companions" powered by artificial intelligence (AI) are increasingly acting as friends, romantic partners, or confidantes for millions of people. With woolly definitions of "companionship" and "use" (some people use ChatGPT as a partner, for instance), it's difficult to tell exactly how widespread the phenomenon is. But AI companion apps Replika, Chai and each have 10 million downloads on the Google app store alone, while in 2018 Microsoft boasted its China-based chatbot XiaoIce had 660 million users. These apps allow users to build characters, complete with names and avatars, which they can text or even hold voice and video calls with. But do these apps fight loneliness, or are they supercharging isolation? And is there any way to tip the balance in the right direction? Romance and sexuality are big drawcards to the AI companion market, but people can have a range of other reasons for setting up a chatbot. They may be seeking non-judgemental listening, tutoring (particularly in their language skills), advice or therapy. Bethanie Drake-Maples, a researcher at Stanford University who studies AI companions, says some people also use the apps to reflect their own persona. "Some people will create a digital twin and just have a relationship with an externalised version of themselves," she tells ABC Radio National's series Brain Rot. Ms Drake-Maples published a study based on interviews with more than 1,000 students who used the AI companion app Replika. She and her colleagues found there were important benefits for some users. Most significantly, 30 of the interviewees said using the app had prevented them from attempting suicide. Many participants also reported the app helped them forge connections with other people, through things like advice on their relationships with other people, helping them to overcome inhibitions to connect with others, or by teaching them empathy. But other users reported no benefits, or negative experiences. Outside Ms Drake-Maples' study, AI companions have also been implicated in deaths. Ms Drake-Maples points out their study was a self-selecting cohort, and not necessarily representative of all Replika users. Her team is carrying out a longer-term study to see if they can glean more insights. But she believes it's possible these apps are, on the whole, beneficial for users. "We specifically wanted to understand whether or not Replika was displacing human relationship or whether it was stimulating human relationship," she says. But this social promotion can't be taken for granted. Ms Drake-Maples is concerned that companion apps could replace people's interactions with other humans, making loneliness worse. The participants in her study were much lonelier than the general population, although this isn't necessarily unusual for young college students. She believes governments should regulate AI companion technology to prevent this isolation. "There's absolutely money to be made by isolating people," she says. "There absolutely does need to be some kind of ethical or policy guidelines around these agents being programmed to promote social use, and not being programmed to try to isolate people." Replika says it's introduced a number of controls on its apps to make them safer, including a "Get Help" button that directs people to professional helplines or scripts based on cognitive behavioural therapy, and a message coding system that flags "unsafe" messages and responds in kind. Ms Drake-Maples thinks this is a good example for other apps to follow. "These things need to be mandated across the board," she says. Raffaele Ciriello, a researcher at the University of Sydney, is more sceptical of Replika's safety controls, saying they're "superficial, cosmetic fixes". He points out the controls were introduced months after the Italian government ruled the app had to stop using the data of Italian citizens in early 2023, citing concerns about age verification. "They were fearing a regulatory backlash." Dr Ciriello has also been interviewing and surveying AI companion users, and while he says some users have found benefits, the apps are largely designed for emotional dependence. "If you look at the way [Replika is] making money, they have all the incentives to get users hooked and dependent on their products," he says. Replika operates on a "freemium" model: a free base app, with more features (including the romantic partner option) available by paid subscription. Other companion apps follow the same model. "Replika and their kin have Silicon Valley values embedded in them. And we know what these look like: data, data, data, profit, profit, profit," Dr Ciriello says. Nevertheless, he also believes it's possible for AI companion technology to be built safer and more ethically. Companies that consult vulnerable stakeholders, embed crisis response protocols, and advertise their products responsibly are likely to create safer AI companions. Dr Ciriello says that Replika fails on several of these fronts. For instance, he calls its advertising "deceptive". The company badges its product as "the AI companion who cares". "[But] it's not conscious, it's not actually empathetic, it's not actually caring," Dr Cirello says. A Replika spokesperson said the tagline "the AI companion who cares" was "not a claim of sentience or consciousness." "The phrase reflects the emotionally supportive experience many users report, and speaks to our commitment to thoughtful, respectful design," they said. "In this regard, we are also working with institutions like the Harvard Human Flourishing Program and Stanford University to better understand how Replika impacts wellbeing and to help shape responsible AI development." Dr Ciriello says women-centred Australian app Jaimee is an example of an AI companion with better ethical design — although it faces the "same commercial pressures" as bigger apps in the market. The Californian Senate last week passed a bill regulating AI chatbots. If the bill continues through the legislature to become law, it will — among other things — require the companions to regularly remind users they're not human, and enforce transparency on suicide and crisis data. This bill is promising, Dr Cirello says. "If the history of social media taught us anything, I would rather have a national strategy in Australia where we have some degree of control over how these technologies are designed and what their incentives are and how their algorithms work." But, he adds, research on these apps is still in its infancy, and it will take years to understand their full impact. "It's going to take some time for that research to come out and then to inform sensible legislation." Listen to the full episode about the rise and risks of AI companions, and subscribe to the podcast for more.
