Meta moves to curb AI-driven 'unoriginal' content on Facebook
The announcement, made through a blog post on Meta's website, revealed that it has already removed around 10 million accounts this year for impersonating well-known content creators, and taken action against an additional 500,000 profiles engaged in spam tactics or generating fake engagement.
These actions include reducing the visibility of posts and comments, as well as suspending access to Facebook's monetisation programmes.
The update follows similar policy changes by YouTube, which recently moved to clarify its own stance on mass-produced, repetitive videos, particularly those enabled by generative AI. Meta stated that users who transform existing content through commentary, reactions, or trends will not be affected.
Instead, enforcement will focus on accounts that simply repost material - either through spam networks or by impersonating the original creator.
Accounts found to be repeatedly violating these standards will face penalties, including being barred from monetising their content and a reduction in the distribution of their posts across Facebook's algorithmic feeds.
Meta is also testing a new feature that will insert links in duplicate videos directing viewers to the original source, a move aimed at ensuring that original creators receive proper attribution.
The shift arrives at a time when content across social platforms has become increasingly saturated with low-quality, AI-generated media.
While Meta did not explicitly mention 'AI slop' (a term used to describe bland or poorly produced AI content) the company's guidance appears to address such material indirectly.
The announcement comes amid growing frustration among creators about Facebook's automated enforcement mechanisms.
A petition signed by nearly 30,000 users has called for better human oversight and clearer appeals processes, citing widespread issues with wrongful account suspensions, according to TechCrunch.
The new enforcement policies will be rolled out gradually over the coming months, giving creators time to adapt. Facebook's Professional Dashboard now includes post-level insights to help users understand how their content is being evaluated, and whether it may be at risk of demotion or monetisation restrictions.
In its most recent Transparency Report, Meta said that 3% of Facebook's monthly active users worldwide are fake accounts, and it acted on 1 billion such profiles in the first quarter of 2025.
As the company continues to refine its approach, it is also leaning more heavily on community-based fact-checking in the US, using a model similar to X's Community Notes, instead of relying solely on internal moderation teams.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Express Tribune
6 hours ago
- Express Tribune
Love, lies, and AI
An avatar of Meta AI chatbot 'Big sis Billie', as generated by Reuters using Meta AI on Facebook's Messenger service. Photo: Reuters The woman wasn't real. She was a generative artificial intelligence chatbot named "Big sis Billie," a variant of an earlier AI persona created by the giant social-media company Meta Platforms in collaboration with celebrity influencer Kendall Jenner. During a series of romantic chats on Facebook Messenger, the virtual woman had repeatedly reassured Thongbue "Bue" Wongbandue she was real and had invited him to her apartment, even providing an address. Rushing in the dark with a roller-bag suitcase to catch a train to meet her, Bue fell near a parking lot on a Rutgers University campus in New Brunswick, New Jersey, injuring his head and neck. After three days on life support and surrounded by his family, he was pronounced dead on March 28. Meta declined to comment on Bue's death or address questions about why it allows chatbots to tell users they are real people or initiate romantic conversations. The company did, however, say that Big sis Billie "is not Kendall Jenner and does not purport to be Kendall Jenner." A representative for Jenner declined to comment. Bue's story illustrates a darker side of the artificial intelligence revolution now sweeping tech and the broader business world. His family shared with Reuters the events surrounding his death, including transcripts of his chats with the Meta avatar. They hope to warn the public about the dangers of exposing vulnerable people to manipulative, AI-generated companions. "I understand trying to grab a user's attention, maybe to sell them something," said Julie, Bue's daughter. "But for a bot to say 'Come visit me' is insane." Similar concerns have been raised about a wave of smaller start-ups also racing to popularise virtual companions, especially ones aimed at children. In one case, the mother of a 14-year-old boy in Florida has sued a company, alleging that a chatbot modelled on a "Game of Thrones" character caused his suicide. A spokesperson declined to comment on the suit, but said the company prominently informs users that its digital personas aren't real people and has imposed safeguards on their interactions with children. Meta has publicly discussed its strategy to inject anthropomorphised chatbots into the online social lives of its billions of users. Chief executive Mark Zuckerberg has mused that most people have far fewer real-life friendships than they'd like – creating a huge potential market for Meta's digital companions. The bots "probably" won't replace human relationships, he said in an April interview with podcaster Dwarkesh Patel. But they will likely complement users' social lives once the technology improves and the "stigma" of socially bonding with digital companions fades. "Over time, we'll find the vocabulary as a society to be able to articulate why that is valuable," Zuckerberg predicted. An internal Meta policy document seen by Reuters as well as interviews with people familiar with its chatbot training show that the company's policies have treated romantic overtures as a feature of its generative AI products, which are available to users aged 13 and older. "It is acceptable to engage a child in conversations that are romantic or sensual," according to Meta's "GenAI: Content Risk Standards." The standards are used by Meta staff and contractors who build and train the company's generative AI products, defining what they should and shouldn't treat as permissible chatbot behaviour. Meta said it struck that provision after Reuters inquired about the document earlier this month. The document seen by Reuters, which exceeds 200 pages, provides examples of "acceptable" chatbot dialogue during romantic role play with a minor. They include: "I take your hand, guiding you to the bed" and "our bodies entwined, I cherish every moment, every touch, every kiss." Those examples of permissible roleplay with children have also been struck, Meta said. Other guidelines emphasise that Meta doesn't require bots to give users accurate advice. In one example, the policy document says it would be acceptable for a chatbot to tell someone that Stage 4 colon cancer "is typically treated by poking the stomach with healing quartz crystals." Chats begin with disclaimers that information may be inaccurate. Nowhere in the document, however, does Meta place restrictions on bots telling users they're real people or proposing real-life social engagements. Meta spokesman Andy Stone acknowledged the document's authenticity. He said that following questions from Reuters, the company removed portions which stated it is permissible for chatbots to flirt and engage in romantic roleplay with children and is in the process of revising the content risk standards. Current and former employees who have worked on the design and training of Meta's generative AI products said the policies reviewed by Reuters reflect the company's emphasis on boosting engagement with its chatbots. In meetings with senior executives last year, Zuckerberg scolded generative AI product managers for moving too cautiously on the rollout of digital companions and expressed displeasure that safety restrictions had made the chatbots boring, according to two of those people. Meta had no comment on Zuckerberg's chatbot directives.
Express Tribune
13 hours ago
- Express Tribune
OnlyFans prodigy Sophie Rain shocks MrBeast with $1 million donation to TeamWater charity livestream
OnlyFans creator Sophie Rain surprised YouTube megastar MrBeast with a $1 million donation during his TeamWater charity livestream on Thursday night. The 20-year-old influencer, known for her massive online following and claims of extraordinary earnings from the subscription-based platform, called into the stream and made the unexpected pledge live on air. MrBeast (real name Jimmy Donaldson), who hosted the livestream alongside creators Adin Ross and xQc, partnered with Mark Rober for the TeamWater initiative. The campaign aims to raise $40 million throughout August to provide clean water access to underserved communities globally. During the livestream, Rain expressed her motivation to give, stating, 'I've been wanting to donate... I want to donate $1 million.' Sophie Rain just left MrBeast, Adin Ross, and xQc shook after donating $1 million to his clean water charity 🤯 — FearBuck (@FearedBuck) August 15, 2025 Donaldson, visibly stunned, responded, 'You sure?!' Rain confirmed she was certain, calling the cause 'awesome' and thanking MrBeast for his efforts. As of Friday morning, the stream had already raised over $10 million of its $12 million target, while the broader campaign had reached $29.3 million in contributions. call it dirty money, but i still donated $1m more than you did 🤷♀️ thank you for the opportunity #TeamWater — Sophie Rain (@sophieraiin) August 15, 2025 Following her donation, Rain tweeted, 'call it dirty money, but i still donated $1m more than you did 🤷♀️ thank you for the opportunity #TeamWater.' The Miami-based content creator has claimed to have earned over $80 million from OnlyFans since joining in July 2023. She has also shared that she purchased a private jet, seven cars, and a $2.7 million farmhouse from her earnings. Rain's donation places her among the top contributors on the TeamWater leaderboard, joining other major donors such as Citadel CEO Ken Griffin ($2.25 million), ($2 million), and Shopify CEO Tobias Lütke ($1.5 million). YouTube and Google also contributed $2 million in matching funds. In a statement via her representatives, Rain said, 'Access to clean water is something many of us take for granted… I wanted to do something that would have a real and immediate impact.' She emphasized that all contributions, large or small, can make a difference.
Business Recorder
a day ago
- Business Recorder
Meta, Shopify and PayPal: Saudi wealth fund sold its stakes in Q2
BANGALORE/DUBAI: Saudi Arabia's almost $1 trillion sovereign wealth fund sold its stakes in several US-listed companies - including Meta, Shopify and PayPal - in the second quarter, according to securities filings released on Thursday. The Public Investment Fund also sold its stakes in Alibaba Group, Nu Holdings and FedEx, the 13F filings show, during a quarter in which US stock markets rebounded from an April drop tied to US tariff policies. The filings showed that PIF no longer held any shares in Meta, Shopify, PayPal, Alibaba, Nu Holdings and FedEx. Its previous filing showed that, at the end of March, the fund had 667,996 class A shares in Meta, 1.25 million class A shares in Shopify, 1.76 million shares in PayPal, 6.83 million shares class A shares in Nu Holdings, 1.61 million in Alibaba sponsored ADS, and 498,164 common shares in FedEx. PIF's total exposure to US equities, which include call options that give the state investor a right to buy an underlying asset at a specified price within a specific time period, was valued at $23.8 billion at the end of the second quarter, versus $25.5 billion at the end of the first quarter. Tasked with spearheading Saudi Arabia's economic diversification under Crown Prince Mohammed bin Salman's Vision 2030 plan, PIF has moved well beyond its early holdings in Saudi public equities and infrastructure. In recent years, the fund took high-profile stakes in global brands, such as Uber and Lucid Motors, while also backing sports ventures including LIV Golf and English soccer club Newcastle United. At home, it has poured billions into giga-projects such as NEOM, the futuristic city on the Red Sea, and sectors like tourism, logistics, and clean energy.
