Latest news with #AI-manipulated

The Hindu
2 days ago
- Entertainment
- The Hindu
Meta Oversight Board overturns decision on AI-manipulated video post on Facebook
The Meta Oversight Board overturned the social media company's decision to leave up an AI-manipulated video post that showed Brazilian soccer player Ronaldo Nazário promoting an online game, which he did not. The manipulated video was posted in September last year, which falsely showed Nazário endorsing the play-to-earn game. Interestingly, users were taken to a different game when they clicked the AI-manipulated video's link. A Meta user complained about this post, but their report was not addressed and the content remained visible until the case reached the oversight board. While the 'ad' was disabled for violating the company's Unacceptable Business Practices Advertising Standard, the original organic post stayed up. Only later was it removed for policy violations. 'Meta has a responsibility to 'mitigate adverse human rights impacts' of monetized content that could scam or defraud – in line with the United Nations Guiding Principles on Business and Human Rights. When paid to boost content, Meta should ensure these posts do not violate its policies,' noted the board in its decision. The oversight board criticised Meta for lacking a uniform enforcement policy when it comes to celebrity endorsements. It also stressed Meta's responsibilities to users and the public when labelling or taking action against AI deepfakes, to prevent public fraud from taking place. 'Based on public reporting, the Board notes Meta is likely allowing significant amounts of scam content on its platforms to avoid potentially overenforcing a small subset of genuine celebrity endorsements. At-scale reviewers are not empowered to enforce this prohibition on content that establishes a fake persona or pretends to be a famous person in order to scam or defraud. Meta should enforce this prohibition at-scale by providing reviewers with often easily identifiable indicators that distinguish AI content,' noted the Meta Oversight Board in its post.


Hans India
2 days ago
- Business
- Hans India
Meta Faces Heat Over Celebrity Deepfake Scams on Facebook, Oversight Board Warns
Meta is under renewed scrutiny after its Oversight Board flagged a troubling rise in AI deepfake scams, particularly those misusing celebrity identities for deceptive ads. In a recent decision, the board overturned Meta's choice to keep up a Facebook post featuring an AI-generated deepfake of Brazilian football legend Ronaldo Nazário promoting a gambling app. Despite more than 50 user reports, the ad remained online and racked up over 600,000 views before being taken down. The Oversight Board stated this case highlights broader issues with Meta's enforcement of its own policies against impersonation and scams. It criticized the tech giant for enabling large-scale scam content, noting that content reviewers often lack the authority and training to act on AI-generated deepfakes unless there's a direct escalation. According to the board, reviewers face inconsistent enforcement guidelines, which vary by region, making scam detection uneven and unreliable. The ad in question promoted a game called Plinko and was among thousands found in Meta's Ad Library. Many of these reportedly featured deepfaked videos of other celebrities, including Cristiano Ronaldo and even Meta's CEO, Mark Zuckerberg. The board issued a single but significant recommendation: Meta must strengthen its internal policies, empower its moderators, and train them to recognize hallmarks of AI-manipulated media. In response, Meta pushed back, saying the board's assessment was 'simply inaccurate.' The company pointed to an ongoing pilot program using facial recognition to detect such scams and emphasized its broader safety tools and enforcement strategies. Still, Meta's efforts appear insufficient. Earlier this year, several deepfake scam ads featuring Elon Musk and other public figures made the rounds, with some running for weeks despite clear signs of manipulation. Actress Jamie Lee Curtis recently criticized Meta publicly for failing to remove a fake ad featuring her likeness until she intervened directly. The Oversight Board isn't alone in raising alarms. A Wall Street Journal report revealed that nearly half of all scam reports on Zelle for JPMorgan Chase originated from Meta platforms. Regulators in the UK and Australia have also highlighted similar trends. As AI tools become more accessible, the misuse of deepfakes for fraud is accelerating. Critics argue that without stricter ad oversight and enforcement, Meta risks becoming a breeding ground for online scams.


7NEWS
3 days ago
- 7NEWS
Man accused of using AI images of women for sextortion
A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail.


The Advertiser
4 days ago
- General
- The Advertiser
Man accused of using AI images of women for sextortion
A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail. A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail. A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail. A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail.


West Australian
4 days ago
- General
- West Australian
Man accused of using AI images of women for sextortion
A man accused of threatening to post AI-manipulated images online in the sextortion of three women has appeared in court for the first time. Benjamin Michael Jomaa is accused of sending sexual material to the women without their consent on Facebook messenger and threatening to distribute AI-manipulated images of them online. The 31-year-old allegedly demanded to be sent more intimate pictures and encouraged one of the women to participate in a sexual act without her consent. Sexual extortion or 'sextortion' is a form of blackmail where a person threatens to share a nude or sexual image or video unless their victim gives in to their demands. Police searched Jomaa's home on May 28 at Ettalong Beach on the NSW Central Coast and seized several electronic devices. He was arrested and charged with 13 offences. The three women, all aged in their 20s, were allegedly abused by Jomaa online between October 2024 and April 2025. Jomaa was granted bail after the arrest. He appeared briefly in Gosford Local Court for the first time on Wednesday, represented by his lawyer Jessica Tohi. Supported by two people, Jomaa walked out of the court building hidden underneath a coat. He has been excused from attending court when the matter returns in two weeks and will remain on bail.