
'Tool for grifters': AI deepfakes push bogus sexual cures
The rise of generative AI has made it easy -- and financially lucrative -- to mass-produce such videos with minimal human oversight, often featuring fake celebrity endorsements of bogus and potentially harmful products.
In some TikTok videos, carrots are used as a euphemism for male genitalia, apparently to evade content moderation policing sexually explicit language.
"You would notice that your carrot has grown up," the muscled man says in a robotic voice in one video, directing users to an online purchase link.
"This product will change your life," the man adds, claiming without evidence that the herbs used as ingredients boost testosterone and send energy levels "through the roof."
The video appears to be AI-generated, according to a deepfake detection service recently launched by the Bay Area-headquartered firm Resemble AI, which shared its results with AFP.
"As seen in this example, misleading AI-generated content is being used to market supplements with exaggerated or unverified claims, potentially putting consumers' health at risk," Zohaib Ahmed, Resemble AI's chief executive and co-founder, told AFP.
"We're seeing AI-generated content weaponized to spread false information."
'Cheap way'
The trend underscores how rapid advances in artificial intelligence have fueled what researchers call an AI dystopia, a deception-filled online universe designed to manipulate unsuspecting users into buying dubious products.
They include everything from unverified -- and in some cases, potentially harmful -- dietary supplements to weight loss products and sexual remedies.
"AI is a useful tool for grifters looking to create large volumes of content slop for a low cost," misinformation researcher Abbie Richards told AFP.
"It's a cheap way to produce advertisements," she added.
Alexios Mantzarlis, director of the Security, Trust, and Safety Initiative at Cornell Tech, has observed a surge of "AI doctor" avatars and audio tracks on TikTok that promote questionable sexual remedies.
Some of these videos, many with millions of views, peddle testosterone-boosting concoctions made from ingredients such as lemon, ginger and garlic.
More troublingly, rapidly evolving AI tools have enabled the creation of deepfakes impersonating celebrities such as actress Amanda Seyfried and actor Robert De Niro.
"Your husband can't get it up?" Anthony Fauci, former director of the National Institute of Allergy and Infectious Diseases, appears to ask in a TikTok video promoting a prostate supplement.
But the clip is a deepfake, using Fauci's likeness.
'Pernicious'
Many manipulated videos are created from existing ones, modified with AI-generated voices and lip-synced to match what the altered voice says.
"The impersonation videos are particularly pernicious as they further degrade our ability to discern authentic accounts online," Mantzarlis said.
Last year, Mantzarlis discovered hundreds of ads on YouTube featuring deepfakes of celebrities -- including Arnold Schwarzenegger, Sylvester Stallone, and Mike Tyson -- promoting supplements branded as erectile dysfunction cures.
The rapid pace of generating short-form AI videos means that even when tech platforms remove questionable content, near-identical versions quickly reappear -- turning moderation into a game of whack-a-mole.
Researchers say this creates unique challenges for policing AI-generated content, requiring novel solutions and more sophisticated detection tools.
AFP's fact checkers have repeatedly debunked scam ads on Facebook promoting treatments -- including erectile dysfunction cures -- that use fake endorsements by Ben Carson, a neurosurgeon and former US cabinet member.
Yet many users still consider the endorsements legitimate, illustrating the appeal of deepfakes.
"Scammy affiliate marketing schemes and questionable sex supplements have existed for as long as the internet and before," Mantzarlis said.
"As with every other bad thing online, generative AI has made this abuse vector cheaper and quicker to deploy at scale."
Hashtags

Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles


France 24
2 hours ago
- France 24
Ireland prepares to excavate 'mass grave' at mother and baby home
A crew sealed off the site in Tuam, 135 miles (220 kilometres) west of Dublin, in preparation for beginning to dig for any remains next month. In 2014, local historian Catherine Corless produced evidence that 796 children, from newborns to a nine-year-old, died at Tuam's mother and baby home. Her research pointed to the children's likely final resting place -- a disused septic tank discovered in 1975. Significant quantities of baby remains were discovered in an apparently makeshift crypt at the site during test excavations between 2016 and 2017. The home was run by Catholic nuns between 1925 and 1961, and the site was left largely untouched after the institution was knocked down in 1972. It was Corless's discovery of the unmarked mass burial site that led to an Irish Commission of Investigation into the so-called mother and baby home. n findings published in 2021, the commission said there had been "disquieting" levels of infant mortality at the institutions. "It's been a fierce battle. When I started this nobody wanted to listen. At last we are righting the wrongs," Corless, 71, told AFP last month in Tuam. "I was just begging 'Take the babies out of this sewage system and give them the decent Christian burial that they were denied'," she said. Babies taken from mothers Women who became pregnant out of wedlock were siloed in the so-called mother and baby homes by Irish society, the state and the Catholic church, which has historically held an iron grip on Irish social attitudes. After giving birth at the homes, mothers were then separated from their newborn children, who were often given up for adoption. The state-backed enquiries sparked by the discoveries in Tuam found that 56,000 unmarried women and 57,000 children passed through 18 such homes over the space of 76 years. The commission's report concluded that 9,000 children had died in the homes across Ireland. Often church and state worked in tandem to run the institutions, which still operated in Ireland as recently as 1998. A team was finally appointed in 2023 to lead the Tuam site excavation. It is tasked with recovering, memorialising and re-burying any remains recovered at the site. Sample DNA will be taken from people who have reasonable grounds to believe the remains are those of a close relative. © 2025 AFP


Mediapart
20 hours ago
- Mediapart
The chronicles of a genocide in Gaza (part two)
The cookies and similar technologies we use on Mediapart are of different natures and allow us to pursue different purposes. Some are necessary for the functioning of the site and the mobile application (you cannot refuse them). Others are optional but help to facilitate your experience as a reader and in some way support Mediapart. You can refuse or accept them below, depending on their purpose. Do you agree that Mediapart uses cookies or similar technologies for the following purposes ? You can make your choice, for each category, by enabling or disabling the switch button. Mandatory for the operation of the site or application Subscriber login, anonymized audience measurement, sending of push notifications, tracking of failures, highlighting of our services these tools are necessary to track the activity of our services and their proper functioning. read more Here are the various cookies and similar technologies included in this category : Authentication cookies : subscriber login. : subscriber login. AT Internet : anonymized audience measurement : anonymized audience measurement Display of multimedia editorial content : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). Typeform : optional questionnaires to collect readers opinions on our digital products. : optional questionnaires to collect readers opinions on our digital products. Datadog (only on the website) : technical indicators and load balancing. : technical indicators and load balancing. Selligent (only on the website) : communication with the subscriber, highlighting of services, offers and benefits. : communication with the subscriber, highlighting of services, offers and benefits. Batch (only on the app) : sending push notifications and in-app messages. : sending push notifications and in-app messages. Firebase Cloud Messaging (only on app) : required for push notifications to work on Android. : required for push notifications to work on Android. Microsoft App Center (only on app) : app update and failure tracking system. Statistics These tools allow us to collect statistics on site and mobile application traffic to understand usage, detect possible problems and optimize the ergonomics of our products. read more These are the third-party tools included in this category : AT Internet : audience measurement related to subscriber ID. : audience measurement related to subscriber ID. CrazyEggs (only on website) : customer journey analysis. : customer journey analysis. Nonli (only on website) : helps our social network team to publish our contents on social networks. : helps our social network team to publish our contents on social networks. Qiota (available only on the website) : management of the datawall system. Advertising retargeting There is no advertising on Mediapart. But we do promote our content and services on other sites and social networks. For this, we use technologies made available by some advertising companies. read more These are the third-party tools included in this category : Facebook (only on the website) : audience targeting on social networks to promote Mediapart. Content Access Management We use the Qiota service from Opper Marketing Suite to configure the activation of a datawall on certain content (available only on the website). This system, intended for non-subscribed users, requires the input of an email address to access the relevant content. By providing this information, the user consents to its collection, storage, and use for statistical purposes. In accordance with the applicable regulations, users have the right to access, rectify, and delete their data, which they can exercise by contacting dpo@ Save and close


Mediapart
20 hours ago
- Mediapart
Macron visits Greenland to convey 'solidarity' in face of Trump
The cookies and similar technologies we use on Mediapart are of different natures and allow us to pursue different purposes. Some are necessary for the functioning of the site and the mobile application (you cannot refuse them). Others are optional but help to facilitate your experience as a reader and in some way support Mediapart. You can refuse or accept them below, depending on their purpose. Do you agree that Mediapart uses cookies or similar technologies for the following purposes ? You can make your choice, for each category, by enabling or disabling the switch button. Mandatory for the operation of the site or application Subscriber login, anonymized audience measurement, sending of push notifications, tracking of failures, highlighting of our services these tools are necessary to track the activity of our services and their proper functioning. read more Here are the various cookies and similar technologies included in this category : Authentication cookies : subscriber login. : subscriber login. AT Internet : anonymized audience measurement : anonymized audience measurement Display of multimedia editorial content : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). Typeform : optional questionnaires to collect readers opinions on our digital products. : optional questionnaires to collect readers opinions on our digital products. Datadog (only on the website) : technical indicators and load balancing. : technical indicators and load balancing. Selligent (only on the website) : communication with the subscriber, highlighting of services, offers and benefits. : communication with the subscriber, highlighting of services, offers and benefits. Batch (only on the app) : sending push notifications and in-app messages. : sending push notifications and in-app messages. Firebase Cloud Messaging (only on app) : required for push notifications to work on Android. : required for push notifications to work on Android. Microsoft App Center (only on app) : app update and failure tracking system. Statistics These tools allow us to collect statistics on site and mobile application traffic to understand usage, detect possible problems and optimize the ergonomics of our products. read more These are the third-party tools included in this category : AT Internet : audience measurement related to subscriber ID. : audience measurement related to subscriber ID. CrazyEggs (only on website) : customer journey analysis. : customer journey analysis. Nonli (only on website) : helps our social network team to publish our contents on social networks. : helps our social network team to publish our contents on social networks. Qiota (available only on the website) : management of the datawall system. Advertising retargeting There is no advertising on Mediapart. But we do promote our content and services on other sites and social networks. For this, we use technologies made available by some advertising companies. read more These are the third-party tools included in this category : Facebook (only on the website) : audience targeting on social networks to promote Mediapart. Content Access Management We use the Qiota service from Opper Marketing Suite to configure the activation of a datawall on certain content (available only on the website). This system, intended for non-subscribed users, requires the input of an email address to access the relevant content. By providing this information, the user consents to its collection, storage, and use for statistical purposes. In accordance with the applicable regulations, users have the right to access, rectify, and delete their data, which they can exercise by contacting dpo@ Save and close