'Tool for grifters': AI deepfakes push bogus sexual cures
Rapid advances in artificial intelligence have fueled an AI dystopia, turning social media into a deception-filled space used to promote dubious products.
By Anuj Chopra and Marisha Goldhamer
Holding an oversized carrot, a brawny, shirtless man promotes a supplement he claims can enlarge male genitalia -- one of countless AI-generated videos on TikTok peddling unproven sexual treatments.
The rise of generative AI has made it easy -- and financially lucrative -- to mass-produce such videos with minimal human oversight, often featuring fake celebrity endorsements of bogus and potentially harmful products.
In some TikTok videos, carrots are used as a euphemism for male genitalia, apparently to evade content moderation policing sexually explicit language.
"You would notice that your carrot has grown up," the muscled man says in a robotic voice in one video, directing users to an online purchase link.
"This product will change your life," the man adds, claiming without evidence that the herbs used as ingredients boost testosterone and send energy levels "through the roof."
The video appears to be AI-generated, according to a deepfake detection service recently launched by the Bay Area-headquartered firm Resemble AI, which shared its results with AFP.
"As seen in this example, misleading AI-generated content is being used to market supplements with exaggerated or unverified claims, potentially putting consumers' health at risk," Zohaib Ahmed, Resemble AI's chief executive and co-founder, told AFP. "We're seeing AI-generated content weaponized to spread false information."
The trend underscores how rapid advances in artificial intelligence have fueled what researchers call an AI dystopia, a deception-filled online universe designed to manipulate unsuspecting users into buying dubious products.
They include everything from unverified -- and in some cases, potentially harmful -- dietary supplements to weight loss products and sexual remedies.
"AI is a useful tool for grifters looking to create large volumes of content slop for a low cost," misinformation researcher Abbie Richards told AFP.
"It's a cheap way to produce advertisements," she added.
Alexios Mantzarlis, director of the Security, Trust, and Safety Initiative at Cornell Tech, has observed a surge of "AI doctor" avatars and audio tracks on TikTok that promote questionable sexual remedies.
Some of these videos, many with millions of views, peddle testosterone-boosting concoctions made from ingredients such as lemon, ginger and garlic.
More troublingly, rapidly evolving AI tools have enabled the creation of deepfakes impersonating celebrities such as actress Amanda Seyfried and actor Robert De Niro.
"Your husband can't get it up?" Anthony Fauci, former director of the National Institute of Allergy and Infectious Diseases, appears to ask in a TikTok video promoting a prostate supplement.
But the clip is a deepfake, using Fauci's likeness.
Many manipulated videos are created from existing ones, modified with AI-generated voices and lip-synced to match what the altered voice says.
"The impersonation videos are particularly pernicious as they further degrade our ability to discern authentic accounts online," Mantzarlis said.
Last year, Mantzarlis discovered hundreds of ads on YouTube featuring deepfakes of celebrities -- including Arnold Schwarzenegger, Sylvester Stallone, and Mike Tyson -- promoting supplements branded as erectile dysfunction cures.
The rapid pace of generating short-form AI videos means that even when tech platforms remove questionable content, near-identical versions quickly reappear -- turning moderation into a game of whack-a-mole.
Researchers say this creates unique challenges for policing AI-generated content, requiring novel solutions and more sophisticated detection tools.
AFP's fact checkers have repeatedly debunked scam ads on Facebook promoting treatments -- including erectile dysfunction cures -- that use fake endorsements by Ben Carson, a neurosurgeon and former U.S. cabinet member.
Yet many users still consider the endorsements legitimate, illustrating the appeal of deepfakes.
"Scammy affiliate marketing schemes and questionable sex supplements have existed for as long as the internet and before," Mantzarlis said. "As with every other bad thing online, generative AI has made this abuse vector cheaper and quicker to deploy at scale."
© 2025 AFP
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Japan Today
15 hours ago
- Japan Today
Startups show off ocean-preserving tech at Paris trade fair
By Mona Guichard Harnessing ocean currents to boost fuel efficiency of vessels, or tracking whales using sensor data and AI -- startups at Paris trade fair Vivatech have been showing off the latest innovations aimed at protecting the environment. Recently developed AI programs capable of learning from vast datasets have boosted projects trying to understand and predict real-world phenomena, several company founders told AFP. "We have to use AI because in the natural world there are too many variables" to deal with manually, said Emily Charry Tissier, a biologist and founder of Canadian startup Whale Seeker, which is developing technology to track sea mammals. Powered by "neural network" systems that ape the functioning of the human brain, the learning systems behind today's AI models "can calculate a weather forecast 1,000 times faster than a standard digital model running on a supercomputer", agreed oceanographer Alexandre Stegner. He flagged an AI model developed by his firm, Amphitrite, that he said could predict ocean currents by crunching "several layers of satellite data corresponding to different physical variables". It can forecast currents up to 10 days in advance, he said, offering sea captains "a simple way to save fuel" by slightly changing course and using currents to gain a speed boost of up to four knots. That could save operators money on fuel, reduce the carbon emissions from shipping, and avoid the classic solution of telling sea captains to reduce their speed. Technologies like these were being shown off in the halls of Vivatech as the U.N. Ocean Conference (UNOC) drew to a close hundreds of kilometers to the south in French Mediterranean city Nice. The conference has pushed a treaty to protect 60 percent of the world's oceans closer to becoming law, with 55 signatures -- just five shy of the number required for its enactment. New technologies could be "a very good thing" for the oceans, said Andre Abreu, International Affairs Director at the Paris-based Tara Ocean Foundation. But he warned that innovation should not be harnessed to allow more fish to be caught. "That would mean shooting ourselves in the foot" on goals like preserving marine biodiversity, he said. That ambiguity can be seen in technology from OceanEyes, a Japanese startup using AI analysis of satellite data to predict sea conditions. The company hopes to cut the time fishing boats spend tracking down a catch. "A big problem in Japan is the efficiency of the fishery operations. Many fishers spend a lot of time searching for fish in the water," said boss Yusuke Tanaka. With less fuel burnt, operators will save money and greenhouse emissions can be slashed. Anticipating concerns about overfishing, OceanEyes said it also aimed to help vessels comply with recently updated Japanese regulations that oblige fishers to "ensure sustainable use of marine resources". Whale Seeker's Tissier said technology could be used in a considered way to find sustainable solutions. "I'd like the market to recognize its own limits -- not the limits of what we can do, but what we should do," she told AFP. That attitude pushed her to refuse to work with a company that wanted to use whale detection to identify nearby fish to catch. But startups cannot grow without funding and, in the context of oceans, investments are likely to come from big firms keen to make a saving -- from fishing and ship management companies to haulage and logistics giants. This could well limit their ability to stand on principle. Stegner called for "regulations that would push the maritime sector to reduce carbon emissions". But Charry Tissier said the initiative could come from business. "Technology is developing so much faster than regulation... what I'd like is for big companies to decide for themselves to be responsible," she said. © 2025 AFP
Japan Today
2 days ago
- Japan Today
Man who let snakes bite him 200 times spurs new antivenom hope
Tim Friede has allowed himself to be bitten by snakes more than 200 times By Daniel Lawler Tim Friede was feeling particularly down on the day after the September 11 attacks, so he went to his basement and let two of the world's deadliest snakes bite him. Four days later, he woke up from a coma. "I know what it feels like to die from snakebite," Friede told AFP via video call from his home in the small US town of Two Rivers, Wisconsin. This experience might put most people off snakes entirely, but Friede simply vowed to be more careful next time. From 2000 to 2018, he allowed himself to be bitten by snakes more than 200 times. He also injected himself with their venom over 650 times. Friede endured this pain because he wanted to achieve total immunity to venom, a practice called mithridatism which should not be tried at home. After a couple of years, Friede started to believe he could be the basis for a better kind of antivenom. The former truck mechanic, who does not have a university degree, long struggled to be taken seriously by scientists. But last month, a study published in the prestigious Cell journal showed that antibodies from his blood protect against a range of snake venom. The researchers now hope Friede's hyper-immunity could even lead to the development of a universal antivenom. This would fill a major need, because currently most antivenoms only cover one or a few of the world's 600 venomous snakes. Up to 138,000 people are killed by snakebites a year, while 400,000 suffer amputations or other disabilities, according to the World Health Organization. These figures are believed to be vastly underestimated because snakebite victims typically live in poorer, remote areas. Friede's first bite was from a harmless garter snake when he was five years old. "I was afraid, I cried, I ran away," said Friede, now 57. Then he started bringing snakes home and hiding them in pickle jars. His mother sought counselling, but his interest in snakes persisted. Things escalated after Friede attended a class that taught him how to "milk" snakes for their venom. How antivenom is made has changed little over the last 125 years. Small doses of snake venom are injected into animals such as horses, which produce antibodies that can be extracted and used as antivenom. However this antivenom usually only works for bites from that particular species of snake -- and it includes other antibodies from horse that can cause serious side-effects including anaphylactic shock. "I thought, well, if they make antivenom in horses, why can't I just use myself as a primate?" Friede said. He started working through the venom from all the deadly species he could get his hands on, such as cobras, taipans, black mambas and rattlesnakes. "There is pain every time," he said. For years, the scientists he contacted to take advantage of his immunity refused to bite. Then in 2017, immunologist Jacob Glanville, who previously worked on universal vaccines, turned his attention towards antivenom. Glanville told AFP he had been looking for "a clumsy snake researcher who'd been bit accidentally a couple times," when he came across a video of Friede taking brutal back-to-back snake bites. When they first spoke, Glanville said he told Friede: "I know this is awkward, but I would love to get my hands on some of your blood." "I've been waiting for this call for a long time," came the response, Glanville said. The antivenom described in the Cell paper includes two antibodies from Friede's blood, as well as a drug called varespladib. It offered mice full protection against 13 of the 19 snake species tested, and partial protection for the remaining six. The researchers hope a future cocktail will cover far more snakes -- particularly vipers -- with further trials planned on dogs in Australia. Timothy Jackson of the Australian Venom Research Unit praised the immunological research, but questioned whether a human needed to be involved, pointing to synthetically developed antibodies. Glanville said the ultimate goal of his US-based firm Centivax was to develop a universal antivenom administered by something like an EpiPen, potentially produced in India to keep the costs down. Friede said he was "proud" to have made a "small difference" in medical history. Now working for Centivax, Friede stopped self-inflicting himself with venom in 2018 to save the firm from liability issues. But he hopes to get bitten by snakes again in the future. "I do miss it," he said. © 2025 AFP
Japan Today
2 days ago
- Japan Today
The most eye-catching products at Paris's Vivatech trade fair
Visitors browse through the stands at the VivaTech technology fair at the Paris Expo Porte de Versailles By Daxia ROJAS Products ranging from footwear to AI counterfeit detectors fill the halls of Paris's Vivatech trade fair, which runs until Saturday. Here are some of the highlights of this year's show gathered by AFP on the scene: Anti-counterfeiting AI For humans, spotting the difference between a Lacoste polo shirt and a fake sporting the brand's crocodile logo can be tricky. But French startup Vrai AI believes its artificial intelligence model can tell the two apart based on a simple photo. "AI can detect micro-mistakes" made by counterfeit manufacturers of products like off-the-rack clothes, banknotes or even anti-malarial medications, co-founder Hugo Garcia-Cotte tells AFP. "It's more reliable than humans," he adds. Lacoste has been testing the AI model since November, with customs services in countries like Cameroon and Senegal also taking an interest. Robotic telemedicine Scooting around on castor wheels, column-shaped robots from Hong Kong firm Robocore can serve as mobile advertising billboards -- but for now are mostly deployed for medical purposes in hospitals and retirement homes. "We are in about 200 elderly homes in the United States, 1,000 elderly homes in Hong Kong, and we are in a lot of hospitals as well," boss Long Hei Roy Lim tells AFP. The robots, each a few feet high, use AI to navigate environments autonomously, including taking the lift. They can also analyse patients' medical data and have conversations powered by chatbots from American developer OpenAI or Chinese competitor DeepSeek. Robocore says its robots can save time for health workers, whose workload is cut to simply checking up on what the robots have distributed to patients -- hopefully limiting the impact of doctor shortages. With 50,000 units deployed across 33 countries, Robocore was hoping to expand into new markets thanks to its attendance at Vivatech. Nimble electric vehicles At just 79 centimeters (two and half feet) wide and 2.4 meters long, French startup Aemotion's four-wheeled electric vehicle is designed to weave through traffic, saving commuters time spent in jams. Built in central France, the black transport that's not quite a motor scooter nor really a car is fully enclosed and can carry two people at up to 115 kilometers per hour. "We aim to sell 5,000 of these a year within five years," company chief Alexandre Lagrange told AFP at the company's stand, where he is showing off the third version of Aeomotion's prototype. Pre-orders are already open for the vehicle, with the company aiming to get road licensing early next year, with a price tag of 20,000 euros ($23,000). The first drivers will get their hands on one in late 2026 or early 2027, co-founder Alain Dublin said. Smart shoes Imagine being guided on a walk around busy city streets not by brightly-coloured signs and traffic lights, but by vibrations in your feet. That's the promise of Japanese start-up Ashirase, which has developed a vibrating tool that slips into shoes aimed at making life easier for visually impaired people. 'We use AI for accurate positioning, by mixing the sensor data from the Ashirase device and location data from (a) smartphone,' development chief Ryohei Tokuda said. Users simply have to select a destination in the accompanying app and the buzzing inserts will let them know when to turn. Backed by carmaker Honda, Ashirase's smart shoe upgrades are already on sale in Japan. It hopes to bring them to Europe starting with a launch in Germany in September. © 2025 AFP
