'Tool for grifters': AI deepfakes push bogus sexual cures
WASHINGTON: Holding an oversized carrot, a brawny, shirtless man promotes a supplement he claims can enlarge male genitalia – one of countless AI-generated videos on TikTok peddling unproven sexual treatments.
The rise of generative AI has made it easy – and financially lucrative – to mass-produce such videos with minimal human oversight, often featuring fake celebrity endorsements of bogus and potentially harmful products.
In some TikTok videos, carrots are used as a euphemism for male genitalia, apparently to evade content moderation policing sexually explicit language.
"You would notice that your carrot has grown up," the muscled man says in a robotic voice in one video, directing users to an online purchase link.
"This product will change your life," the man adds, claiming without evidence that the herbs used as ingredients boost testosterone and send energy levels "through the roof."
The video appears to be AI-generated, according to a deepfake detection service recently launched by the Bay Area-headquartered firm Resemble AI, which shared its results with AFP.
"As seen in this example, misleading AI-generated content is being used to market supplements with exaggerated or unverified claims, potentially putting consumers' health at risk," Zohaib Ahmed, Resemble AI's chief executive and co-founder, told AFP.
"We're seeing AI-generated content weaponized to spread false information."
'Cheap way'
The trend underscores how rapid advances in artificial intelligence have fueled what researchers call an AI dystopia, a deception-filled online universe designed to manipulate unsuspecting users into buying dubious products.
They include everything from unverified – and in some cases, potentially harmful – dietary supplements to weight loss products and sexual remedies.
"AI is a useful tool for grifters looking to create large volumes of content slop for a low cost," misinformation researcher Abbie Richards told AFP.
"It's a cheap way to produce advertisements," she added.
Alexios Mantzarlis, director of the Security, Trust, and Safety Initiative at Cornell Tech, has observed a surge of "AI doctor" avatars and audio tracks on TikTok that promote questionable sexual remedies.
Some of these videos, many with millions of views, peddle testosterone-boosting concoctions made from ingredients such as lemon, ginger and garlic.
More troublingly, rapidly evolving AI tools have enabled the creation of deepfakes impersonating celebrities such as actress Amanda Seyfried and actor Robert De Niro.
"Your husband can't get it up?" Anthony Fauci, former director of the National Institute of Allergy and Infectious Diseases, appears to ask in a TikTok video promoting a prostate supplement.
But the clip is a deepfake, using Fauci's likeness.
'Pernicious'
Many manipulated videos are created from existing ones, modified with AI-generated voices and lip-synced to match what the altered voice says.
"The impersonation videos are particularly pernicious as they further degrade our ability to discern authentic accounts online," Mantzarlis said.
Last year, Mantzarlis discovered hundreds of ads on YouTube featuring deepfakes of celebrities – including Arnold Schwarzenegger, Sylvester Stallone, and Mike Tyson – promoting supplements branded as erectile dysfunction cures.
The rapid pace of generating short-form AI videos means that even when tech platforms remove questionable content, near-identical versions quickly reappear – turning moderation into a game of whack-a-mole.
Researchers say this creates unique challenges for policing AI-generated content, requiring novel solutions and more sophisticated detection tools.
AFP's fact checkers have repeatedly debunked scam ads on Facebook promoting treatments – including erectile dysfunction cures – that use fake endorsements by Ben Carson, a neurosurgeon and former US cabinet member.
Yet many users still consider the endorsements legitimate, illustrating the appeal of deepfakes.
"Scammy affiliate marketing schemes and questionable sex supplements have existed for as long as the internet and before," Mantzarlis said.
"As with every other bad thing online, generative AI has made this abuse vector cheaper and quicker to deploy at scale." – AFP
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Malaysian Reserve
a day ago
- Malaysian Reserve
AI's arrival at work reshaping employers' hunt for talent
PARIS — Predictions of imminent AI-driven mass unemployment are likely overblown, but employers will seek workers with different skills as the technology matures, a top executive at global recruiter ManpowerGroup told AFP at Paris's Vivatech trade fair. The world's third-largest staffing firm by revenue ran a startup contest at Vivatech in which one of the contenders was building systems to hire out customisable autonomous AI 'agents', rather than humans. Their service was reminiscent of a warning last month from Dario Amodei, head of American AI giant Anthropic, that the technology could wipe out half of entry-level white-collar jobs within one to five years. For ManpowerGroup, AI agents are 'certainly not going to become our core business any time soon,' the company's Chief Innovation Officer Tomas Chamorro-Premuzic said. 'If history shows us one thing, it's most of these forecasts are wrong.' An International Labour Organization (ILO) report published in May found that around 'one in four workers across the world are in an occupation with some degree of exposure' to generative AI models' capabilities. 'Few jobs are currently at high risk of full automation,' the ILO added. But the UN body also highlighted 'rapid expansion of AI capabilities since our previous study' in 2023, including the emergence of 'agentic' models more able to act autonomously or semi-autonomously and use software like web browsers and email. 'Soft skills' Chamorro-Premuzic predicted that the introduction of efficiency-enhancing AI tools would put pressure on workers, managers and firms to make the most of the time they will save. 'If what happens is that AI helps knowledge workers save 30, 40, maybe 50 percent of their time, but that time is then wasted on social media, that's not an increase in net output,' he said. Adoption of AI could give workers 'more time to do creative work' — or impose 'greater standardization of their roles and reduced autonomy,' the ILO said. There's general agreement that interpersonal skills and an entrepreneurial attitude will become more important for knowledge workers as their daily tasks shift towards corralling AIs. Employers identified ethical judgement, customer service, team management and strategic thinking as top skills AI could not replace in a ManpowerGroup survey of over 40,000 employers across 42 countries published this week. Nevertheless, training that adopts those new priorities has not increased in step with AI adoption, Chamorro-Premuzic lamented. 'For every dollar you invest in technology, you need to invest eight or nine on HR, culture transformation, change management,' he said. He argued that such gaps suggest companies are still chasing automation, rather than the often-stated aim of augmenting human workers' capabilities with AI. AI hiring AI? One of the areas where AI is transforming the world of work most rapidly is ManpowerGroup's core business of recruitment. But here candidates are adopting the tools just as quickly as recruiters and companies, disrupting the old way of doing things from the bottom up. 'Candidates are able to send 500 perfect applications in one day, they are able to send their bots to interview, they are even able to game elements of the assessments,' Chamorro-Premuzic said. That extreme picture was not borne out in a survey of over 1,000 job seekers released this week by recruitment platform TestGorilla, which found just 17 percent of applicants admitting to cheating on tests, and only some of those to using AI. Jobseekers' use of consumer AI tools meets recruiters doing the same. The same TestGorilla survey found almost two-thirds of the more-than-1,000 hiring decision-makers polled used AI to generate job descriptions and screen applications. But a far smaller share are already using the technology to actually interview candidates. Where employers today are focused on candidates' skills over credentials, Chamorro-Premuzic predicted that 'the next evolution is to focus on potential, not even skills even if I know the skills you bring to the table today, they might be obsolete in six months.' 'I'm better off knowing that you're hard-working, that you are curious, that you have good people skills, that you're not a jerk — and that, AI can help you evaluate,' he believes. — AFP
Malaysian Reserve
2 days ago
- Malaysian Reserve
Google turns internet queries into conversations
SAN FRANCISCO — Google on Friday began letting people turn online searches into conversations, with generative artificial intelligence providing spoken summaries of query results. With Audio Overviews, Gemini AI models quickly sum up query results in conversational style, according to Google. 'An audio overview can help you get a lay of the land, offering a convenient, hands-free way to absorb information whether you're multitasking or simply prefer an audio experience,' Google said in a blog post. 'We display helpful web pages right within the audio player on the search results page so you can easily dive in and learn more.' Google is beefing up online search with generative artificial intelligence, embracing AI despite fears for its ad-based business model. CEO Sundar Pichai recently unveiled a new AI mode in Google search. The search engine's nascent AI mode goes further than AI Overviews which display answers to queries from the tech giant's generative AI powers above the traditional blue links to websites and ads. Since Google debuted AI Overviews in search slightly more than a year ago, it has grown to more than 1.5 billion users across several countries, according to Pichai. Google's push into generative comes amid intensifying competition with OpenAI's ChatGPT, which has itself incorporated search engine features into its popular chatbot. — AFP
Rakyat Post
2 days ago
- Rakyat Post
A Promising Future — Young Malaysian Builds Voice And Motion Controlled Smart Rubbish Bin
Subscribe to our FREE A young Malaysian student has captured the internet's attention with her impressive invention, a smart trash bin that responds to both voice and motion commands. The video, shared by Syscore Academy (@syscore_academy) on TikTok, showcases the student proudly presenting her fully functional prototype. Syscore Academy, a technology and robotics school based in Klang, highlighted the innovation as part of its ongoing efforts to support young tech talent. In the clip, the student demonstrates how the bin works by saying simple commands like 'open' and 'close.' 🗑️𝐒𝐦𝐚𝐫𝐭 𝐓𝐫𝐚𝐬𝐡 𝐂𝐚𝐧 𝐏𝐫𝐨𝐭𝐨𝐭𝐲𝐩𝐞 – 𝐏𝐨𝐰𝐞𝐫𝐞𝐝 𝐛𝐲 𝐦𝐢𝐜𝐫𝐨:𝐛𝐢𝐭! 💡✨ Our students just built a smart trash can that opens automatically when it detects motion — all with a micro:bit! 👏 Big applause to our young innovators for building this eco-friendly, touchless solution! Instantly, the lid responds, opening and closing on cue. She further tests the device's motion sensitivity by clapping, prompting the lid to react accordingly. According to the academy, the bin is powered by a micro:bit, an open-source hardware device designed for educational programming. The system uses sound and motion sensors to trigger the lid, making it a completely touchless experience. Syscore Academy praised the student's ingenuity, pointing out the bin's potential to improve hygiene and convenience, especially useful in households, schools, or public areas. Beyond the technical achievement, the project has struck an emotional chord online. The comment section was flooded with praise from proud netizens. It can be said that the student is an inspiration for the next generation of inventors. This young innovator's success is a shining example of what can happen when creativity, curiosity, and opportunity come together and it's only the beginning. Share your thoughts with us via TRP's . Get more stories like this to your inbox by signing up for our newsletter.
