'Tool for grifters': AI deepfakes push bogus sexual cures
Tired of too many ads?
Remove Ads
Tired of too many ads?
Remove Ads
Tired of too many ads?
Remove Ads
Holding an oversized carrot, a brawny, shirtless man promotes a supplement he claims can enlarge male genitalia -- one of countless AI-generated videos on TikTok peddling unproven sexual treatments.The rise of generative AI has made it easy -- and financially lucrative -- to mass-produce such videos with minimal human oversight, often featuring fake celebrity endorsements of bogus and potentially harmful products.In some TikTok videos, carrots are used as a euphemism for male genitalia, apparently to evade content moderation policing sexually explicit language."You would notice that your carrot has grown up," the muscled man says in a robotic voice in one video, directing users to an online purchase link."This product will change your life," the man adds, claiming without evidence that the herbs used as ingredients boost testosterone and send energy levels "through the roof."The video appears to be AI-generated, according to a deepfake detection service recently launched by the Bay Area-headquartered firm Resemble AI , which shared its results with AFP."As seen in this example, misleading AI-generated content is being used to market supplements with exaggerated or unverified claims, potentially putting consumers' health at risk," Zohaib Ahmed, Resemble AI's chief executive and co-founder, told AFP."We're seeing AI-generated content weaponized to spread false information."The trend underscores how rapid advances in artificial intelligence have fueled what researchers call an AI dystopia, a deception-filled online universe designed to manipulate unsuspecting users into buying dubious products.They include everything from unverified -- and in some cases, potentially harmful -- dietary supplements to weight loss products and sexual remedies."AI is a useful tool for grifters looking to create large volumes of content slop for a low cost," misinformation researcher Abbie Richards told AFP."It's a cheap way to produce advertisements," she added.Alexios Mantzarlis, director of the Security, Trust, and Safety Initiative at Cornell Tech, has observed a surge of "AI doctor" avatars and audio tracks on TikTok that promote questionable sexual remedies.Some of these videos, many with millions of views, peddle testosterone-boosting concoctions made from ingredients such as lemon, ginger and garlic.More troublingly, rapidly evolving AI tools have enabled the creation of deepfakes impersonating celebrities such as actress Amanda Seyfried and actor Robert De Niro."Your husband can't get it up?" Anthony Fauci, former director of the National Institute of Allergy and Infectious Diseases, appears to ask in a TikTok video promoting a prostate supplement.But the clip is a deepfake, using Fauci's likeness.Many manipulated videos are created from existing ones, modified with AI-generated voices and lip-synced to match what the altered voice says."The impersonation videos are particularly pernicious as they further degrade our ability to discern authentic accounts online," Mantzarlis said.Last year, Mantzarlis discovered hundreds of ads on YouTube featuring deepfakes of celebrities -- including Arnold Schwarzenegger, Sylvester Stallone, and Mike Tyson -- promoting supplements branded as erectile dysfunction cures.The rapid pace of generating short-form AI videos means that even when tech platforms remove questionable content, near-identical versions quickly reappear -- turning moderation into a game of whack-a-mole.Researchers say this creates unique challenges for policing AI-generated content, requiring novel solutions and more sophisticated detection tools.AFP's fact checkers have repeatedly debunked scam ads on Facebook promoting treatments -- including erectile dysfunction cures -- that use fake endorsements by Ben Carson, a neurosurgeon and former US cabinet member.Yet many users still consider the endorsements legitimate, illustrating the appeal of deepfakes."Scammy affiliate marketing schemes and questionable sex supplements have existed for as long as the internet and before," Mantzarlis said."As with every other bad thing online, generative AI has made this abuse vector cheaper and quicker to deploy at scale."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
News18
6 hours ago
- News18
Infosys Gives 80% Average Bonus Payout To Employees For Q1 FY26: Report
The bonus, applicable to employees in Band 6 and below (which largely includes junior and mid-level staff), is linked to performance ratings across levels, according to a report. IT major Infosys has rolled out its quarterly performance bonus for the first quarter of FY2025-26, with an organisation-wide average payout of 80 per cent, according to a Moneycontrol report citing an internal communication. The move follows the Bengaluru-headquartered company's strong June 2025 quarter earnings, where it beat analyst expectations on both profit and revenue. The bonus, applicable to employees in Band 6 and below (which largely includes junior and mid-level staff), is linked to performance ratings across levels. For PL4 employees, payouts range between 80-89 per cent, while PL5 employees will see 78-87 per cent, and PL6 employees will receive 75-85 per cent, depending on their performance category. At PL4, those rated 'Outstanding" will get 89 per cent of their eligible bonus, while those marked 'Needs Attention" are set at 80 per cent. At PL6, top performers will receive 85 per cent, with the lowest band fixed at 75 per cent. Infosys has informed employees that their individual bonus letters will be uploaded to their e-dockets. The average payout this quarter is higher than the previous one, which stood at around 65 per cent for eligible staff. The company posted an 8.7 per cent year-on-year rise in net profit to Rs 6,921 crore in Q1, while revenue grew 7.5 per cent to Rs 42,279 crore, surpassing Street forecasts. This comes against the backdrop of wider compensation changes at the company. Infosys had earlier announced that it would roll out 6–8 percent annual salary hikes for employees in India starting January 2025, with a second phase in April 2025. 'Broadly, the comp (annual salary increment) that we are expecting is 6-8% in India, and the overseas comps will be in line with the earlier comp reviews," Infosys CFO Jayesh Sanghrajka had said after its Q3FY25 results. Infosys employs over 3.23 lakh professionals. The development follows rival Tata Consultancy Services' announcement of a wage hike effective September 1, even as it reportedly prepares to lay off about 12,000 employees this year. view comments First Published: August 20, 2025, 17:11 IST Disclaimer: Comments reflect users' views, not News18's. Please keep discussions respectful and constructive. Abusive, defamatory, or illegal comments will be removed. News18 may disable any comment at its discretion. By posting, you agree to our Terms of Use and Privacy Policy. Loading comments...
Time of India
7 hours ago
- Time of India
German firm plans to open its first tech centre in India at Indore
Indore: A German tech firm announced plans to invest at least $8 million to establish a technology centre in Indore, marking its first setup in India. Another Berlin-headquartered technology company also expressed interest in establishing a technology centre in the state, focusing on the service sector.A delegation of five German technology companies visited Indore on a week-long trip concluding on August 22 under the state's Global Startup Exchange Programme. They held meetings with officials from the industries department and key tech firms on Tuesday. The delegation is part of the memorandum of understanding signed between Madhya Pradesh Industrial Development Corporation (MPIDC) and Germany India Innovation Centre (GIIC) during the Global Investors Summit held in Bhopal in Feb 2025. GIIC managing director Siddharth Bhasin said, "The objective behind this visit is locking some good deals and collaboration. German investors are exploring opportunities to share technology and expertise with tech companies of Indore. India is primarily known for its IT services, but the collaboration with German firms could aid in establishing firms working on product development in healthcare, edtech, and others." Speaking on the sidelines of an industry meeting in Indore, the German tech firm, Q-nnect AG chief product officer Andre Lange said, "We want to set up a tech centre in Indore and be part of building an ecosystem in the state of Madhya Pradesh. The estimated cost of the tech centre is between $8-10 million, and this facility will make the state more competitive for attracting investments from more tech firms." German AI and software development companies stated that the presence of IT giants like TCS, Infosys and Infobeans, among others in Indore — a home to more than 1000 big and small IT firms—makes the place suitable for German investments and collaborations. "I have explored Bengaluru, Hyderabad, and other Indian cities and found Indore well suited as it has talent due to the presence of IIT and IIM, ease of doing business, and favourable policies for tech companies," said Lange. Another German tech company stated they are in advanced talks with a homegrown listed IT firm for collaborating on technology sharing, soft training, and providing advanced services to clients. "We are in talks with an Indore-based IT giant for collaborating with them with a focus on the services sector. We are also planning to set up a tech centre but have not decided on the location. We are considering Indore seriously because this place has good availability of talent and, most importantly, this is not saturated, which makes it a great place to operate," said Joanna Maja Morzy, marketing and operations lead at Talonic. German tech firms mentioned that the tariffs imposed by the United States will help further strengthen the business relationship with India and pave the way for new avenues for other nations. The German delegation held closed-door meetings and workshops with homegrown IT company Infobeans, followed by interactions with other tech firms and industry department officials at the office of MPIDC. MPIDC Indore executive director Himanshu Prajapati said, "The govt is playing a supportive and encouraging role in international partnerships and technical cooperation. The operating cost in Indore is much lower compared to metro cities, while the city's liveability makes it even more attractive for entrepreneurs and investors to work here. As the digitization of data in India is still in its early stages, and data duplicity affects accuracy in the long term, the country is currently focusing on the integration of AI and data-driven services." "We are finding immense opportunities to collaborate on the AI side. We will help some of them with their go to market strategy in India and to our customers. German companies are doing some really good work on the generative AI side," said Infobeans co-founder Siddharth Seth.
Time of India
7 hours ago
- Time of India
AI Impact: Big discounts in IT deals hurt, but tech spend set to rise, says Coforge CEO
Major clients renewing IT contracts at 30-50% lower rates, citing increasing use of artificial intelligence (AI), is deflationary for the outsourcing industry, Coforge chief executive Sudhir Singh said. At the same time, however, technology spends on transformational projects are on the rise, he told ET in an interview.'Every time there is a disruptive technology, tech spend as an aggregate always increases,' Singh said, adding that Coforge aims to capitalise on $283-billion outsourcing industry's clients globally are seeing a contraction in the investments on 'run budgets' such as infrastructure, maintenance, and testing, he noted. 'Having said that, there is no enterprise which is saying that with AI having come in, we will reduce our spend on technology. They understand it is a massive lever for driving change and transformation,' Singh added. Amid AI disruption and an uncertain macro environment, Indian software service providers are facing heightened cost pressures on account of a fundamental shift in their deals and pricing. Coforge seems to have bucked that trend. The mid-tier IT firm won a $1.5-billion deal from US firm Sabre through request for proposal (RFP) in the March quarter, beating two large IT service providers. For the June quarter, the Noida-and-New Jersey-headquartered firm won five large deals, with total orders worth $507 million. Its revenue rose 8.2% sequentially in rupee terms and by 9.6% in dollar terms to Rs 3,688.6 crore, or $442.4 million. Year-on-year, the revenue grew 54% both in rupee and dollar terms, supported by the Cigniti acquisition. Margins improved to 17.5%, from 16.9% in the preceding quarter, but declined from 18% a year ago. This comes at a time when most larger peers are witnessing a sub-5% revenue growth and Coforge's immediate rivals are seeing a margin crunch. As of March end, the company is the eighth largest Indian IT firm with a revenue of $1.45 billion for FY25, behind Mphasis , which reported a revenue of $1.68 billion for the fiscal. In 2020, NIIT Technologies was rebranded as Coforge a year after it was taken over by Baring Private Equity Asia. Its revenue was $600 million then. 'We were a small cap,' Singh said. 'When we came was three times our size. We will, I think, take over Mphasis next quarter, we should be the biggest mid cap.' Coforge has been reporting stronger growth than larger industry peers, steadily climbing the ranks among the top 10 IT companies. Singh also expects the company's margin to go up by at least 140 basis points, or 1.4 percentage points, in FY26 despite subdued demand and macro environment. 'We'd be very comfortable growing around 18-19% in the short term, till we hit $5 billion,' he said. Singh also underlined that there is no material de-hyphenation of revenue-to-headcount growth at present and majority of the impact on jobs is still on select AI-based projects. The fixed-price and milestone-based contracts continue to demand employees and Coforge will continue to increase its workforce as of now, he said. While clients are looking to slash the run budget, they are increasing the 'change budget,' which used to be called the development projects. 'These days, we call it transformation projects. Such projects' conversion does not happen through RFPs (request for proposals) as enterprises are still not yet fluent on how to apply AI to drive such projects,' Singh said. 'We, for one, try to focus more on the change bucket, where you don't have to compete with an RFP that has come out,' he added.
