AI Generated Videos And Audios Of Pope Leo Viral On YouTube, Tiktok
AI-generated videos and audios of Pope Leo XIV are populating rapidly online, racking up views as platforms struggle to police them.
An AFP investigation identified dozens of YouTube and TikTok pages that have been churning out AI-generated messages delivered in the pope's voice or otherwise attributed to him since he took charge of the Catholic Church last month.
The hundreds of fabricated sermons and speeches, in English and Spanish, underscore how easily hoaxes created using artificial intelligence can elude detection and dupe viewers.
"There's natural interest in what the new pope has to say, and people don't yet know his stance and style," said University of Washington professor emeritus Oren Etzioni, founder of TrueMedia.org, a nonprofit focused on fighting deepfakes.
"A perfect opportunity to sow mischief with AI-generated misinformation."
After AFP presented YouTube with 26 channels posting predominantly AI-generated pope content, the platform terminated 16 of them for violating its policies against spam, deceptive practices and scams, and another for violating YouTube's terms of service.
"We terminated several channels flagged to us by AFP for violating our Spam policies and Terms of Service," spokesperson Jack Malon said.
The company also booted an additional six pages from its partner program allowing creators to monetize their content.
TikTok similarly removed 11 accounts that AFP pointed out -- with over 1.3 million combined followers -- citing the platform's policies against impersonation, harmful misinformation and misleading AI-generated content of public figures.
'Chaotic uses'
With names such as "Pope Leo XIV Vision," the social media pages portrayed the pontiff supposedly offering a flurry of warnings and lessons he never preached.
But disclaimers annotating their use of AI were often hard to find -- and sometimes nonexistent.
On YouTube, a label demarcating "altered or synthetic content" is required for material that makes someone appear to say something they did not. But such disclosures only show up toward the bottom of each video's click-to-open description.
A YouTube spokesperson said the company has since applied a more prominent label to some videos on the channels flagged by AFP that were not found to have violated the platform's guidelines.
TikTok also requires creators to label posts sharing realistic AI-generated content, though several pope-centric videos went unmarked.
A TikTok spokesperson said the company proactively removes policy-violating content and uses verified badges to signal authentic accounts.
Brian Patrick Green, director of technology ethics at Santa Clara University, said the moderation difficulties are the result of rapid AI developments inspiring "chaotic uses of the technology."
Many clips on the YouTube channels AFP identified amassed tens of thousands of views before being deactivated.
On TikTok, one Spanish-language video received 9.6 million views while claiming to show Leo preaching about the value of supportive women. Another, which carried an AI label but still fooled viewers, was watched some 32.9 million times.
No video on the pope's official Instagram page has more than 6 million views.
Experts say even seemingly harmless fakes can be problematic especially if used to farm engagement for accounts that might later sell their audiences or pivot to other misinformation.
The AI-generated sermons not only "corrode the pope's moral authority" and "make whatever he actually says less believable," Green said, but could be harnessed "to build up trust around your channel before having the pope say something outrageous or politically expedient."
The pope himself has also warned about the risks of AI, while Vatican News called out a deepfake that purported to show Leo praising Burkina Faso leader Ibrahim Traore, who seized power in a 2022 coup.
AFP also debunked clips depicting the pope, who holds American and Peruvian citizenships, criticizing US Vice President JD Vance and Peru's President Dina Boluarte.
"There's a real crisis here," Green said. "We're going to have to figure out some way to know whether things are real or fake."
(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Time of India
2 hours ago
- Time of India
YouTube pilots vernacular thumbnails to complement dubbing tools
YouTube is introducing a new feature that can help creators expand their global reach by tailoring their thumbnails for international audiences, according to a Business Insider report. According to a company spokesperson, the platform will soon allow select creators to upload different thumbnails for each dubbed version of their videos, enhancing the ability to localise content based on the viewer's language. The feature is expected to roll out in the coming days and will initially be available only to creators who already have access to YouTube's multi-language audio dubbing tools. YouTube has been gradually expanding these tools, which use AI to enable creators to dub their videos into other languages. The platform began testing this technology with a limited group of creators as early as 2023. 'We're always testing more ways for creators to reach new audiences,' the spokesperson told Business Insider. 'In this case, a handful of creators are able to localise their thumbnails for videos with multiple language audio tracks.' This new capability builds on YouTube's broader strategy to break language barriers and maximise content visibility worldwide. The platform has seen growing interest in dubbing among major content creators, including global YouTube star MrBeast , who has publicly embraced AI-powered dubbing as a tool to reach millions of non-English speaking viewers. By allowing localised thumbnails, YouTube not only ensures that video titles and audio match a viewer's language preferences, but also makes the visual experience more culturally relevant—potentially increasing click-through rates and engagement in diverse regions. Live Events This feature reflects YouTube's ongoing investment in global creator tools, further positioning the platform as a leader in cross-language content distribution. Discover the stories of your interest Blockchain 5 Stories Cyber-safety 7 Stories Fintech 9 Stories E-comm 9 Stories ML 8 Stories Edtech 6 Stories
Economic Times
5 hours ago
- Economic Times
Google removes NSFW app XShorts from Play Store after ads scandal: Report
Google has removed the adult short video app XShorts from its Play Store after an Adweek report revealed that the platform—despite carrying a 'Teen' rating—was hosting sexually suggestive and racially offensive content, while also running ads from major brands including Verizon, Shell, and Amazon. XShorts, a short-form video app similar to TikTok, had been trending among the top five apps on the Play Store this week. However, the app's misclassification allowed it to sidestep typical ad safety controls, exposing top brands to reputational risk. Ad servers and demand-side platforms (DSPs) such as Facebook Audience Network, Amazon, AppLovin, Basis, InMobi, and Moloco had unknowingly served ads to the app based on its maturity rating. The incident highlights the complex challenges of digital ad placement in the automated, fast-moving programmatic ecosystem—particularly with emerging platforms that escape proper outreach from Adweek, DSPs including Meta, Basis, InMobi, and Moloco took steps to either block or reclassify XShorts. Meanwhile, brands such as Roblox, Puck, Todd Snyder, and &SONS tightened their ad placement controls or blocked the app independently confirmed ad placements on XShorts for companies including Audible, Walgreens, Microsoft, Popeyes, Starbucks, Roblox, Gatorade, Wayfair, Instacart, and Square. The app displayed both banner ads beneath videos and full-screen ads between videos. Although a Google search may still list the Play Store link for XShorts, the page now shows an error message: 'We're sorry, the requested URL was not found on this server.'
Time of India
6 hours ago
- Time of India
China leaders take reins at TikTok Shop in US as sales miss goal
ByteDance Ltd., TikTok 's parent company, has been replacing US-hired staff near Seattle with leaders connected to China, aiming to replicate its e-commerce success in Asia after sales fell short in America. TikTok Shop initially set a goal to increase its US e-commerce business tenfold last year to $17.5 billion in transaction volume, but the company had to drastically lower that goal, according to people familiar with the plan who spoke on condition of anonymity because they were not authorized to talk publicly. TikTok established its Shop business in the Seattle area near Inc., the online retail giant it was aiming to displace. Meetings that used to be held in English are now often conducted in Mandarin and managers increasingly write in Chinese when communicating on Feishu, ByteDance's internal Slack-like app, with English-speaking staff forced to rely on the built-in translation function. More than 100 TikTok Shop employees in the US have been fired or have left amid confusion between leaders that has worsened the work environment, according to people familiar with the company. The cultural transition taking place in the company coincides with its fight for survival in the US — due mainly to the app's Chinese ties. A national security law passed by Congress last year requires TikTok's US business to be spun off from its Chinese parent company or it will face a ban. Lawmakers warned that TikTok's ties to China pose a threat to the safety and security of American users. President Donald Trump has twice delayed the ban — with legal assurances from his attorney general — and another deadline for divestiture looms later this month, though that might also be extended, Wall Street Journal has reported. ByteDance has said it doesn't intend to sell. The TikTok Shop near Seattle in February began requiring workers to be in the office five days a week for eight hours a day, according to a memo reviewed by Bloomberg. The change is in contrast to some other major tech companies that still offer flexible work schedules, and has been particularly burdensome for employees who often join late-night calls with colleagues in Asia after they leave the office, according to former employees. US-based staff require human resources and manager pre-approval to work from home. The changes were introduced after Bob Kang, China-based global head of TikTok's e-commerce division, visited the office in Bellevue, Washington, earlier this year and found there weren't enough staff pressent on a work day, according to multiple people who spoke on the condition of anonymity for fear of retaliation. Increasing influence Increasing Chinese influence over TikTok's fastest-growing business may raise questions about its previous corporate promise to distance the US operation from China. After Trump initially tried to ban the app during his first term, the company announced a security plan dubbed 'Project Texas' and vowed to wall off the app's US data and operations from any Chinese oversight. TikTok Shop is the biggest source of revenue for the video-sharing app besides advertising, and it has become a major investment area for ByteDance. Adding full-scale commerce to its eye-catching content and popular influencers sets it apart from rivals like Instagram and YouTube. The company still aims to challenge Amazon in major markets. To better compete, TikTok Shop recruited aggressively near Seattle over the past three years, targeting people with experience at Amazon, according to a review of Linkedin profiles and people who worked at both companies. In some corners of TikTok's Bellevue office of roughly 1,000 employees, the workflow felt like a remix of previous Amazon teams, the people said. But since January, growing tension in the teams below Kang and Nico Le Bourgeois, who oversaw TikTok's e-commerce operations in the US, became a distraction for staff who were often unsure about whose orders to follow, the people said. TikTok's uncertain fate in the US also weighed on morale. The company carried out a round of layoffs in April. A second batch followed in May. In the first round, Le Bourgeois was demoted when Mu Qing, a Chinese executive from ByteDance's e-commerce platform Douyin moved to the Seattle area to run TikTok Shop in the US. After the second bout, Mu sent an internal message saying Le Bourgeois was leaving to pursue other opportunities, according to a copy of the message seen by Bloomberg. Those cuts were intended to improve TikTok's 'efficiency,' according to former employees, though it wasn't clear to staff what factors contributed to a worker's efficiency rating. More like Douyin With these changes, ByteDance leaders are bringing in people who are familiar with what worked for the company in China, where Douyin, its TikTok clone for the Chinese market, has evolved into a $490 billion shopping phenomenon. In addition to Mu, who was the head of Douyin's e-commerce, six other leaders with Chinese backgrounds were appointed in April, according to a different internal memo from Kang viewed by Bloomberg. One challenge is that habits of many American users trend toward passive TikTok scrolling as opposed to making purchases in the app. Some US sellers told Bloomberg that they have also been reluctant to invest in the platform, given the possible ban. The final tally for 2024 sales came in at around $9 billion, according to an estimate by Singapore-based consultancy Momentum Works, far below the internal goal of $17.5 billion in transaction volume. A TikTok spokesperson previously called the $17.5 billion internal goal 'inaccurate.' TikTok Shop's US struggles haven't halted the company's global shopping ambitions. ByteDance in 2021 rolled out e-commerce services in countries including Indonesia, Vietnam and the UK. In Southeast Asia, it's already the region's biggest shopping platform after Shopee, according to Momentum Works. Last year, TikTok Shop opened in five countries in Europe, including Germany and Spain. The Europe expansion was delayed because the company first prioritised US growth, Bloomberg reported. A TikTok spokesperson did not respond to an emailed request for comment for this story. This is a crucial month for TikTok in the US. The company will host merchants and creators in Los Angeles next week for a summit featuring some of the new leaders of the e-commerce unit. The current deadline for ByteDance to sell the TikTok's US operation is June 19 and there have been several interested suitors. The company came close to a possible spin-off in April to a consortium of investors that included Oracle Corp., but the deal was scuttled in part because of Trump's trade war with China. Meanwhile, the churn of e-commerce employment continues in the Seattle area. Current and former TikTok Shop employees told Bloomberg that they get hounded by recruiting messages from Temu , another Chinese e-commerce competitor.
