AI-generated Pope sermons flood YouTube, TikTok
An AFP investigation identified dozens of YouTube and TikTok pages that have been churning out AI-generated messages delivered in the pope's voice or otherwise attributed to him since he took charge of the Catholic Church last month.
The hundreds of fabricated sermons and speeches, in English and Spanish, underscore how easily hoaxes created using artificial intelligence can elude detection and dupe viewers.
"There's natural interest in what the new pope has to say, and people don't yet know his stance and style," said University of Washington professor emeritus Oren Etzioni, founder of TrueMedia.org, a nonprofit focused on fighting deepfakes.
"A perfect opportunity to sow mischief with AI-generated misinformation."
After AFP presented YouTube with 26 channels posting predominantly AI-generated pope content, the platform terminated 16 of them for violating its policies against spam, deceptive practices and scams, and another for violating YouTube's terms of service.
"We terminated several channels flagged to us by AFP for violating our Spam policies and Terms of Service," spokesperson Jack Malon said.
The company also booted an additional six pages from its partner program allowing creators to monetize their content.
TikTok similarly removed 11 accounts that AFP pointed out -- with over 1.3 million combined followers -- citing the platform's policies against impersonation, harmful misinformation and misleading AI-generated content of public figures.
- 'Chaotic uses' -
With names such as "Pope Leo XIV Vision," the social media pages portrayed the pontiff supposedly offering a flurry of warnings and lessons he never preached.
But disclaimers annotating their use of AI were often hard to find -- and sometimes nonexistent.
On YouTube, a label demarcating "altered or synthetic content" is required for material that makes someone appear to say something they did not. But such disclosures only show up toward the bottom of each video's click-to-open description.
A YouTube spokesperson said the company has since applied a more prominent label to some videos on the channels flagged by AFP that were not found to have violated the platform's guidelines.
TikTok also requires creators to label posts sharing realistic AI-generated content, though several pope-centric videos went unmarked.
A TikTok spokesperson said the company proactively removes policy-violating content and uses verified badges to signal authentic accounts.
Brian Patrick Green, director of technology ethics at Santa Clara University, said the moderation difficulties are the result of rapid AI developments inspiring "chaotic uses of the technology."
Many clips on the YouTube channels AFP identified amassed tens of thousands of views before being deactivated.
On TikTok, one Spanish-language video received 9.6 million views while claiming to show Leo preaching about the value of supportive women. Another, which carried an AI label but still fooled viewers, was watched some 32.9 million times.
No video on the pope's official Instagram page has more than 6 million views.
Experts say even seemingly harmless fakes can be problematic especially if used to farm engagement for accounts that might later sell their audiences or pivot to other misinformation.
The AI-generated sermons not only "corrode the pope's moral authority" and "make whatever he actually says less believable," Green said, but could be harnessed "to build up trust around your channel before having the pope say something outrageous or politically expedient."
The pope himself has also warned about the risks of AI, while Vatican News called out a deepfake that purported to show Leo praising Burkina Faso leader Ibrahim Traore, who seized power in a 2022 coup.
AFP also debunked clips depicting the pope, who holds American and Peruvian citizenships, criticizing US Vice President JD Vance and Peru's President Dina Boluarte.
"There's a real crisis here," Green said. "We're going to have to figure out some way to know whether things are real or fake."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
AFP
an hour ago
- AFP
AI-generated Pope sermons flood YouTube, TikTok
An AFP investigation identified dozens of YouTube and TikTok pages that have been churning out AI-generated messages delivered in the pope's voice or otherwise attributed to him since he took charge of the Catholic Church last month. The hundreds of fabricated sermons and speeches, in English and Spanish, underscore how easily hoaxes created using artificial intelligence can elude detection and dupe viewers. "There's natural interest in what the new pope has to say, and people don't yet know his stance and style," said University of Washington professor emeritus Oren Etzioni, founder of a nonprofit focused on fighting deepfakes (archived here and here). "A perfect opportunity to sow mischief with AI-generated misinformation." After AFP presented YouTube with 26 channels posting predominantly AI-generated pope content, the platform terminated 16 of them for violating its policies against spam, deceptive practices and scams, and another for violating YouTube's terms of service (archived here and here). "We terminated several channels flagged to us by AFP for violating our Spam policies and Terms of Service," spokesperson Jack Malon said. The company also booted an additional six pages from its partner program allowing creators to monetize their content (archived here). TikTok similarly removed 11 accounts that AFP pointed out -- with more than 1.3 million combined followers -- citing the platform's policies against impersonation, harmful misinformation and misleading AI-generated content of public figures (archived here, here and here). - 'Chaotic uses' - With names such as "Pope Leo XIV Vision," the social media pages portrayed the pontiff supposedly offering a flurry of warnings and lessons he never preached. Image Screenshot from YouTube taken May 28, 2025 But disclaimers annotating their use of AI were often hard to find -- and sometimes nonexistent. On YouTube, a label demarcating "altered or synthetic content" is required for material that makes someone appear to say something they did not (archived here). But such disclosures only show up toward the bottom of each video's click-to-open description. A YouTube spokesperson said the company has since applied a more prominent label to some videos on the channels flagged by AFP that were not found to have violated the platform's guidelines. Image Screenshot from YouTube taken June 6, 2025, with a newly added synthetic content label outlined by AFP TikTok also requires creators to label posts sharing realistic AI-generated content, though several pope-centric videos went unmarked (archived here). A TikTok spokesperson said the company proactively removes policy-violating content and uses verified badges to signal authentic accounts. Brian Patrick Green, director of technology ethics at Santa Clara University, said the moderation difficulties are the result of rapid AI developments inspiring "chaotic uses of the technology" (archived here). Many clips on the YouTube channels AFP identified amassed tens of thousands of views before being deactivated. On TikTok, one Spanish-language video received 9.6 million views while claiming to show Leo preaching about the value of supportive women. Another, which carried an AI label but still fooled viewers, was watched some 32.9 million times. No video on the pope's official Instagram page has more than 6 million views. Experts say even seemingly harmless fakes can be problematic especially if used to farm engagement for accounts that might later sell their audiences or pivot to other misinformation. The AI-generated sermons not only "corrode the pope's moral authority" and "make whatever he actually says less believable," Green said, but could be harnessed "to build up trust around your channel before having the pope say something outrageous or politically expedient." The pope himself has also warned about the risks of AI, while Vatican News called out a deepfake that purported to show Leo praising Burkina Faso leader Ibrahim Traore, who seized power in a 2022 coup (archived here). AFP also debunked clips depicting the pope, who holds American and Peruvian citizenships, criticizing US Vice President JD Vance and Peru's President Dina Boluarte. "There's a real crisis here," Green said. "We're going to have to figure out some way to know whether things are real or fake."
Mediapart
5 hours ago
- Mediapart
Lost in the Channel: the migrants who disappear en route to England
The cookies and similar technologies we use on Mediapart are of different natures and allow us to pursue different purposes. Some are necessary for the functioning of the site and the mobile application (you cannot refuse them). Others are optional but help to facilitate your experience as a reader and in some way support Mediapart. You can refuse or accept them below, depending on their purpose. Do you agree that Mediapart uses cookies or similar technologies for the following purposes ? You can make your choice, for each category, by enabling or disabling the switch button. Mandatory for the operation of the site or application Subscriber login, anonymized audience measurement, sending of push notifications, tracking of failures, highlighting of our services these tools are necessary to track the activity of our services and their proper functioning. read more Here are the various cookies and similar technologies included in this category : Authentication cookies : subscriber login. : subscriber login. AT Internet : anonymized audience measurement : anonymized audience measurement Display of multimedia editorial content : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). : videos (YouTube, Dailymotion, Vimeo, INA), social networks (Facebook, Instagram, Pinterest, Twitter), documents (Scribd, Document Cloud, Slideshare), sounds (SoundCloud, Spotify, Deezer), maps (Google Maps, Mapbox, CartoDB, uMap), infographics (Highcharts, GitHub, Datawrapper, Flourish, Infogram, ThingLink, jQuery, Google Fonts, Bootstrap), live blogs (24liveblog, CoverItLive), media integration support in Journal and Club publications (Embedly). Typeform : optional questionnaires to collect readers opinions on our digital products. : optional questionnaires to collect readers opinions on our digital products. Datadog (only on the website) : technical indicators and load balancing. : technical indicators and load balancing. Selligent (only on the website) : communication with the subscriber, highlighting of services, offers and benefits. : communication with the subscriber, highlighting of services, offers and benefits. Batch (only on the app) : sending push notifications and in-app messages. : sending push notifications and in-app messages. Firebase Cloud Messaging (only on app) : required for push notifications to work on Android. : required for push notifications to work on Android. Microsoft App Center (only on app) : app update and failure tracking system. Statistics These tools allow us to collect statistics on site and mobile application traffic to understand usage, detect possible problems and optimize the ergonomics of our products. read more These are the third-party tools included in this category : AT Internet : audience measurement related to subscriber ID. : audience measurement related to subscriber ID. CrazyEggs (only on website) : customer journey analysis. : customer journey analysis. Nonli (only on website) : helps our social network team to publish our contents on social networks. : helps our social network team to publish our contents on social networks. Qiota (available only on the website) : management of the datawall system. Advertising retargeting There is no advertising on Mediapart. But we do promote our content and services on other sites and social networks. For this, we use technologies made available by some advertising companies. read more These are the third-party tools included in this category : Facebook (only on the website) : audience targeting on social networks to promote Mediapart. Content Access Management We use the Qiota service from Opper Marketing Suite to configure the activation of a datawall on certain content (available only on the website). This system, intended for non-subscribed users, requires the input of an email address to access the relevant content. By providing this information, the user consents to its collection, storage, and use for statistical purposes. In accordance with the applicable regulations, users have the right to access, rectify, and delete their data, which they can exercise by contacting dpo@ Save and close
France 24
16 hours ago
- France 24
New Europe push to curb children's social media use
The European Union already has some of the world's most stringent digital rules to rein in Big Tech, with multiple probes ongoing into how platforms protect children -- or not. There are now demands for the EU to go further as a rising body of evidence shows the negative effects of social media on children's mental and physical health. Backed by France and Spain, Greece has spearheaded a proposal for how the EU should limit children's use of online platforms as fears mount over their addictive nature. They will present the plan on Friday to EU counterparts in Luxembourg "so that Europe can take the appropriate action as soon as possible", Greek Digital Minister Dimitris Papastergiou said. The proposal includes setting an age of digital adulthood across the 27-country EU, meaning children will not be able to access social media without parental consent. Since the proposal was published last month, other countries have expressed support including Cyprus and Denmark -- which takes over the rotating EU presidency in July. Danish officials say the issue will be a priority during their six-month presidency. France has led the way in cracking down on platforms, passing a 2023 law requiring them to obtain parental consent for users under the age of 15. But the measure has not received the EU green light it needs to come into force. France also gradually introduced requirements this year for all adult websites to have users confirm their age to prevent children accessing porn -- with three major platforms going dark this week in anger over the move. Also under pressure from the French government, TikTok on Sunday banned the "#SkinnyTok" hashtag, part of a trend promoting extreme thinness on the platform. Real age verification Greece says its aim is to protect children from the risks of excessive internet use. The proposal does not say at what age digital adulthood should begin but Papastergiou said platforms should know users' real ages "so as not to serve inappropriate content to minors". France, Greece and Spain expressed concern about the algorithmic design of digital platforms increasing children's exposure to addictive and harmful content -- with the risk of worsening anxiety, depression and self-esteem issues. The proposal also blames excessive screen time at a young age for hindering the development of minors' critical and relationship skills. They demand "an EU-wide application that supports parental control mechanisms, allows for proper age verification and limits the use of certain applications by minors". The goal would be for devices such as smartphones to have in-built age verification. The European Commission, the EU's digital watchdog, wants to launch an age-verification app next month, insisting it can be done without disclosing personal details. The EU last month published draft guidelines for platforms to protect minors, to be finalised once a public consultation ends this month, including setting children's accounts to private by default, and making it easier to block and mute users. Those guidelines are non-binding, but the bloc is clamping down in other ways. EU investigations It is currently investigating Meta's Facebook and Instagram, and TikTok under its mammoth content moderation law, the Digital Services Act (DSA), fearing the platforms are failing to do enough to prevent children accessing harmful content. In the Meta probe, the EU fears the platform's age-verification tools may not be effective. And last week, it launched an investigation into four pornographic platforms over suspicions they are failing to stop children accessing adult content. Separately, the EU has been in long-running negotiations on a law to combat child sexual abuse material, but the proposal has been mired in uncertainty, with worries from some countries that it would allow authorities to access encrypted communications. The legal proposal has pitted proponents of privacy against those working to protect children -- and despite repeated attempts, it has failed to get EU states' approval.
