Cloudflare AI Update Blocks Crawlers by Default
Cloudflare, Inc. (NYSE: NET), the leading connectivity cloud company, announced a major update to protect original online content. The company revealed it is now the first Internet infrastructure provider to block AI crawlers by default.
This move aims to stop AI companies from accessing web content without permission or compensation. Starting immediately, website owners can choose whether AI crawlers can access their content and how it can be used.
AI companies must now clearly state if their crawlers are used for training, inference, or search. This transparency helps content creators make informed decisions.
Cloudflare reported that this new setting marks a step toward a more sustainable future for both creators and AI innovators. For years, search engines directed users to original websites, generating traffic and ad revenue. That model is now disrupted.
AI crawlers collect content like text and images but often provide no referral traffic. This change, Cloudflare warned, risks removing incentives to produce high-quality content.
Matthew Prince, co-founder and CEO of Cloudflare, stated, 'If the Internet is going to survive the age of AI, we need to give publishers control and build a new economic model.' He emphasized that original content powers the Internet and must be protected.
Prince added, 'Our goal is to put the power back in the hands of creators, while still helping AI companies innovate.'
Several publishing and tech leaders voiced strong support for Cloudflare's move: Roger Lynch, CEO of Condé Nast, called it a 'game-changer' for publishers.
Neil Vogel, CEO of Dotdash Meredith, said AI platforms must fairly compensate creators.
Renn Turiano of Gannett Media praised the technology for combating unauthorized scraping.
Pinterest CEO Bill Ready said the update helps ensure content is used as intended. Reddit's CEO Steve Huffman agreed, stating that crawling should be more transparent and controlled.
Vivek Shah, CEO of Ziff Davis, applauded the step as a boost for a sustainable digital ecosystem.
Cloudflare revealed it manages 20% of global web traffic and handles trillions of requests daily. In September 2024, the company introduced an option to block AI crawlers with one click. Over one million customers enabled this option.
Now, Cloudflare is enforcing a permission-based model. New domains must choose whether to allow AI crawlers during setup. This removes the need to manually opt out later.
Cloudflare also announced new protocols to help AI bots authenticate themselves. These protocols will make it easier for website owners to identify AI crawlers and control access.
The company reported support from global publishers and media organizations including TIME, Condé Nast, Gannett Media, Reddit, and Pinterest.
Cloudflare stated this is about protecting intellectual property while still enabling innovation. The update supports a fairer Internet where content creators retain control and receive proper recognition.
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Zawya
15 minutes ago
- Zawya
Nvidia set to become the world's most valuable company in history
Nvidia was on track to become the most valuable company in history on Thursday, with the chipmaker's market capitalization reaching $3.915 trillion as Wall Street doubled down on optimism about AI. Shares of the leading designer of high-end AI chips were up 2% at $160.4 in morning trading, giving the company a higher market capitalization than Apple's record closing value of $3.915 trillion on December 26, 2024. (Reporting by Noel Randewich in Oakland, California; Arsheeya Bajwa in Bengaluru and Carolina Mandl in New York; Editing by Dawn Kopecki and Matthew Lewis)
Tahawul Tech
an hour ago
- Tahawul Tech
Google launches Veo 3 on Gemini in MENA
Google AI Pro subscribers can now create videos using the latest model on Gemini. Dubai — Google announced today the launch of Veo 3, Google's state-of-the-art video generation model that enables people to bring their creative vision to life through a mesmerising combination of visuals and sound. Veo 3 is now accessible to all Google AI Pro subscribers across the region. With Veo 3 now built into the Gemini app, people can write the scene they want to watch. This description is called a 'prompt' and with it, Veo 3 will whip up a custom eight-second video complete with sound, dialogue, and music, at 720p output. Veo 3 was released at Google's annual event for developers, Google I/O, last May. Veo 3 lets users add sound effects, ambient noise, and even dialogue to their creations – generating all audio natively. It also delivers best in class quality, excelling in physics, realism and prompt adherence. The SynthID watermark is embedded in all content generated by Google's generative AI models, including Veo 3. Google recently rolled out SynthID Detector to early testers, and aims to expand access soon. As an additional step to help people identify AI-generated content, a visible watermark will be added to all videos generated by the video model, except for videos generated by Ultra members in Flow, Google's latest tool for AI filmmakers. People can subscribe to Google AI Pro to try out Veo 3, starting today.
Zawya
an hour ago
- Zawya
How AI note-taking can ease health's documentation fatigue?
Embracing technology in healthcare is helping practitioners improve efficiency. Tools like Nora AI, which capture doctor-patient conversations in real-time and automatically generate structured clinical notes, are helping to ease clinicians' documentation fatigue. 'Our goal is simple,' says James Gordon, co-founder and COO of Nora AI. 'We want to give doctors back their time. Nora AI reduces friction in the clinical workflow, integrates with existing electronic health record systems, and ensures that documentation is complete, well-structured, and consistent.' Pivoting to health tech Originally developed as an educational tool to auto-generate study materials from various resources, Nora AI pivoted into the health tech space when Healthbridge identified its potential to solve a growing clinician pain point: documentation fatigue. Healthbridge integrated Nora AI into its Healthbridge Clinical platform. 'This isn't theoretical innovation,' says Luis da Silva, CEO of Healthbridge. 'Nora AI is already reducing burnout, improving documentation quality, and helping clinicians focus on what matters most: patient care.' Improving healthcare delivery Cross-sector partnerships are crucial for scaling health technology solutions and improving healthcare delivery. 'By pairing health tech infrastructure with AI applications, the ecosystem becomes more agile, efficient, and scalable, benefitting medical practitioners and patients alike,' says Da Silva. It is also invaluable in emerging markets, where legacy systems and resource constraints call for more flexible and intelligent design. 'Across the African continent, where many healthcare systems still rely on paper-based processes and fragmented supply chains, AI-powered solutions offer a leapfrog opportunity. 'Given clinician shortages, inconsistent data capture, and limited access to care, the case for ambient AI is even more compelling,' Gordon says. Growing health tech market Investors are taking notice, and with Africa's health tech market projected to grow at a CAGR of 23.4% from 2024 to 2030, a new generation of African startups is using technology to reimagine healthcare access, equity, and efficiency. 'This is what we mean by AI with purpose,' concludes Da Silva. 'It's not about hype or disruption for its own sake. It's about building tools that work in the background to make people's lives better, starting with the clinicians who keep healthcare running.'
