Cloudflare to block AI crawler bots by default
July 1 (UPI) -- Cloudflare announced it will begin blocking AI web crawlers to prevent them from "accessing content without permission or compensation," from all of its clients beginning on Tuesday.
Cloudflare blocking AI crawler bots builds off the tool launched in September last year that allowed publishers the ability to block crawlers with one click but announced Tuesday the option to block them will be implemented by default for all of its clients.
"AI crawlers have been scraping content without limits. Our goal is to put the power back in the hands of creators, while still helping AI companies innovate," said Matthew Prince, co-founder and CEO of Cloudflare. "This is about safeguarding the future of a free and vibrant Internet with a new model that works for everyone."
Cloudflare is a content delivery network which helps businesses and applications by caching the data closer to end users and it estimated that 16% of global internet traffic goes directly through it's service in a 2023 report.
The company also announced it will implement a Pay Per Crawl program that will allow some publishers to set a price that can be viewed by companies to decide whether they want to pay the fee for its content.
AI crawlers are automated bots with the intent to extract large amounts of data from websites, to train large language models from companies such as OpenAI and Google.
AI crawlers are typically seen as more invasive and selective when it comes to the data they consumer. They have been accused of overwhelming websites and significantly impacting user experience," Matthew Holman, a partner at U.K. law firm Cripps, said.
"If effective, the development would hinder AI chatbots' ability to harvest data for training and search purposes," he added. "This is likely to lead to a short term impact on AI model training and could, over the long term, affect the viability of models."
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Yahoo
an hour ago
- Yahoo
Apple CEO Tim Cook Says the Technology They're Developing Will Be ‘One of the Most Profound Technologies of Our Lifetime'
In Apple's fiscal Q3 2025 earnings call, CEO Tim Cook doubled down on the company's commitment to artificial intelligence (AI), framing it as both a transformative technology and a natural extension of Apple's product philosophy. Cook's remarks position AI not as a standalone product line, but as a deeply integrated layer across Apple's ecosystem — powered by its own silicon and fortified by its privacy-first principles. 'We see AI as one of the most profound technologies of our lifetime,' Cook said. 'We are embedding it across our devices and platforms and across the company. We are also significantly growing our investments.' More News from Barchart UnitedHealth Stock Soars as Warren Buffett's Berkshire Hathaway Discloses $1.57B Stake Palantir CEO Alex Karp Sees More Gains Ahead With America-Focused Growth Strategy, Calls U.S. The 'Leader of the Free World' Lucid Motors Is Caught in a Tariff Trap. Is LCID Stock More Likely to Hit $1 or $7 in 2025? Get exclusive insights with the FREE Barchart Brief newsletter. Subscribe now for quick, incisive midday market analysis you won't find anywhere else. AI as a Core Growth Driver The remarks come as Apple (AAPL) continues to face a rapidly evolving competitive landscape in AI, with rivals like Microsoft (MSFT), Google (GOOGL) (GOOG), and OpenAI pushing cloud-based generative AI tools to the forefront. Apple's strategy, however, appears to hinge on on-device intelligence — leveraging its custom Apple silicon chips to run advanced AI models directly on iPhones, iPads, and Macs without relying solely on the cloud. Cook emphasized that Apple's approach is about making advanced technology accessible, echoing a familiar refrain in the company's history from the Macintosh to the iPhone. He specified, 'Apple has always been about taking the most advanced technologies and making them easy to use and accessible for everyone. And that's at the heart of our AI strategy.' Apple Intelligence: Early Rollout and Upcoming Features Apple's branded AI initiative, Apple Intelligence, has already delivered more than 20 features, including visual intelligence, photo cleanup, and advanced writing tools. Cook noted the company is also making 'good progress' on a more personalized Siri — a feature he says is slated for release in 2026. The underlying technology runs primarily on-device, thanks to the efficiency and performance of Apple silicon. For more demanding AI tasks, Apple's private cloud compute — also powered by its own chips — handles the processing, allowing for greater capabilities while still preserving user privacy. Privacy as a Differentiator Cook was clear in positioning privacy as a central pillar of Apple's AI value proposition. The private cloud compute architecture, designed to minimize the amount of user data leaving the device, is a counterpoint to competitors that require extensive cloud data processing. The CEO argued that this hybrid approach — balancing on-device AI with selective, secure server-based computing — offers 'the best way for users to experience the full potential of generative AI' without sacrificing security or personal data integrity. Investment and Market Implications While Apple did not disclose specific dollar figures for its AI investments during the call, Cook's comment that the company is 'significantly growing' its AI spend suggests an accelerated development roadmap. Analysts see Apple's AI integration as a potential catalyst for device upgrade cycles, particularly as consumers begin to associate premium smartphones and computers with advanced personal AI capabilities. This push could also help Apple defend its high-margin hardware business against a backdrop of slowing global smartphone growth. If successful, AI-powered features could extend the lifecycle of Apple devices in the market and strengthen the ecosystem lock-in that has been key to Apple's long-term profitability. Looking Ahead Apple's next major software releases in 2026 will be a critical test of whether its AI strategy resonates with consumers and developers alike. The integration of AI into Siri, along with more contextually aware and personalized device interactions, could reshape how users engage with their devices on a daily basis. In the near term, investors will be watching to see if these AI advancements translate into tangible revenue growth — either through device sales, services expansion, or entirely new monetization channels. On the date of publication, Caleb Naysmith did not have (either directly or indirectly) positions in any of the securities mentioned in this article. All information and data in this article is solely for informational purposes. This article was originally published on Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
Yahoo
an hour ago
- Yahoo
Pinterest, Inc. (PINS) Is One Of The 'Most Undervalued Companies,' Says Jim Cramer
We recently published . Pinterest, Inc. (NYSE:PINS) is one of the stocks Jim Cramer recently discussed. Pinterest, Inc. (NYSE:PINS), a social media platform focused primarily on visual arts, idea generation, and eCommerce, is one of Cramer's top social media stocks. The CNBC TV host believes that the firm has a unique business model that places it in a key position for AI scraping. Not only does he believe that Pinterest, Inc. (NYSE:PINS) allows users to learn from each other, but he also believes the firm is undervalued: 'And then. . .I think Pinterest and Reddit are the two most undervalued companies, of the new companies, because they are being scraped and the scrapers are going to have to pay the piper. Pinterest, Reddit, they're gonna pay the piper.' Cramer previously discussed Pinterest, Inc. (NYSE:PINS)'s business and undervaluation in detail. Here is what he said: 'I'm always looking for companies like Square now Block, that could take off even if it doesn't get added to the S&P. And there are a couple of notes about Pinterest. I think that Bill Ready has done a remarkable job as CEO. Pinterest is going to be a part of what's scraped by these, the five big ones. And we should highlight the five big ones, they do matter. And I just think Pinterest is a place where people go to learn, and people go to have crafts. It's an underrated site. It's 25 billion. It could be 50 billion. Copyright: alexeyboldin / 123RF Stock Photo '[On Morgan Stanley saying there growth acceleration is not being priced] Look, I think this is a remarkable site. Because, if you want to take trip, if you want to learn to paint, if you want to learn to cook, if you want to cook something really special, it's where you go. It's a very useful site. And it seems to me to be a, a very much of a site that you're not going to see the stuff that we just talked about.' While we acknowledge the potential of PINS as an investment, our conviction lies in the belief that some AI stocks hold greater promise for delivering higher returns and have limited downside risk. If you are looking for an extremely cheap AI stock that is also a major beneficiary of Trump tariffs and onshoring, see our free report on the . READ NEXT: 30 Stocks That Should Double in 3 Years and 11 Hidden AI Stocks to Buy Right Now. Disclosure: None. This article is originally published at Insider Monkey.
Yahoo
an hour ago
- Yahoo
Reddit, Inc. (RDDT) Is One Of The 'Most Undervalued Companies,' Says Jim Cramer
We recently published . Reddit, Inc. (NYSE:RDDT) is one of the stocks Jim Cramer recently discussed. Reddit, Inc. (NYSE:RDDT) is one of Cramer's top social media stocks. The CNBC TV host believes the firm's vast depository of user data will serve it well in today's AI era, where firms are hungry for training data. Reddit, Inc. (NYSE:RDDT)'s shares have gained 35% year-to-date, primarily due to a 55% surge since late July. The stock rose after the firm's second quarter revenue of $500 million and earnings per share of $0.45 beat analyst estimates of $426 million and $0.19 by a wide margin. Despite the share price gains, Cramer believes Reddit, Inc. (NYSE:RDDT) is still undervalued: 'And then. . .I think Pinterest and Reddit are the two most undervalued companies, of the new companies, because they are being scraped and the scrapers are going to have to pay the piper. Pinterest, Reddit, they're gonna pay the piper.' Copyright: dedivan1923 / 123RF Stock Photo Here are his earlier comments about Reddit, Inc. (NYSE:RDDT): 'Let me start with Reddit. I use Reddit pretty aggressively. It's a terrific product. My wife uses it to sell… her mezcal brand because Reddit has an entire mezcal forum. So I like it. The advertiser likes it. That's where I start. I then try to find out what other people… whether they feel like I do. Rob (Rob Pace, founder and CEO of HundredX) has told me that Reddit customers are planning to increase future use because people love crowdsourced information, seems to be able to be independent… Reddit demonstrates the increasing value of human intelligence, increasing value of human intelligence, I like that. In fact, he's betting that as the future of search evolves from finding things to figuring things out, Reddit could be a major winner. Now you take your own use as I have… You then take data from HundredX to see if your experience lines up with reality. Only then you go to the web, you look up articles, check out websites to see things like the piece we ran on Reddit a couple of days ago, which said it was great to buy. Wow, that's been terrific. To me, that produced a terrific, really special reason to buy the stock, and I'm sticking with it. I just wish I had bought it for my Charitable Trust when I first got the hunch, but I hadn't done the homework. Can't jump that.' While we acknowledge the potential of RDDT as an investment, our conviction lies in the belief that some AI stocks hold greater promise for delivering higher returns and have limited downside risk. If you are looking for an extremely cheap AI stock that is also a major beneficiary of Trump tariffs and onshoring, see our free report on the . READ NEXT: 30 Stocks That Should Double in 3 Years and 11 Hidden AI Stocks to Buy Right Now. Disclosure: None. This article is originally published at Insider Monkey. Error in retrieving data Sign in to access your portfolio Error in retrieving data Error in retrieving data Error in retrieving data Error in retrieving data
