How this startup is helping publishers profit from AI scraping

Yahoo

20-06-2025

"Artificial intelligence (AI) scraping" describes the practice of using AI to extract data from websites, oftentimes without the publishers' permission. AI scraping has been a key discussion amid the AI revolution, as the practice raises questions about ethical usage of the technology.
Reddit (RDDT) is suing Anthropic (ANTH.PVT), alleging the AI company used its content without authorization.
TollBit CEO and co-founder Toshit Panigrahi joins Catalysts to discuss how TollBit helps publishers protect their content from AI scraping.
To watch more expert insights and analysis on the latest market action, check out more Catalysts here.
This month, Reddit sued AI giant Anthropic, claiming that the OpenAI rival had accessed its platform of more than 100,000 times it accessed the platform since July of 2022 after Anthropic allegedly said it had blocked its bots from doing so.
We sat down with the COO of Reddit to discuss the suit.
What's important to us is that um That we are able to protect our users privacy, their deletion rights, like we have policies um that ensure that, you know, when users take down a post like the post is taken down.
And so it's really important and as we said in our terms of service that, you know, we have a conversation with folks who have access to our data because that's a commitment that we have in terms of our policies.
Our next guest has crunched the numbers on the size and scope of AI scraping by bots and helps publishers profit from the scraping.
Joining us now we've got Tosit Panigrahi, who is the Tolbit CEO and co-founder.
Tolbit is a New York-based startup that helps news publishers monitor and make money when AI companies scrape their content.
Uh, by acting almost like a toll booth of the internet, did we get that right, Tosa?
Yes, that's correct.
Thanks for having me.
Absolutely.
So take us into your business and and what you're seeing more broadly here, especially as we're knowing and knowledge knowledgeable of how much scraping these AI engines need to do in order to get either knowledge sets that can then be used for generative AI efforts and they reach to basically every source part of the web that they can essentially get their hands on for free.
Absolutely.
So Tobit is a platform that helps, uh, websites of all sizes monitor, manage, and monetize their AI bot traffic, which essentially means we give them tools to to get an idea of how rampant the scraping might be on their site.
We give them tools to block it and enforce content access rights, and then we give them, uh, I think a real innovation is our bot paywall, a tool that allows these AI bots to come in and actually pay for sanctioned access to that content.
Um, and, and data, right?
And I think one of the things that we're seeing, right, especially in the last quarter is the demand for not for uh uh content for training, content for retrieval at inference time when people ask the question, the bots have to go out and read and answer your question.
Is AI training as it stands right now ethical from the standard practices that users expect when they're on the internet?
I think this is a question that's bigger than all of us.
I think we're definitely looking to some of the course to set, to decide and set some precedent as to whether or not training is fair use, but I think, uh, us as a business, right?
And I think where some of the conversation should be going should be around, you know, these bots who are, who have to go out when you and I ask a question.
Finding these platforms to go read that content, right?
They don't know what happened to it.
They don't know what the price of the ticket was if you wanted to go to France, right?
They actually have to go out and access those sites to get that information.
That will be a far bigger use case than, than, uh, just training as these tools continue to evolve.
And so what, what is the revenue model like?
How does the business make money?
So, essentially, what with the technology that we built, we have built a gateway that any AI application, agent bot can come in through and actually pay uh through the form of micropayments for access to content and data, right?
So it could be anything from what happened today, right?
You want, you want to read um what happened on the news today to, I want to know, you know, what the price of the hotel is today in New York, and I want you to go, uh, book.
It for me, right?
And so we are able to uh let the website set those rules, set the the access protocols for what that content data should cost, and then we take a transaction fee on top of that for enabling this faster, cleaner, licensed access to the content.
So it's a really fascinating business and I'm sure there's a very large total addressable market that just continues to grow at this juncture.
Thanks so much for bringing this down.
We appreciate it.
Thank you.