logo
Reddit blocks most Wayback Machine access after catching AI firms scraping archived data

Reddit blocks most Wayback Machine access after catching AI firms scraping archived data

India Today4 days ago
Reddit has decided to block most of the Internet Archive's Wayback Machine from accessing its website, as per a report by The Verge. This was done after it was discovered that AI companies were scraping archived Reddit content without permission. The Wayback Machine, a long-standing tool that lets people view websites as they appeared in the past, will now only be able to index Reddit's homepage. That means it will no longer be able to archive post detail pages, comments, or profiles. In practice, the archive will only show which posts and headlines were trending on any given day, rather than preserving the full content behind them.advertisementReddit spokesperson Tim Rathschmidt told The Verge, 'Internet Archive provides a service to the open web, but we've been made aware of instances where AI companies violate platform policies, including ours, and scrape data from the Wayback Machine.' The company says that until the Internet Archive can ensure it protects user privacy and complies with platform rules, such as removing deleted content, it is restricting access 'to protect redditors.' Rathschmidt added that Reddit had informed the Internet Archive in advance of the changes and that restrictions would start 'ramping up' immediately.The Internet Archive's stated mission is to preserve a record of websites and other digital cultural materials for public use. However, Reddit argues that this mission is being undermined when third parties exploit the archive's open access for commercial gain, particularly to train AI models. Rathschmidt pointed out that Reddit had 'raised concerns' about scraping from the Wayback Machine before, suggesting this has been a long-brewing issue rather than a sudden decision.
Over the past few years, Reddit has become more aggressive about controlling access to its data, especially in the face of growing demand for AI tools. In 2023, the platform made controversial API changes that forced some third-party apps to shut down, sparking user protests. Reddit claimed those changes were necessary because APIs were being misused to gather content for AI training. Last year, it cut deals with major companies like Google and OpenAI to provide access to data, but crucially, only in exchange for payment. The Verge notes that Reddit even sued AI firm Anthropic in June, accusing it of continuing to scrape content after promising to stop.The Wayback Machine has been a valuable tool for researchers, journalists, and the general public, helping preserve the history of the internet. Yet, as more companies rush to feed AI models with vast amounts of text and images, platforms like Reddit are rethinking how much of their content should remain freely accessible. Mark Graham, director of the Wayback Machine, told The Verge, 'We have a longstanding relationship with Reddit and continue to have ongoing discussions about this matter.' That statement suggests negotiations are still possible. But for now, Reddit's move will significantly limit the archive's ability to capture and preserve its content.- Ends
Orange background

Try Our AI Features

Explore what Daily8 AI can do for you:

Comments

No comments yet...

Related Articles

Candidate lacks ‘oomph': Leaked video of interviewers' private chat reveals ‘honest feeedback'
Candidate lacks ‘oomph': Leaked video of interviewers' private chat reveals ‘honest feeedback'

Mint

time5 hours ago

  • Mint

Candidate lacks ‘oomph': Leaked video of interviewers' private chat reveals ‘honest feeedback'

A woman interviewed on Zoom thought she had done fairly well. But, later, she discovered something shocking. The interview">interview was recorded on the Fathom app, and she accidentally received not only the recap but also a video of the interviewers' private chat. After she logged off, the executive director said he liked her and found her 'chill'. But, the newly-hired director strongly criticised her and called her the weakest among the three other candidates. It "felt like pulling teeth", she said. The executive director seemed to agree and said she was underwhelming, perhaps only good on paper. 'Her energy was muted,' he said. 'She might be a function of what looks good on paper... and lacking some energy." "Energy, drive, curiosity, you know... she could perform on the job but I was looking for a little more 'oomph'," the new director added. The new director then told the executive director that they should interview her in person to see if they could 'get a vibe' for her. After discussing her, the two interviewers casually talked about another candidate, a team dinner and even a board member's dogsitting problem. The Reddit user was disturbed by how dismissive the new director seemed, and how the executive director agreed with her on everything. Then, the story took a twist. On the same day, she was offered her real dream job with a respected organisation she had wanted for months. Feeling relieved and amused, she decided not to attend the second round with the first company. 'I will not be going to the in-person interview at that sh*tty office, but I think we should have a little fun with this, no? Also, who's free on the 20th to rock up for the team dinner?' she joked. Other Reddit users reacted to her post. One of them thought the accidental feedback could be good. 'This is actually great for you. Interviewing is tough and getting honest feedback on interviews is even tougher. This will help you improve moving forward,' the user wrote. 'I used to walk into interviews trying to 'act' the way I thought the company wanted me to. Over time, I realised it's far better to show up as myself. If they don't like me for who I am, then it's simply not the right fit,' wrote another. 'Two worst hires I had both were enthusiastic during the interview. One enthusiastically deleted production data,' came a sarcastic comment.

Google engineer on H1B weighs return to India amid visa worries and family ties; Netizens chip in
Google engineer on H1B weighs return to India amid visa worries and family ties; Netizens chip in

Hindustan Times

time5 hours ago

  • Hindustan Times

Google engineer on H1B weighs return to India amid visa worries and family ties; Netizens chip in

A 28-year-old software engineer working at Google in the US on an H-1 B visa is considering moving back to India. She shared her thoughts in a Reddit post on the r/returntoindia community on Thursday. After years in the U.S. and plans to marry, a Google engineer questions staying abroad as family ties, cultural pull, and visa uncertainty weigh on her future.(Pexel) The woman moved to the US in 2021 to pursue her master's degree, leaving behind a stable job at Apple. At the time, her parents were unsure about her decision but eventually agreed, hoping she would return after three years. 'But then life happened. After moving here, I met my boyfriend. We've been together for 3.5 years and have been living together for 2.5 years. We're planning to get married next year. The tricky part is that he never wants to move back to India. That was part of his reason for coming to the US. He has a stable job and an H1B visa too,' she wrote in her post. She added that if they do move back to India, finding work wouldn't be a major issue for either of them. Her boyfriend, however, wants to continue saving so he can retire early. Still, the emotional weight of being away from family is starting to affect her. 'Most days I'm content here. But sometimes, I miss home so much. Especially when my mom says she misses me or my brother, who's now in Canada (they were against that too, but I convinced them… so I carry guilt about that as well),' she said, mentioning how much she misses family events and festivals. Now, with growing uncertainty around US visa rules, she finds herself stuck between staying and leaving the US . 'My boyfriend says that with the visa uncertainty, we don't know how long we can even stay here. But I do know one thing - I'm not sure I want to live far away from my family forever,' she wrote. Also Read: 'Trump should end H-1B visa': Critics demand stricter rules to protect US jobs She ended her post asking others if moving back is worth it. Internet reaction Several users responded with their own experiences. One of the users wrote, 'You and your bf can always make a compromise - move to Europe, Singapore, UAE or a similar place to be closer to the family but still enjoy the infrastructure and the lifestyle.' Another advised setting clear long-term goals. 'Make a long-term goal in your life, like what do you want in your life in 5 years? House, family, kids, pension, etc. Then take the steps which make you closer to that goal,' the user wrote. Another user chimed, 'Go to India frequently, maybe twice a year, That definitely helps with the home sickness. And sometimes cures it.' The woman has not yet made her decision, but the post sparked a larger conversation around the emotional and practical struggles many immigrants face while living and working in the US.

Sam Altman Acknowledges AI Industry Is in a Bubble, Compares It to the Dot-Com Era
Sam Altman Acknowledges AI Industry Is in a Bubble, Compares It to the Dot-Com Era

Hans India

time8 hours ago

  • Hans India

Sam Altman Acknowledges AI Industry Is in a Bubble, Compares It to the Dot-Com Era

OpenAI CEO Sam Altman has openly acknowledged what many in the financial and tech sectors have been debating: artificial intelligence is in a bubble. Speaking to The Verge, Altman responded to a question on whether investors are currently 'overexcited about AI,' saying, 'My opinion is yes.' He drew parallels between today's AI investment surge and the dot-com bubble of the 1990s, when internet startup valuations skyrocketed before collapsing in 2000. 'When bubbles happen, smart people get overexcited about a kernel of truth,' Altman noted. 'If you look at most of the bubbles in history, like the tech bubble, there was a real thing. Tech was really important. The internet was a really big deal. People got overexcited.' Altman expressed concern over sky-high valuations for AI startups that, in some cases, have 'three people and an idea.' Calling such funding 'insane' and 'not rational behaviour,' he warned, 'Someone's gonna get burned there, I think.' In recent months, AI companies like Safe Superintelligence, led by OpenAI co-founder Ilya Sutskever, and Thinking Machines, founded by ex-OpenAI CTO Mira Murati, have raised billions of dollars. 'Someone is going to lose a phenomenal amount of money. We don't know who, and a lot of people are going to make a phenomenal amount of money,' Altman said. Still, he believes the net result will be positive: 'My personal belief, although I may turn out to be wrong, is that, on the whole, this would be a huge net win for the economy.' Altman also hinted at massive future investments for OpenAI, saying, 'You should expect OpenAI to spend trillions of dollars on data center construction in the not very distant future. You should expect a bunch of economists to wring their hands.' Despite warning signs, Altman's remarks suggest confidence that OpenAI will remain a dominant player, even if the AI bubble eventually bursts.

DOWNLOAD THE APP

Get Started Now: Download the App

Ready to dive into a world of global content with local flavor? Download Daily8 app today from your preferred app store and start exploring.
app-storeplay-store