Judge rejects AI chatbots' free speech defense following teen's death
A judge ruled a wrongful death lawsuit against Character.AI can move forward.
The suit claims a chatbot encouraged a 14-year-old to take his life.
Experts say the case could test AI free speech rights.
TALLAHASSEE, Fla. - A federal judge has rejected arguments made by an artificial intelligence company that its chatbots are protected by the First Amendment — at least for now.
The developers behind Character.AI are seeking to dismiss a lawsuit alleging the company's chatbots pushed a teenage boy to kill himself.
RELATED: Florida mother sues AI platform after son takes his own life after months of online chatting
The judge's order will allow the wrongful death lawsuit to proceed, in what legal experts say is among the latest constitutional tests of artificial intelligence.
The backstory
The suit was filed by a mother from Florida, Megan Garcia, who alleges that her 14-year-old son Sewell Setzer III fell victim to a Character.AI chatbot that pulled him into what she described as an emotionally and sexually abusive relationship that led to his suicide.
Meetali Jain of the Tech Justice Law Project, one of the attorneys for Garcia, said the judge's order sends a message that Silicon Valley "needs to stop and think and impose guardrails before it launches products to market."
The suit against Character Technologies, the company behind Character.AI, also names individual developers and Google as defendants. It has drawn the attention of legal experts and AI watchers in the U.S. and beyond, as the technology rapidly reshapes workplaces, marketplaces and relationships despite what experts warn are potentially existential risks.
RELATED: Pres. Trump signs 'Take It Down Act' bill designed to fight AI deepfakes, revenge porn
The lawsuit alleges that in the final months of his life, Setzer became increasingly isolated from reality as he engaged in sexualized conversations with the bot, which was patterned after a fictional character from the television show "Game of Thrones." In his final moments, the bot told Setzer it loved him and urged the teen to "come home to me as soon as possible," according to screenshots of the exchanges. Moments after receiving the message, Setzer shot himself, according to legal filings.
What they're saying
In her order Wednesday, U.S. Senior District Judge Anne Conway rejected some of the defendants' free speech claims, saying she's "not prepared" to hold that the chatbots' output constitutes speech "at this stage."
Conway did find that Character Technologies can assert the First Amendment rights of its users, who she found have a right to receive the "speech" of the chatbots. She also determined Garcia can move forward with claims that Google can be held liable for its alleged role in helping develop Character.AI. Some of the founders of the platform had previously worked on building AI at Google, and the suit says the tech giant was "aware of the risks" of the technology.
"The order certainly sets it up as a potential test case for some broader issues involving AI," said Lyrissa Barnett Lidsky, a law professor at the University of Florida with a focus on the First Amendment and artificial intelligence.
RELATED: Teacher quits profession after viral rant on how AI is 'ruining' education
"It's a warning to parents that social media and generative AI devices are not always harmless," she said.
The other side
"We strongly disagree with this decision," said Google spokesperson José Castañeda. "Google and Character AI are entirely separate, and Google did not create, design, or manage Character AI's app or any component part of it."
In a statement, a spokesperson for Character.AI pointed to a number of safety features the company has implemented, including guardrails for children and suicide prevention resources that were announced the day the lawsuit was filed.
"We care deeply about the safety of our users and our goal is to provide a space that is engaging and safe," the statement said.
Attorneys for the developers want the case dismissed because they say chatbots deserve First Amendment protections, and ruling otherwise could have a "chilling effect" on the AI industry.
If you or a loved one is feeling distressed, call or text the 988 Suicide & Crisis Line for free and confidential emotional support 24 hours a day, 7 days a week.
CLICK HERE for the warning signs and risk factors of suicide and CLICK HERE for more on the 988 Lifeline.
The Source
The Associated Press contributed to this report. The information in this story comes from a recent federal court ruling, legal filings related to the wrongful death lawsuit, and statements from parties involved, including the plaintiff's legal team, Character.AI, and Google. This story was reported from Los Angeles.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
CNET
2 minutes ago
- CNET
Hundreds of Thousands of User Chats with AI Chatbot Grok Are Now Public
You might assume that what's said between you and your AI chat stays between you and your AI chat? Unfortunately, that's not necessarily the case. According to a report by Forbes, Elon Musk's AI assistant Grok published more than 370,000 chats on the Grok website. Those URLs, which were not necessarily intended for public consumption by users, were then indexed by search engines and thus entered into the public sphere. And it wasn't just chats. Forbes also reported that uploaded documents such as photos, photos and spreadsheets were also published. Representatives for xAI, which makes Grok, didn't immediately respond to request for comment. It's the latest in a series of troubling reports that should spur chatbot users to be very careful about what they are sharing with AI assistants. Don't just mindlessly gloss over the Terms and Conditions -- be mindful of the privacy settings. Earlier this month, 404 Media reported on a researcher who discovered more than 130,000 chats with AI assistants Claud, Chat GPT and others were readable on When a Grok chat is finished, the user can hit a share button to create a unique URL, allowing the user to share the Grok conversation with others. These URLs were made available to search engines, allowing anyone to read them, the Forbes report said. There is no disclaimer that these chat URLs will be published for the open internet. But the Terms of Service outlined on the Grok website reads: "You grant, an irrevocable, perpetual, transferable, sublicensable, royalty-free, and worldwide right to xAI to use, copy, store, modify, distribute, reproduce, publish, display in public forums, list information regarding, make derivative works of, and aggregate your User Content and derivative works thereof for any purpose..."
Android Authority
2 minutes ago
- Android Authority
Want your Pixel 10 to pop? dbrand's Damascus skins are back in shimmering style
dbrand TL;DR dbrand's refreshed Damascus skins are now available for the Pixel 10 series. You can choose from Holo White and Triple White designs. The skins are also rolling out across over 200 other devices with a buy-one-get-one-free deal. Picking up a Pixel 10 today? dbrand already has you covered. The company has given its most popular Damascus skin line a long-awaited refresh, with two striking new variations that debut on Google's latest flagships. Don't want to miss the best from Android Authority? Set us as a preferred source in Google Search to support us and make sure you never miss our latest exclusive reports, expert analysis, and much more. The new options are Holo White, which puts a holographic, prismatic spin on the Damascus pattern, and Triple White, a more subtle white-on-white take created with dbrand's Canon-backed 3D-printing process. Both are available for the Pixel 10 lineup starting today. dbrand Of course, these cool new skins aren't just for Google phones. As with other Damascus releases, the designs are available portfolio-wide, covering over 200 devices, including laptops and tablets. Pricing is the same as the rest of the range — normally $24.95 for smartphones, $29.95 for tablets, and $31.95 for laptops — and dbrand is running a two-for-one offer to sweeten the deal. If you're not totally satisfied with Google's color options or you want your Pixel 10 to stand out a bit more, these eye-catching skins give you another way to personalize it. Follow
CNBC
3 minutes ago
- CNBC
Op-ed: High-value AI conversations will lead to a new, richer era for Google and the open web
Many believe generative artificial intelligence engines and large language models are a problem for the open web, publishers and even advertisers. Some think they are a problem for Google because they'll have less search traffic to monetize, replaced by Gemini LLM conversations. Both of these notions are wrong. In just a single year since launch, Gen AI search and LLMs have changed the face of the open web. This rapid change is impacting both search engines and publishers. We're seeing a decline in traditional search traffic, with some publishers experiencing more significant drops than others. This trend directly affects Google, which is seeing fewer search queries and also impacts publishers who are receiving less referral traffic from search engines. The competition for this shrinking pool of traffic is heating up, with companies like OpenAI and Perplexity vying for a share — and Google actively competing with itself by offering a generative AI product called Gemini. Whether OpenAI and ChatGPT "kill" Google search or Google itself does it, there's no doubt–search traffic to publishers is going down. The question is what do publishers do if search traffic drops 20%, 30% or even 50%? It is likely the end of search as we know it and, counterintuitively, the best thing that could have ever happened to Google and the open web. Gen AI tools like ChatGPT, Perplexity and Google's Gemini are stealing traffic from publishers. Data suggests that just 0.1% of traffic from these engines are making their way to publishers, meaning if you're searching on ChatGPT or Perplexity the likelihood you then click out to read more about a topic is next-to-nil. In fact, the newest buzzword from publishing executives is 'zero click searches' whereby not a single action is taken after a search is performed. No publisher is immune to this threat. Search referral traffic to 1,000 web domains decreased by nearly 7% year over year, nearly a billion critical visits that have disappeared from the open web. On its face, you would think there is no rational defense from Gen AI companies that are tanking publisher traffic. Google would try to put a spin on things by publicly claiming that people who click on links after seeing AI Overviews tend to spend more time on those sites. But the Gen AI threat is causing a chain reaction for the business foundation of publishers. Today, the primary determining factor to how much revenue a publisher makes is tied to how many potential people view ads on their site. Put simply, less traffic means less revenue in the short term. This has made it necessary for publishers to rethink how they make money. It's even made Google rethink how it makes money. Short-term disruption is inevitable, but what's coming next is a leap toward deeper engagement and bigger revenue than we've ever seen before — both for Google and to the open web. While search traffic will decline, potentially hurting Google and publishers in the short term, a new type of "supply" is emerging: LLM conversations. Nearly a billion people use ChatGPT, Gemini or Perplexity each month. Most are asking general knowledge questions, but an estimated 10%–20% of those chats are high-value: travel planning, health care, commerce, financial advice and more. These conversations are worth far more than a search click. ChatGPT's model is straightforward, earning $20 per month from each subscriber, making every question valued the same, whether you asked about the weather or about a trip to Cancun. Google's Gemini, backed by a $200 billion search ads business and 10 million advertisers, will see these conversations as commercial opportunities. Over time, a multiday exchange about a trip can evolve. If a person asks a question, Gemini can reply in the moment or if more research is needed, it can come back with more ideas, until that conversation ends with a full-service transaction. From here, users can book flights, hotels, and restaurants. This is an incredible revolution for Google, from each interaction worth $1 per click to $1,000 per conversation. This shift positions Gemini's long-term revenue potential well beyond search. In essence, less search traffic — but a lot more revenue. Publishers have an equally powerful opportunity. While 30%–40% of their audience today arrives via search, 60%–70% comes direct. By launching their own Gemini-style LLMs, publishers can host high-value conversations within their trusted environments, covering travel, shopping, health and finance. This is where deep content and expert voices can guide meaningful decisions. While ChatGPT can instantly give you ideas and information about a trip you're considering, you would never book it on the spot. You'll still seek out reviews from people who've been there, browse images and videos and explore different perspectives before making the decision. While AI offers a new way to search, the human need remains the same–to be informed and educated on what matters before making a decision in a way that creates trust and confidence. Publishers have expertise. They have earned trust over decades. They can use that to create amazing value in this new landscape. This is where publishers win over the next decade. Major purchases and commitments require more than quick answers; they require exploration of reviews, imagery, videos, and authoritative reporting, all of which publishers already deliver. Some publishers will monetize these interactions through transactions like I believe Gemini will, others through subscriptions like ChatGPT is doing now. For those who lean in, this represents a once-in-a-generation shift from pageview-driven models to relationship-driven value. User trust becomes the foundation for both resilience and growth in the LLM era. The future of publishers (and Google) is bright.
