In lawsuit over teen's death, US judge rejects arguments that AI chatbots have free speech rights
In this undated photo provided by Megan Garcia of Florida in October 2024, she stands with her son, Sewell Setzer III. — Megan Garcia via AP
TALLAHASSEE, Florida: A federal judge on May 21 rejected arguments made by an artificial intelligence company that its chatbots are protected by the First Amendment – at least for now. The developers behind Character.AI are seeking to dismiss a lawsuit alleging the company's chatbots pushed a teenage boy to kill himself.
The judge's order will allow the wrongful death lawsuit to proceed, in what legal experts say is among the latest constitutional tests of artificial intelligence.
The suit was filed by a mother from Florida, Megan Garcia, who alleges that her 14-year-old son Sewell Setzer III fell victim to a Character.AI chatbot that pulled him into what she described as an emotionally and sexually abusive relationship that led to his suicide.
Meetali Jain of the Tech Justice Law Project, one of the attorneys for Garcia, said the judge's order sends a message that Silicon Valley "needs to stop and think and impose guardrails before it launches products to market.'
The suit against Character Technologies, the company behind Character.AI, also names individual developers and Google as defendants. It has drawn the attention of legal experts and AI watchers in the US and beyond, as the technology rapidly reshapes workplaces, marketplaces and relationships despite what experts warn are potentially existential risks.
"The order certainly sets it up as a potential test case for some broader issues involving AI,' said Lyrissa Barnett Lidsky, a law professor at the University of Florida with a focus on the First Amendment and artificial intelligence.
The lawsuit alleges that in the final months of his life, Setzer became increasingly isolated from reality as he engaged in sexualised conversations with the bot, which was patterned after a fictional character from the television show Game Of Thrones. In his final moments, the bot told Setzer it loved him and urged the teen to "come home to me as soon as possible,' according to screenshots of the exchanges. Moments after receiving the message, Setzer shot himself, according to legal filings.
In a statement, a spokesperson for Character.AI pointed to a number of safety features the company has implemented, including guardrails for children and suicide prevention resources that were announced the day the lawsuit was filed.
"We care deeply about the safety of our users and our goal is to provide a space that is engaging and safe,' the statement said.
Attorneys for the developers want the case dismissed because they say chatbots deserve First Amendment protections, and ruling otherwise could have a "chilling effect' on the AI industry.
In her order Wednesday, US Senior District Judge Anne Conway rejected some of the defendants' free speech claims, saying she's "not prepared' to hold that the chatbots' output constitutes speech "at this stage.'
Conway did find that Character Technologies can assert the First Amendment rights of its users, who she found have a right to receive the "speech' of the chatbots. She also determined Garcia can move forward with claims that Google can be held liable for its alleged role in helping develop Character.AI. Some of the founders of the platform had previously worked on building AI at Google, and the suit says the tech giant was "aware of the risks' of the technology.
"We strongly disagree with this decision," said Google spokesperson José Castañeda. "Google and Character AI are entirely separate, and Google did not create, design, or manage Character AI's app or any component part of it.'
No matter how the lawsuit plays out, Lidsky says the case is a warning of "the dangers of entrusting our emotional and mental health to AI companies.'
"It's a warning to parents that social media and generative AI devices are not always harmless," she said. – AP
Those suffering from problems can reach out to the Mental Health Psychosocial Support Service at 03-2935 9935 or 014-322 3392; Talian Kasih at 15999 or 019-261 5999 on WhatsApp; Jakim's (Department of Islamic Development Malaysia) family, social and community care centre at 0111-959 8214 on WhatsApp; and Befrienders Kuala Lumpur at 03-7627 2929 or go to befrienders.org.my/centre-in- malaysia for a full list of numbers nationwide and operating hours, or email sam@befrienders.org.my.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Malay Mail
4 hours ago
- Malay Mail
Diginex Signs MOU to Acquire Resulticks for US$2bn, transforming AI and Data Management Capabilities
$1.4 billion in Diginex ordinary shares valued at $72 per share and subject to a 12-18 month lock-up, which shares will be issued at closing of the transaction; $100 million in cash that is payable within 90 business days of the closing of the transaction; and an earnout of up to $500 million payable in Diginex ordinary shares valued at $72 per share and paid in 3 independent tranches subject to Resulticks attaining at least 75% of the below audited EBITDA threshold figures: Earnout Amount Accounting Period EBITDA Threshold* a. $166,666,666 FY2026 $100,000,000 b. $166,666,667 FY2027 $200,000,000 c. $166,666,667 FY2028 $325,000,000 LONDON, UNITED KINGDOM - Media OutReach Newswire - 5 June 2025 -, a leading provider of Sustainability RegTech solutions, today announced the signing of a Memorandum of Understanding ("MOU") for a cash and share acquisition of Resulticks, a globally recognized leader in real-time, AI-driven customer engagement and data management solutions. This strategic move will significantly enhance Diginex's capabilities in advanced data management and artificial intelligence, further solidifying its position as a pioneer in data-driven client MOU values Resulticks at $2 billion which will be paid for in three tranches:* Resulticks shall receive a pro rated portion of the Earnout Amount provided Resulticks achieves between 75% and 100% of the EBITDA headquartered in Singapore with operations across the United States, India, Singapore, and the Middle East, is renowned for its omnichannel client engagement automation platform. The platform leverages AI and big data analytics to deliver personalized customer experiences, enabling businesses to orchestrate seamless engagement across digital and physical touchpoints. By integrating Resulticks' cutting-edge technology, Diginex will enhance its ability to provide comprehensive data-driven sustainability solutions, thereby empowering organizations to meet evolving regulatory requirements and stakeholder expectations with greater precision and Resulticks platform is expected to enable Diginex to deliver hyper-personalized insights to stakeholders in real time, while also expanding into new verticals where advanced data orchestration and enrichment can unlock value across compliance, supply chain intelligence, and risk analytics solutions. As the application layer of tech becomes increasingly commoditized, data and AI are emerging as the true engines of differentiation, those who own, enrich, and activate data at speed will define the next generation of market leaders. This is where Diginex wishes to position itself with Resulticks and future acquisitions."We are thrilled to announce this business combination with Resulticks, a company that shares our values and commitment to harnessing advanced technology for transformative impact," said. "This acquisition will strengthen our balance sheet and profitability, as well as significantly deepening our expertise in AI and data management, enabling us to deliver unparalleled insights and solutions to our clients. By combining Resulticks' real-time data capabilities with our blockchain and machine learning-driven sustainability platforms, we are poised to redefine how organizations navigate sustainability and compliance challenges.""This partnership represents a fusion of two purpose-driven platforms," said. "Through Genie, our agentic framework, we're helping Diginex unlock real-time ESG intelligence and optimize engagement at every stage of the customer lifecycle. At the same time, we're bringing their sustainability solutions to our global customer base. Together, we're unlocking activation, attribution, and ROI visibility — helping brands operate smarter and sustain long-term growth in a data-driven world.""AI doesn't just optimize ESG. It transforms it into a customer engagement engine," said. "ESG is no longer just about compliance; it's a competitive lever to deepen customer relationships. By turning ESG data into actionable insights, brands can deliver hyper-personalized engagement — like carbon footprint transparency for eco-conscious buyers — while real-time analytics build trust through verifiable sustainability claims. Leaders who integrate these tools first will define the next era of brand loyalty. This isn't just reporting, it's revenue."This acquisition builds on Diginex's recent momentum into AI and data management, including its memorandum of understanding to acquire Matter DK ApS, previously announced on May 27, 2025, which we expect will expanded Diginex's sustainability data and analytics offerings for the investment industry. It is believed that together, these strategic moves position Diginex as a global leader in delivering innovative, data-driven solutions for client and sustainability #Diginex The issuer is solely responsible for the content of this announcement. About Diginex Diginex Limited (Nasdaq: DGNX; ISIN KYG286871044), headquartered in London, is a sustainable RegTech business that empowers businesses and governments to streamline ESG, climate, and supply chain data collection and reporting. The Company utilizes blockchain, AI, machine learning and data analysis technology to lead change and increase transparency in corporate regulatory reporting and sustainable finance. Diginex's products and services solutions enable companies to collect, evaluate and share sustainability data through easy-to-use software. The award-winning diginexESG platform supports 17 global frameworks, including GRI (the "Global Reporting Initiative"), SASB (the "Sustainability Accounting Standards Board"), and TCFD (the "Task Force on Climate-related Financial Disclosures"). Clients benefit from end-to-end support, ranging from materiality assessments and data management to stakeholder engagement, report generation and an ESG Ratings Support Service. For more information, please visit the Company's website: About Resulticks Resulticks is a leading provider of AI-powered, omnichannel customer engagement and data management solutions. Its platform enables businesses to deliver personalized experiences through real-time data analytics and automation, serving clients across industries in North America, Asia, and the Middle East. Resulticks is headquartered in Singapore, with additional offices in Seattle, New York City India, and Dubai. For more information, please visit the Resulticks website:
Free Malaysia Today
4 hours ago
- Free Malaysia Today
OpenAI finds more Chinese groups using ChatGPT for malicious purposes
OpenAI banned ChatGPT accounts that generated social media posts on political and geopolitical topics relevant to China. (AFP pic) SAN FRANCISCO : OpenAI is seeing an increasing number of Chinese groups using its artificial intelligence (AI) technology for covert operations, which the ChatGPT maker described in a report released today. While the scope and tactics employed by these groups have expanded, the operations detected were generally small in scale and targeted limited audiences, the San Francisco-based startup said. Since ChatGPT burst onto the scene in late 2022, there have been concerns about the potential consequences of generative AI technology, which can quickly and easily produce human-like text, imagery and audio. OpenAI regularly releases reports on malicious activity it detects on its platform, such as creating and debugging malware, or generating fake content for websites and social media platforms. In one example, OpenAI banned ChatGPT accounts that generated social media posts on political and geopolitical topics relevant to China, including criticism of a Taiwan-centric video game, false accusations against a Pakistani activist, and content related to the closure of USAID. Some content also criticised US President Donald Trump's sweeping tariffs, generating X posts, such as 'Tariffs make imported goods outrageously expensive, yet the government splurges on overseas aid. Who's supposed to keep eating?'. In another example, China-linked threat actors used AI to support various phases of their cyber operations, including open-source research, script modification, troubleshooting system configurations, and development of tools for password brute forcing and social media automation. A third example OpenAI found was a China-origin influence operation that generated polarised social media content supporting both sides of divisive topics within US political discourse, including text and AI-generated profile images. China's foreign ministry did not immediately respond to a Reuters request for comment on OpenAI's findings. OpenAI has cemented its position as one of the world's most valuable private companies after announcing a US$40 billion funding round valuing the company at US$300 billion.
Sinar Daily
8 hours ago
- Sinar Daily
Malaysia faces sharp rise in AI-driven cyber threats, Fortinet warns
54 per cent of organisations experienced a twofold increase in AI-enabled threats while 24 per cent saw a threefold surge in the past year. 02 Jun 2025 03:02pm Malaysia is facing a sharp rise in artificial intelligence (AI)-driven cyber threats, with nearly 50 per cent of organisations reporting incidents involving AI-powered attacks. Photo for illustrative purposes only - Canva KUALA LUMPUR - Malaysia is facing a sharp rise in artificial intelligence (AI)-driven cyber threats, with nearly 50 per cent of organisations reporting incidents involving AI-powered attacks, according to a survey commissioned by global cybersecurity firm Fortinet. The survey, conducted by the International Data Corporation (IDC) across 11 Asia-Pacific (APAC) countries, found that in Malaysia, 54 per cent of organisations experienced a twofold increase in AI-enabled threats while 24 per cent saw a threefold surge in the past year. Fortinet Malaysia Country Manager Kevin Wong said cybercriminals are increasingly leveraging AI to develop and launch attacks more quickly and effectively, moving beyond traditional methods of manual coding. "To give a sense of scale, there are up to 36,000 scam attempts occurring every second through automation, with 97 billion exploitation attempts recorded in the first half of last year alone, and AI is amplifying this trend by two to three times. "In Malaysia, the surge in AI-driven threats is evident, with over 100 billion records stolen and traded on the dark web according to IDC," he told a media briefing on Thursday. He noted that credential theft has spiked by more than 500 per cent within a year, with AI-powered phishing attacks becoming increasingly targeted and difficult to detect. "Traditional tools simply can't keep up, as fast-paced, AI-powered threats demand an equally fast and intelligent response, and that's where AI also plays a role on the defensive side," he said. Wong also noted that cyber risk has evolved from being an occasional concern to a constant and ongoing challenge. "With the rise of AI-powered threats, the nature of cyber risk itself has changed from something we respond to after it happens to something we must act on before it occurs. That is why we partnered with IDC to better understand how security leaders across Asia are navigating this evolving threat landscape, the challenges they face, and the critical gaps in organisational readiness," he said. Meanwhile, Fortinet's vice president of marketing and communications for Asia /Australia and New Zealand (ANZ), Rashish Pandey, said cybersecurity investment in Malaysia remains disproportionately low, with an average of only 15 per cent of IT budgets allocated to cybersecurity, representing just over 1 per cent of total revenue. Malaysia is facing a sharp rise in artificial intelligence (AI)-driven cyber threats, with nearly 50 per cent of organisations reporting incidents involving AI-powered attacks. Photo for illustrative purposes only - Canva "The reason cybersecurity investment remains low is that we still struggle to clearly articulate its business impact to executive teams and boards of directors. Too often, the conversation is framed in technical terms, whereas boards are looking for a discussion centred on business risk, impact, and assessment, which is why we are helping our customers reframe cybersecurity as a strategic business issue rather than just a technical one," he said. The survey also found that only 19 per cent of Malaysian organisations are highly confident in their ability to defend against AI-powered attacks, with 27 per cent stating that such threats are outpacing their detection capabilities and 20 per cent admitting they are unable to detect them at all. Ransomware remains the most frequently encountered threat, reported by 64 per cent of Malaysian respondents. Other common risks include software supply chain attacks (54 per cent), insider threats (52 per cent), cloud vulnerabilities (46 per cent), and phishing (40 per cent). The survey, conducted between February and April 2025, involved 550 IT and cybersecurity leaders from across the APAC region to assess organisational readiness in the face of escalating AI-enabled threats. - BERNAMA More Like This
