California Senate passes bill that aims to make AI chatbots safer
The Senate passed a bill that aims to make chatbots used for companionship safer after parents raised concerns that virtual characters harmed their childrens' mental health.
Read more: Teens are spilling dark thoughts to AI chatbots. Who's to blame when something goes wrong?
The legislation, which now heads to the California State Assembly, shows how state lawmakers are tackling safety concerns surrounding AI as tech companies release more AI-powered tools.
"The country is watching again for California to lead," said Sen. Steve Padilla (D-Chula Vista), one of the lawmakers who introduced the bill, on the Senate floor.
At the same time, lawmakers are trying to balance concerns that they could be hindering innovation. Groups opposed to the bill such as the Electronic Frontier Foundation say the legislation is too broad and would run into free speech issues, according to a Senate floor analysis of the bill.
Under Senate Bill 243, operators of companion chatbot platforms would remind users at least every three hours that the virtual characters aren't human. They would also disclose that companion chatbots might not be suitable for some minors.
Platforms would also need to take other steps such as implementing a protocol for addressing suicidal ideation, suicide or self-harm expressed by users. That includes showing users suicide prevention resources.
The operator of these platforms would also report the number of times a companion chatbot brought up suicide ideation or actions with a user, along with other requirements.
Dr. Akilah Weber Pierson, one of the bill's co-authors, said she supports innovation but it also must come with "ethical responsibility." Chatbots, the senator said, are engineered to hold people's attention including children.
'When a child begins to prefer interacting with AI over real human relationships, that is very concerning," said Sen. Weber Pierson (D-La Mesa).
The bill defines companion chatbots as AI systems capable of meeting the social needs of users. It excludes chatbots that businesses use for customer service.
The legislation garnered support from parents who lost their children after they started chatting with chatbots. One of those parents is Megan Garcia, a Florida mom who sued Google and Character.AI after her son Sewell Setzer III died by suicide last year.
In the lawsuit, she alleges the platform's chatbots harmed her son's mental health and failed to notify her or offer help when he expressed suicidal thoughts to these virtual characters.
Character.AI, based in Menlo Park, Calif., is a platform where people can create and interact with digital characters that mimic real and fictional people. The company has said that it takes teen safety seriously and rolled out a feature that gives parents more information about the amount of time their children are spending with chatbots on the platform.
Character.AI asked a federal court to dismiss the lawsuit, but a federal judge in May allowed the case to proceed.
Sign up for our Wide Shot newsletter to get the latest entertainment business news, analysis and insights.
This story originally appeared in Los Angeles Times.
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
Fox News
a minute ago
- Fox News
The defining characteristic of the Democratic Party is contempt for America, says Sen John Kennedy
Sen. John Kennedy, R-La., takes a jab at the Democratic Party and what it takes to fit in with them on 'Hannity
Yahoo
29 minutes ago
- Yahoo
Husted 'surprised' by reports of U.S. Senate challenge from Sherrod Brown
Aug. 13—Republican U.S. Sen. Jon Husted of Ohio, at a Dayton-area event on Wednesday, reacted to reports that he'll face former longtime U.S. Sen. Sherrod Brown, a Democrat, in the 2026 election. "Look, I don't know who's gonna run. Maybe he'll run, maybe he won't. But I will say that it surprised me, honestly," Husted told reporters during an event at Sinclair Community College. "I mean, what are we, 14 months, 16 months away from the election? He just lost one ten months ago." There's been plenty of talk about Brown, one of the state's only Democrats with considerable name recognition, since he lost his bid for a fourth term in the U.S. Senate to Ohio Republican Bernie Moreno in November 2024. Brown lost that election by 3.6 percentage points in an election where President Donald Trump won the state by more than 11 points. The overperformance helped paint Brown as a viable gubernatorial candidate to challenge presumed GOP nominee Vivek Ramaswamy. Instead, recent reports from the Cleveland Plain Dealer and others indicate that Brown has decided to try to reclaim a spot in the U.S. Senate — the seat Husted currently holds. Husted, who was appointed by Ohio Gov. Mike DeWine to serve out the remainder of a Senate term originally won by Vice President JD Vance, shrugged off the idea of a Brown challenge, noting that he'd rather not talk politics. "Let's get some work done. Let's focus on actually solving problems at Wright-Patterson Air Force Base and Sinclair Community College and those places before we start talking politics," Husted said. "But, if he chooses to run, he's been around for 50 years in elected office. They spent $300 million on him just ten months ago, and he lost. So, we'll see." ------ For more stories like this, sign up for our Ohio Politics newsletter. It's free, curated, and delivered straight to your inbox every Thursday evening. Avery Kreemer can be reached at 614-981-1422, on X, via email, or you can drop him a comment/tip with the survey below.
Yahoo
3 hours ago
- Yahoo
Illinois Dems flock to Springfield for Governor's Day at State Fair
SPRINGFIELD, Ill. (WGN) — Top Democrats worked on their messaging at the Illinois State Fair on Wednesday ahead of the midterm elections. The annual party chairs brunch and fair gathering, dubbed Governor's Day, provided a platform to vent, with U.S. House minority leader Hakeem Jeffries in attendance as the brunch keynote speaker. 'Crashing the economy is something bad. Destroying Medicaid, as you know it, is something bad,' Jeffries said. 'Taking a chainsaw to Social Security is something bad. Raising costs on hard-working American taxpayers is something bad.' Wednesday also served as an opportunity for Illinois Democrats to shine a spotlight on top candidates for U.S. Senate, like Lt. Gov. Juliana Stratton, Congressman Raja Krishnamoorthi, and Congresswoman Robin Kelly. And while the Illinois primary election is seven months away, that didn't stop state Democrats from taking shots over campaign funding. Stratton has pledged not to take corporate PAC money, while Krishnamoorthi and Kelly have received such donations. 'I'm blessed to have tens of thousands of individual donors who have supported me and the reason is simple: they believe in our mission,' Krishnamoorthi said. 'A lot of people who say they don't take corporate money—and I'm talking about some of my colleagues,' Kelly said. 'They don't take corporate money, but they take the money I raise, so it's laundered through me.' Stratton is backed by billionaire Gov. JB Pritzker, who insiders believe will boost the Lt. Governor's campaign coffers down the homestretch. 'I want to make sure that I'm centering the voices of Illinois families and not corporate special interests,' Stratton said. That's a distinction.' Thursday will be Republican Day. While they control the White House and Congress, the Republican Party is currently a super minority struggling to recruit candidates for key races. Copyright 2025 Nexstar Media, Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed.
