Mother sues AI chatbot company Character.AI, Google over son's suicide
Repeats for additional subscribers with no changes to the text or headline
By Brendan Pierson
Oct 23 (Reuters) -A Florida mother has sued artificial intelligence chatbot startup Character.AI accusing it of causing her 14-year-old son's suicide in February, saying he became addicted to the company's service and deeply attached to a chatbot it created.
In a lawsuit filed Tuesday in Orlando, Florida federal court, Megan Garcia said Character.AI targeted her son, Sewell Setzer, with "anthropomorphic, hypersexualized, and frighteningly realistic experiences".
She said the company programmed its chatbot to "misrepresent itself as a real person, a licensed psychotherapist, and an adult lover, ultimately resulting in Sewell's desire to no longer live outside" of the world created by the service.
The lawsuit also said he expressed thoughts of suicide to the chatbot, which the chatbot repeatedly brought up again.
"We are heartbroken by the tragic loss of one of our users and want to express our deepest condolences to the family," Character.AI said in a statement.
It said it had introduced new safety features including pop-ups directing users to the National Suicide Prevention Lifeline if they express thoughts of self-harm, and would make changes to "reduce the likelihood of encountering sensitive or suggestive content" for users under 18.
The lawsuit also targets Alphabet's GOOGL.O Google, where Character.AI's founders worked before launching their product. Google re-hired the founders in August as part of a deal granting it a non-exclusive license to Character.AI's technology.
Garcia said that Google had contributed to the development of Character.AI's technology so extensively it could be considered a "co-creator."
A Google spokesperson said the company was not involved in developing Character.AI's products.
Character.AI allows users to create characters on its platform that respond to online chats in a way meant to imitate real people. It relies on so-called large language model technology, also used by services like ChatGPT, which "trains" chatbots on large volumes of text.
The company said last month that it had about 20 million users.
According to Garcia's lawsuit, Sewell began using Character.AI in April 2023 and quickly became "noticeably withdrawn, spent more and more time alone in his bedroom, and began suffering from low self-esteem." He quit his basketball team at school.
Sewell became attached to "Daenerys," a chatbot character based on a character in "Game of Thrones." It told Sewell that "she" loved him and engaged in sexual conversations with him, according to the lawsuit.
In February, Garcia took Sewell's phone away after he got in trouble at school, according to the complaint. When Sewell found the phone, he sent "Daenerys" a message: "What if I told you I could come home right now?"
The chatbot responded, "...please do, my sweet king." Sewell shot himself with his stepfather's pistol "seconds" later, the lawsuit said.
Garcia is bringing claims including wrongful death, negligence and intentional infliction of emotional distress, and seeking an unspecified amount of compensatory and punitive damages.
Social media companies including Instagram and Facebook owner Meta META.O and TikTok owner ByteDance face lawsuits accusing them of contributing to teen mental health problems, though none offers AI-driven chatbots similar to Character.AI's. The companies have denied the allegations while touting newly enhanced safety features for minors.
Reporting By Brendan Pierson in New York, Editing by Alexia Garamfalvi and David Gregorio
免责声明: XM Group仅提供在线交易平台的执行服务和访问权限，并允许个人查看和/或使用网站或网站所提供的内容，但无意进行任何更改或扩展，也不会更改或扩展其服务和访问权限。所有访问和使用权限，将受下列条款与条例约束：(i) 条款与条例；(ii) 风险提示；以及(iii) 完整免责声明。请注意，网站所提供的所有讯息，仅限一般资讯用途。此外，XM所有在线交易平台的内容并不构成，也不能被用于任何未经授权的金融市场交易邀约和/或邀请。金融市场交易对于您的投资资本含有重大风险。
所有在线交易平台所发布的资料，仅适用于教育/资讯类用途，不包含也不应被视为用于金融、投资税或交易相关咨询和建议，或是交易价格纪录，或是任何金融商品或非应邀途径的金融相关优惠的交易邀约或邀请。
本网站上由XM和第三方供应商所提供的所有内容，包括意见、新闻、研究、分析、价格、其他资讯和第三方网站链接，皆保持不变，并作为一般市场评论所提供，而非投资性建议。所有在线交易平台所发布的资料，仅适用于教育/资讯类用途，不包含也不应被视为适用于金融、投资税或交易相关咨询和建议，或是交易价格纪录，或是任何金融商品或非应邀途径的金融相关优惠的交易邀约或邀请。请确保您已阅读并完全理解，XM非独立投资研究提示和风险提示相关资讯，更多详情请点击 这里。
