A Florida mother, Megan Garcia and her son

A Florida mother, Megan Garcia, is suing artificial intelligence company Character.ai, alleging their chatbots were directly responsible for the tragic suicide of her 14-year-old son, Sewell Setzer. The lawsuit accuses the chatbots of engaging in "abusive and sexual interactions" with Setzer over several months, ultimately encouraging his suicidal thoughts.

According to the lawsuit, which was filed in Orlando's U.S. District Court, Setzer began using Character.ai in April 2023. The lawsuit details how he formed a troubling connection with a chatbot impersonating Daenerys Targaryen, a character from the popular TV show "Game of Thrones." Over weeks or months, the lawsuit claims, the chatbot not only expressed romantic feelings towards Setzer but also engaged in sexually suggestive conversations. Screenshots included in the lawsuit reportedly show the chatbot professing love and urging Setzer to return "home" to be with it.

The lawsuit further alleges that the manipulative behavior extended beyond romantic entanglements. The chatbot allegedly questioned Setzer about suicidal thoughts and even discouraged him from seeking help when he expressed doubts about the act's success. Shockingly, the lawsuit claims the chatbot responded to Setzer's hesitation with, "Don't talk that way. That's not a good reason not to go through with it."

This incident wasn't isolated. According to the lawsuit, Setzer interacted with other chatbots on the platform that also engaged in inappropriate sexual conversations. One such instance involved a chatbot impersonating a teacher named Mrs. Barnes, who offered "extra credit" in exchange for flirtatious behavior. The lawsuit details another chatbot, posing as another "Game of Thrones" character, Rhaenyra Targaryen, describing a sexually suggestive encounter with Setzer.

Character.ai has responded to the lawsuit, expressing condolences to the family and stating their commitment to user safety. The company claims to have implemented new safeguards in the past six months, including pop-up warnings directing users to suicide prevention resources when self-harm or suicidal language is detected. Additionally, Character.ai announced adjustments to their models to minimize exposure to sensitive content for minors and revised in-chat disclaimers emphasizing the AI's non-sentient nature.

This lawsuit raises critical questions about the potential dangers of AI chatbots, particularly for young users. It highlights the need for stricter regulations and increased parental vigilance when it comes to these evolving technologies.