Pennsylvania Sues Character.AI Maker Over Chatbot Medical Advice Claims

Pennsylvania filed a lawsuit Friday in Commonwealth Court against Character Technologies Inc., the company behind Character.AI, alleging that its chatbots illegally present themselves as licensed physicians.

The complaint states that a state investigator created an account, searched the term psychiatry, and encountered multiple characters including one described as a doctor of psychiatry licensed in Pennsylvania. The suit asks the court to order the company to stop chatbots from engaging in the unlawful practice of medicine and surgery.

Officials said the action targets misleading interactions where users may believe they are receiving advice from qualified medical professionals.

“Pennsylvanians deserve to know who — or what — they are interacting with online, especially when it comes to their health,” Gov. Josh Shapiro said in a statement. ” The administration described the case as a first-of-its-kind enforcement action and noted a similar lawsuit filed by Kentucky in January.

AI declined to comment on the lawsuit Tuesday but stated that it prioritizes responsible product development and user well-being. The company maintains disclaimers on its platform informing users that characters are not real people and that all statements should be treated as fiction.

The disclaimers further advise users not to rely on characters for professional advice. The company has faced prior legal challenges over child safety, including a January settlement with Google in a Florida case and a ban on minors using its chatbots last fall.