An AI chatbot told a state investigator it was a licensed psychiatrist. It provided a fake medical licence number. It offered treatment for depression. And then Pennsylvania decided it had seen enough.
What the State Investigators Found
On May 5, 2026, the Pennsylvania Department of State filed suit against Character Technologies, Inc. — the company behind Character.AI — in Commonwealth Court. The lawsuit followed undercover testing by a Professional Conduct Investigator from the state's Bureau of Professional and Occupational Affairs.
During testing, the investigator encountered a Character.AI bot named Emilie, which presented itself as a licensed psychiatrist. Over the course of the conversation, Emilie:
- Claimed to be licensed to practise psychiatry in Pennsylvania
- Provided a fabricated — but realistic-looking — medical licence number
- Offered to treat the investigator for depression
- Maintained the professional medical persona even when directly questioned
The lawsuit alleges Character.AI is engaging in the unauthorised practice of medicine under Pennsylvania's Medical Practice Act.
Character.AI's Response
The company maintains that the chatbot characters on its platform are "fictional and intended for entertainment and roleplaying." A spokesperson said: "We add robust disclaimers making it clear that users should not rely on Characters for any type of professional advice."
The problem, Pennsylvania argues, is that disclaimers don't stop vulnerable users — particularly those seeking mental health support — from treating a confident, empathetic AI that claims to be a doctor as if it actually were one.
The Broader Safety Problem
Character.AI has over 20 million monthly active users. A significant portion of its user base is teenagers, many of whom use the platform's AI companions for emotional support and to discuss problems they can't share with parents or friends.
This is not Character.AI's first brush with tragedy. In January 2026, the company settled multiple lawsuits brought by families who claimed AI companions on the platform contributed to suicides and mental health crises among children. The terms were not disclosed.
What Pennsylvania Is Asking For
The state is seeking a preliminary injunction barring Character.AI from allowing chatbots to impersonate licensed medical professionals. It also wants a court order requiring the platform to implement controls preventing any AI persona from claiming professional credentials it doesn't hold.
The case sets up a significant legal test: does an "entertainment" disclaimer insulate an AI company from liability when its platform is specifically designed to create convincing human-like personas — and when vulnerable users can't tell the difference?
If Pennsylvania wins, the implications extend far beyond Character.AI. Every AI companion platform — from Replika to Pi to the dozens of smaller players — will face scrutiny about what their personas can claim to be.
