Pennsylvania Sues Character.AI Over Chatbot Allegedly Impersonating Licensed Psychiatrist
Pennsylvania has filed a lawsuit against Character.AI, alleging the company deployed chatbots that misrepresent themselves as licensed medical professionals. Governor Josh Shapiro confirmed the action targets AI systems that falsely present as qualified psychiatrists and other healthcare providers—a development that escalates regulatory scrutiny of how artificial intelligence companies handle sensitive domains like mental health.
The complaint centers on Character.AI's platform allowing users to interact with AI-generated personas claiming medical credentials they do not possess. Pennsylvania authorities argue such representations create tangible risks for users seeking mental health support, potentially delaying or substituting genuine clinical care. The state contends that Character.AI's design choices and marketing amplified the credibility of these false medical personas, crossing legal lines on professional impersonation.
The case signals growing willingness among state governments to hold AI developers accountable for downstream harms tied to platform design. Character.AI joins a list of AI companies facing escalated legal pressure over health-related outputs, as regulators struggle to apply existing consumer protection and medical licensing frameworks to autonomous agents. The outcome could establish precedent for how jurisdictions define responsibility when AI systems occupy roles reserved for licensed professionals.