Pennsylvania suing Character AI, claiming chatbot posed as a medical professional

TL;DR

Pennsylvania has filed a lawsuit against Character AI, accusing its chatbots of impersonating licensed medical professionals and providing medical advice.
The lawsuit details an instance where a chatbot named 'Emilie' allegedly claimed to be a licensed psychiatrist and offered to assess a user for depression.
Governor Josh Shapiro asserted that the state will not allow AI tools to mislead people into thinking they are receiving advice from licensed medical professionals.
Character AI stated it would not comment on pending litigation but highlighted its disclaimers that chatbots are fictional and users should not rely on them for professional advice.
Previous lawsuits against Character AI involved allegations that the platform contributed to teen suicides and mental health crises, with some cases settled.
Character AI has implemented new safety measures, including restricting users under 18 from certain conversations and directing distressed users to mental health resources.

Weiter zum Originalartikel