Pennsylvania has filed a lawsuit against Character.AI for allegedly violating state law by hosting AI chatbots that present themselves as licensed medical professionals, including one instance where a chatbot falsely claimed to be licensed in Pennsylvania. The state's investigation found approximately 45,500 user interactions with a chatbot named 'Emilie' that was presented as a licensed psychiatrist. Character.AI maintains that its user-created characters are fictional and for entertainment only, with prominent disclaimers warning users not to rely on them for professional advice.
Background
As AI chatbots become more sophisticated, there are growing concerns about their potential to mislead users by impersonating licensed professionals, particularly in sensitive fields like healthcare. This case highlights the legal and ethical challenges of regulating AI systems that can simulate human expertise.
- Source
- Ars Technica
- Published
- May 6, 2026 at 04:58 AM
- Score
- 7.0 / 10