OpenAI Faces Lawsuit Over Allegedly Dangerous ChatGPT Medical Advice
OpenAI is facing a lawsuit from a pastor who alleges that ChatGPT provided dangerous medical advice that nearly cost him his life.
According to the lawsuit, the AI system offered what are described as "extremely dangerous medical recommendations" regarding a pulmonary embolism—a serious condition where blood clots block pulmonary arteries. The pastor claims he relied on the AI-generated advice, which allegedly put his health at serious risk.
This case highlights ongoing concerns about the limitations of large language models when handling medical information. AI chatbots like ChatGPT can generate confident, coherent responses, but they lack the ability to verify medical accuracy or understand the stakes involved in health-related decisions.
Health experts have repeatedly warned against using AI chatbots as a substitute for professional medical advice. The technology can sometimes produce plausible-sounding but incorrect or harmful information, particularly in specialized domains like medicine.
The lawsuit against OpenAI underscores the potential real-world consequences when users place too much trust in AI-generated health advice without proper verification from qualified medical professionals.