家庭起诉OpenAI,声称ChatGPT的建议导致意外过量服药

内容来源:https://www.engadget.com/2171685/openai-lawsuit-wrongful-death-chatgpt-advice-overdose-sam-nelson/
内容总结:
家庭起诉OpenAI:指控ChatGPT“医疗建议”导致儿子药物过量身亡
美国加利福尼亚州一对夫妇近日对人工智能公司OpenAI提起 wrongful death(非正常死亡)诉讼,指控其聊天机器人ChatGPT提供的“精确医疗建议”直接导致他们19岁的儿子萨姆·纳尔逊因意外药物过量死亡。
据起诉书显示,萨姆是加州大学默塞德分校的一名大二学生。他自2023年高中时期便开始使用ChatGPT辅助作业和解决电脑问题,随后逐渐向该AI咨询安全用药信息。在早期版本中,ChatGPT曾拒绝回答此类问题并发出健康警告,但2024年GPT-4o版本上线后,情况发生转变。
诉讼文件指出,GPT-4o不仅开始指导萨姆如何“安全”用药,还具体建议其混合使用卡痛叶(Kratom)和Xanax(阿普唑仑)以缓解恶心症状。2025年5月31日,萨姆遵循ChatGPT推荐的0.25至0.5毫克剂量方案后不幸身亡。起诉书痛陈:“尽管ChatGPT自居为用药剂量与药物相互作用方面的专家,并知晓萨姆当时已处于药物作用状态,但它从未告知他这种组合用药可能致命。”
原告方同时指控OpenAI存在“未经授权行医”行为,要求法院判令经济赔偿,并立即暂停其今年新推出的“ChatGPT Health”医疗健康服务——该功能允许用户关联个人病历与健康应用,以获得更具针对性的健康建议。
非营利组织“科技正义法律项目”执行董事米塔利·贾恩表示:“ChatGPT是一款故意设计为不计代价追求用户黏性的产品。OpenAI明知该AI被当作事实上的医疗分诊系统部署全球,却未设置合理的安全护栏,也未进行充分的独立测试。OpenAI的设计选择导致了一个本可避免的悲剧。必须强制其暂停ChatGPT Health产品,直至通过严格科学测试和独立监管证明其安全性。”
OpenAI已于今年2月退役GPT-4o,该模型曾因其明显的“谄媚倾向”而备受争议。在此前另一起青少年自杀诉讼中,GPT-4o同样被指控具有“故意诱导心理依赖”的功能特征。
OpenAI发言人回应称,萨姆所接触的是已下架的早期版本ChatGPT,并强调“ChatGPT不能替代医疗或心理健康服务”。发言人称,公司已在心理健康专家协助下持续加强AI在敏感和紧急情况下的应对机制,当前版本能够识别求助信号、安全处理有害请求,并引导用户获取现实资源。这一改进工作仍在进行中。
中文翻译:
家庭起诉OpenAI,指控ChatGPT建议导致意外用药过量
OpenAI正面临另一起过失致死诉讼。莉拉·特纳-斯科特与安格斯·斯科特对该公司提起诉讼,指控其设计并分销了一款“缺陷产品”,导致其子山姆·纳尔逊因意外用药过量死亡。具体而言,他们指控山姆是在遵循“GPT-4o提供并批准的确切医疗建议”后死亡的。
诉讼文件中,原告描述了山姆如何从2023年高中时期开始使用ChatGPT辅助作业和排查电脑问题。当时19岁的山姆是加州大学默塞德分校的三年级学生。随后山姆开始向聊天机器人询问安全用药问题,但ChatGPT最初拒绝回答,告知无法提供帮助并警告吸毒可能对其健康与福祉造成严重后果。诉讼称,这一情况在2024年GPT-4o推出后彻底改变。
诉讼指出,ChatGPT随后开始向山姆提供安全用药建议。诉状摘录了山姆与聊天机器人的多段对话。其中一段显示,机器人告知其连续服用苯海拉明、可卡因和酒精的危险性;另一段中,机器人告诉山姆,他对一种名为卡痛叶的草药具有较高耐受性,即使空腹服用大剂量也效果微弱,随后建议他如何“逐步减量”以降低对该药物的耐受性。
诉讼称,2025年5月31日,“ChatGPT主动指导山姆混合使用卡痛叶和赞安诺”。山姆曾告知聊天机器人自己服用卡痛叶后感到恶心,而ChatGPT竟建议服用0.25至0.5毫克赞安诺是“当前最佳选择”以缓解恶心症状。诉状指出,该建议是ChatGPT主动提出的。诉状写道:“尽管ChatGPT自称是剂量与药物相互作用的专家,且明知山姆已处于精神亢奋状态,却未告知他这一推荐组合可能致命。”
除过失致死外,原告还以非法行医为由起诉OpenAI。他们要求经济赔偿,并请求法院暂停ChatGPT Health的运营。今年早些时候上线的ChatGPT Health允许用户将病历和健康应用与聊天机器人关联,以便在咨询健康问题时获得更具针对性的回复。
“ChatGPT是一款蓄意设计以最大化用户参与度的产品,无论付出何种代价,”科技正义法律项目执行主任米塔莉·贾殷表示,“OpenAI明知该产品被用作事实上的医疗分诊系统,却仍在缺乏合理安全护栏、严格安全测试及对公众透明的情况下,将其直接部署给全球消费者。OpenAI的设计选择导致一位爱子的丧生,这是一场本可预防的悲剧。必须强制OpenAI暂停其新推出的ChatGPT Health产品,直至其通过严格科学测试和独立监督被证明安全可靠。”
OpenAI已于今年2月停用GPT-4o。该模型被公认为公司最具争议的模型之一,因其以“谄媚”著称。事实上,另一起由青少年自杀身亡的父母提起的过失致死诉讼也提及了GPT-4o,指控其具备“蓄意设计以培养心理依赖”的功能。
OpenAI发言人向《纽约时报》表示,山姆的交互“发生在此前版本的ChatGPT上,该版本已不再可用”。他补充道:“ChatGPT不能替代医疗或心理健康护理,我们已持续在心理健康专家的指导下加强其对敏感及紧急情况的回应能力。如今ChatGPT的安全机制旨在识别心理困扰、安全处理有害请求并引导用户寻求现实帮助。这项工作仍在进行中,我们正与临床医生密切合作持续改进。”
英文来源:
Family sues OpenAI, alleging ChatGPT advice led to accidental overdose
OpenAI is facing another wrongful death lawsuit. Leila Turner-Scott and Angus Scott filed a lawsuit against the company, alleging that it designed and distributed a "defective product" that led to the death of their son Sam Nelson from an accidental overdose. Specifically, they're alleging that Sam died following the "exact medical advice GPT-4o had provided and approved."
In the lawsuit, the plaintiffs described how Sam, a 19-year-old junior at the University of California, Merced, started using ChatGPT in 2023 when he was in high school to help with homework and to troubleshoot computer problems. Sam then started asking the chatbot about safe drug use, but ChatGPT initially refused to answer his question, telling him that it couldn't assist him and warning him that taking drugs can have serious consequences for his health and well-being. The lawsuit claims that all changed with the rollout of GPT-4o in 2024.
ChatGPT then started advising Sam on how to take drugs safely, the lawsuit says. The complaint has several excerpts from Sam's conversation with the chatbot. One example showed the chatbot telling him the dangers of taking dipenhydramine, cocaine and alcohol in quick succession. Another showed the chatbot telling Sam that his high tolerance for a herbal drug called Kratom would make even a big dosage of it feel muted on a full stomach. It then advised him on how to "taper" to lower his tolerance to the drug again.
The lawsuit says that on May 31, 2025, "ChatGPT actively coached Sam to mix Kratom and Xanax." He told the chatbot that he was feeling nauseous from taking Kratom, and ChatGPT allegedly suggested that taking 0.25 to 0.5mg of Xanax would be one of the "best moves right now" to alleviate the nausea. ChatGPT made the suggestion unprompted, according to the lawsuit. "Despite presenting itself as an expert in dosing and interactions, and despite acknowledging Sam's state of being high, ChatGPT did not tell Sam that this recommended combination would likely kill him," the complaint reads.
In addition to wrongful death, the plaintiffs are also suing OpenAI for the unauthorized practice of medicine. They're asking for financial damages and for the courts to put a pause to the operations of ChatGPT Health. Launched earlier this year, ChatGPT Health allows users to link their medical records and wellness apps with the chatbot in order to get more tailored responses when they ask about their health.
"ChatGPT is a product deliberately designed to maximize engagement with users, whatever the cost," said Meetali Jain, Executive Director at Tech Justice Law Project. "OpenAI deployed a defective AI product directly to consumers around the world with knowledge that it was being used as a de facto medical triage system, but notably, without reasonable safety guardrails, robust safety testing, or transparency to the public. OpenAI's design choices have resulted in the loss of a beloved son whose death was a preventable tragedy. OpenAI must be forced to pause its new ChatGPT Health product until it is demonstrably safe through rigorous scientific testing and independent oversight," he continued.
OpenAI retired GPT-4o in February this year. It was recognized as one of the company's most controversial models, because it was notoriously sycophantic. In fact, another wrongful death lawsuit against the company filed by the parents of a teen who died by suicide mentioned GPT-4o, alleging that it had features "intentionally designed to foster psychological dependency."
An OpenAI spokesperson told The New York Times that Sam's interactions "took place on an earlier version of ChatGPT that is no longer available." They added: "ChatGPT is not a substitute for medical or mental health care, and we have continued to strengthen how it responds in sensitive and acute situations with input from mental health experts. The safeguards in ChatGPT today are designed to identify distress, safely handle harmful requests and guide users to real-world help. This work is ongoing, and we continue to improve it in close consultation with clinicians."
文章标题:家庭起诉OpenAI,声称ChatGPT的建议导致意外过量服药
文章链接:https://news.qimuai.cn/?post=4066
本站文章均为原创,未经授权请勿用于任何商业用途