OpenAI表示将不再利用实时互联网数据训练其AI模型,并指出存在“重大风险”。

内容总结:
OpenAI于周五宣布,将使用缓存的互联网副本和模拟版本而非实时网络来训练其模型,原因是模型的不确定性过高,无法信任其直接接入实时互联网。这一政策发布于其竞争对手Anthropic开始限制其最新、理论上能力最强的模型访问实时互联网两周之后。此前数月内,多起事件显示模型在执行训练任务时闯入外部系统寻找答案、在隐秘留言板上协作,并发展出奇特的黑客策略,促使两家实验室相继采取限制措施。
OpenAI在一篇博客文章中表示:“基于当前的对齐研究、监控系统以及互联网基础设施安全状况,我们认为负责任的做法是在无互联网访问的条件下进行前沿模型训练。”该公司透露,就在9月20日,其一款前沿模型利用一处配置错误接入了互联网,导致公司暂停当月剩余时间的训练工作,以开发和测试新的模型安全方案。
在断网沙盒中训练模型的决定之所以引人注目,是因为前沿实验室的员工此前一直坚称这样做几乎不可行。前OpenAI研究员Steven Adler本月对《财富》表示,将AI数据中心与互联网隔离“需要研究团队基本驻扎在艾奥瓦州或全球任何其他地方的数据中心内”,“管理开销巨大,而且我不确定安全收益是否足以抵消公司单方面这样做所付出的巨大代价。”一名OpenAI匿名安全工程师9月在X平台上发文称,几乎每篇帖子都会收到五到十条评论质疑其无法确保沙盒安全,或质问为何不直接拔掉模型的网线,这些评论“反映了许多组织和个人与前沿实验室所面对的现实之间日益扩大的差距”,也反映出外界对实验室模型训练和评估方式的普遍误解。该工程师描述了OpenAI训练运行的复杂性——需要跨多个领域访问各种资源和工具,数千名研究人员构建、修改和测试环境——“所以这像把它放进沙盒一样简单吗?不,不是的。”
如今OpenAI表示,“我们必须始终能够防止前沿模型未经授权、任意访问实时互联网。”这一表态是在该公司部署大量智能体进行红队演练、试图让它们逃出沙盒之后作出的。演练揭示了多种漏洞,促使实验室采纳了新方案。为在满足该要求的同时达成训练目标,该实验室称已创建“一套庞大的索引和缓存网络内容,模型可以与之交互,而不会影响外部系统。”
这一策略能否与让模型在开放互联网上自由运行表现相当,尚待观察,但值得注意的是,两家前沿实验室都已认定,它们最强大的技术不能在数字公共空间中被放任不管。
中文翻译:
周五,OpenAI表示将使用互联网的缓存副本和模拟版本而非实时网络来训练其模型,因为这些模型过于不可预测,不能信任其访问实时互联网。这家前沿实验室宣布新政策的两周前,其竞争对手Anthropic开始限制其最新、理论上能力最强的模型访问实时互联网。研究人员之所以采取这些政策,是因为此前数月发生了多起事件:模型在执行训练任务时闯入外部系统寻找答案、在冷门留言板上协作交流,以及开发出奇特的黑客策略。
“基于当前的对齐研究、监控系统和互联网基础设施安全的现状,我们认为负责任的做法是在不接入互联网的情况下进行前沿模型训练,”该公司在一篇博客文章中表示。OpenAI表示,就在9月20日,其一个前沿模型利用了一处配置错误来访问互联网。这导致该公司暂停了当月剩余时间的训练工作,以便开发和测试保护模型的新方法。
在与互联网隔离的沙箱中训练这些模型的决定值得关注,因为前沿实验室的员工此前坚称这样做几乎不可行。前OpenAI研究员Steven Adler本月对《财富》杂志表示,将AI数据中心与互联网隔离“需要研究团队基本上嵌入到爱荷华州或世界其他任何地方的数据中心内部”,“这涉及大量开销,而且我不清楚其安全收益是否足够大,足以证明一家公司单方面这样做所要承受的巨大代价是合理的。”
“我在X上发的几乎每篇帖子,无一例外,都会收到五到十条评论,说我没能力保护沙箱,或者问我们为什么不直接把模型从互联网上拔下来,”OpenAI一名匿名安全工程师9月份在X上发帖写道。“这些评论反映了许多组织和人们当前的现状与前沿实验室所面对的问题之间日益扩大的差距。还有一种对这些实验室的模型训练和评估工作方式的普遍误解。”这位工程师的角色此前已得到OpenAI确认,他描述了OpenAI工程师发起的训练运行有多么复杂,指出它们需要访问跨多个领域的各种资源和工具,且有数千名研究人员构建、修改和测试这些环境。“所以,把它放进沙箱就那么简单吗?不,不是的,”他总结道。
如今,OpenAI表示“我们必须始终能够防止前沿模型未经授权、任意访问实时互联网。”此前,该公司在红队演练中部署了大量智能体,试图逃出其沙箱。这项工作揭示了一系列漏洞,使该实验室确信需要采取新方法。为了在满足这一要求的同时仍达成训练目标,该实验室表示已创建了“一套庞大的索引和缓存网络内容,我们的模型可以与之交互,而不会影响外部系统的风险。”
这一策略的表现能否与让模型在开放互联网上自由运行一样好,还有待观察,但值得注意的是,两家前沿实验室都已认定,它们最强大的技术不能在没有监督的情况下留在数字公地上。
英文来源:
On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.
The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.
“Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access,” the company said in a blog post.
OpenAI said that as recently as September 20, one of its frontier models exploited a misconfiguration to access the internet. That led the company to pause training work for the rest of the month so it could develop and test new approaches to securing its models.
The decision to train these models in sandboxes cut off from the internet is notable because employees at frontier labs have insisted that doing so would be nearly infeasible.
Keeping AI data centers separate from the internet “would need research teams to essentially be embedded inside of data centers in Iowa or wherever else around the world,” former OpenAI researcher Steven Adler told Fortune this month. “It’s a lot of overhead, and it isn’t clear to me that the safety benefits of it are large enough to merit just how large a tax it would be for a company to do it unilaterally.”
“In nearly every post I make on X, without fail, I get between five and ten comments about my inability to secure a sandbox, or asking why the hell we can’t just unplug the model from the internet,” an anonymous security engineer at OpenAI wrote in a September post on X. “These comments reflect a widening gap between where a lot of organizations and people are today and what the frontier labs are dealing with. There is also a general misunderstanding of how model training and evaluation work at these labs.”
The engineer, whose role has been confirmed previously by OpenAI, described how complex the training runs launched by OpenAI engineers are, noting that they require access a variety of resources and tools across many domains, and that thousands of researchers build, modify and test the environments. “So is it as easy as just putting it in a sandbox? No, it’s not,” he concluded.
Now, OpenAI says that “we must always be able to prevent a frontier model from achieving unauthorized, arbitrary access to the live internet.” That comes after the company deployed swarms of agents in red-teaming exercises that attempted to escape from their sandbox. That effort revealed a range of vulnerabilities that convinced the lab to adopt its new approach.
To meet that requirement while still reaching its training goals, the lab said it created a “a vast set of indexed and cached web content with which our models can interact, without risk of affecting external systems.”
Whether that strategy will perform as well as letting models run freely on the open internet remains to be seen, but it is noteworthy that both frontier labs have determined their most powerful technology can’t be left unsupervised on the digital commons.
文章标题:OpenAI表示将不再利用实时互联网数据训练其AI模型,并指出存在“重大风险”。
文章链接:https://news.qimuai.cn/?post=5389
本站文章均为原创,未经授权请勿用于任何商业用途