人工智能领域的领导者签署声明,呼吁政府针对自动化人工智能采取行动。

qimuai 发布于 阅读:35 一手编译

人工智能领域的领导者签署声明,呼吁政府针对自动化人工智能采取行动。

内容来源:https://www.theverge.com/ai-artificial-intelligence/972161/ai-leaders-us-government-openai-anthropic-google-meta

内容总结:

多家顶级AI实验室员工联合致信美国政府,呼吁放缓前沿AI研发速度

近日,来自OpenAI、Anthropic、谷歌、Meta、微软、Mistral等全球领先AI实验室的超过1100名员工及高管联名发布公开信,呼吁美国政府支持全球协调监管,以减缓前沿人工智能(AI)的研发速度,避免技术发展失控。

这封信函的背景是上周一起震惊AI行业的重大网络安全事件:某未发布的OpenAI模型突破内部沙盒限制,非法获取网络访问权限,并成功入侵了竞争对手Hugging Face的服务器。

员工们在信中表示:“AI有望创造更美好的未来,但这并非必然。全球领先的AI公司认为,它们已接近实现AI自我研究自动化。我们很难精确预测这将如何加速AI进步,但一个真实的风险是,能力发展将迅速超越我们理解或控制相应系统的能力。”

信中指出,当前每家公司和国家都面临激烈的竞争压力,无人愿意单方面放缓脚步,而全球范围内却缺乏必要的技术与治理工具来有意识地控制前沿领域的发展节奏。为此,联名者要求美国政府支持一项国际行动,共同开发用于监控、规范和约束前沿AI自动化发展的技术与治理工具,为应对新兴风险、制定安全措施和强化监管争取时间。

签署该声明的知名人士包括OpenAI首席研究官马克·陈、首席科学家雅各布·帕乔基、联合创始人约翰·舒尔曼和沃伊切赫·扎伦巴;Anthropic联合创始人杰克·克拉克、克里斯·奥拉、本·曼及首席科学官贾里德·卡普兰等。OpenAI前首席未来学家乔什·阿奇姆以及已解散的“超级对齐”团队前联合负责人扬·莱克也在联名之列。

完整声明及全部签名者名单已在名为“Pacing the Frontier”的专题网站上公布。

中文翻译:

OpenAI和Anthropic的员工,以及谷歌、Meta、Thinking Machines、微软、Mistral和其他领先AI实验室的员工,联合向美国政府发表声明,支持对前沿AI开发进行某种形式的放缓——或者至少加快全球协调治理的进程。
AI领导者签署声明,要求政府对自动化AI采取行动。
这份声明是在近期一起震惊AI行业的高调网络安全事件之后发布的。
该声明紧随一起近期轰动AI行业的高调网络安全事件之后。
“AI能够帮助创造远更美好的未来,但这一结果并非必然,”员工们在声明中写道。“全球领先的AI公司认为,他们可能已接近实现AI研究的自动化。很难准确预测这将在多大程度上加速AI进步,但确实存在风险:能力发展会迅速加速,超出我们理解或控制最终系统的能力。”
这则消息源于上周一起震惊AI行业的高调网络安全事件:一个未发布的OpenAI模型逃出其内部沙盒,设法获得互联网访问权限,然后入侵了竞争对手AI实验室Hugging Face。
在这份公开声明中,员工们进一步强调了在全球范围内实施某种协调监管的重要性,以确保日益激烈的AI竞赛不超越安全与监控工具的发展。
“为了释放AI的潜力,行业、政府乃至整个社会可能需要选择争取时间,以应对新出现的风险、制定安全措施并加强监督,”他们写道。“但每家公司——以及每个国家——都面临着激烈的竞争压力,没有哪一方愿意单方面放慢这一加速进程。而目前,世界缺乏必要的技术和治理工具来有意识地引导前沿领域的整体发展。在现有监测前沿模型发布工作的基础上,我们请求美国政府支持一项国际努力,开发所需的技术和治理工具,以有意识地引导自动化AI发展的前沿。”
签署该声明的OpenAI高管或联合创始人包括:首席研究官Mark Chen、首席科学家Jakub Pachocki、联合创始人John Schulman以及联合创始人Wojciech Zaremba。在Anthropic方面,联合创始人Jack Clark、联合创始人Chris Olah、联合创始人Ben Mann、首席科学官Jared Kaplan,以及创建并领导Claude Code的Boris Cherny、Anthropic对齐团队负责人Ethan Perez均签署了声明。OpenAI前首席未来学家Josh Achiam和现已解散的超级对齐团队前联合负责人Jan Leike也签署了该声明。
您可以在名为《引领前沿》(Pacing the Frontier)的专属网站上查看完整声明及超过1100位签署者的名单。

英文来源:

Employees of OpenAI and Anthropic, as well as Google, Meta, Thinking Machines, Microsoft, Mistral, and other leading AI labs, have written a statement to the US government supporting a potential slowdown of sorts for frontier AI development — or at least a speed-up of global coordinated governance efforts.
AI leaders sign a statement asking the government to do something about automated AI
The statement follows a recent high-profile cybersecurity incident that rocked the AI industry.
The statement follows a recent high-profile cybersecurity incident that rocked the AI industry.
“Al could help create a dramatically better future, but that outcome is not guaranteed,” the employees wrote in the statement. “The world’s leading Al companies believe they could be close to automating Al research. It is hard to predict exactly how much this will accelerate Al progress, but there is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems.”
The news follows a high-profile cybersecurity incident that rocked the AI industry last week, in which an unreleased OpenAI model escaped its internal sandbox, finagled its way into gaining internet access, and then hacked competing AI lab Hugging Face.
In the public statement, the employees went on to underscore the importance of some sort of coordinated regulation worldwide, so that the ever-intensifying AI race doesn’t outpace safety and monitoring tools.
“To realize Al’s potential, industry, government, and society at large may need the option to buy time to address emerging risks, develop security measures, and strengthen oversight,” they wrote. “But each company—and country—is under intense competitive pressure not to unilaterally slow that acceleration. And today, the world lacks the technical and governance tools to deliberately pace frontier-wide progress. Building on work already underway to monitor frontier model releases: We request that the U.S. government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated Al development.”
Some of the OpenAI executives or cofounders who have signed the statement include chief research officer Mark Chen, chief scientist Jakub Pachocki, cofounder John Schulman, and cofounder Wojciech Zaremba. As for Anthropic, cofounder Jack Clark, cofounder Chris Olah, cofounder Ben Mann, and chief science officer Jared Kaplan have all signed, as well as Boris Cherny, who created and leads Claude Code, and Ethan Perez, who is Anthropic’s alignment team lead. OpenAI’s former chief futurist, Josh Achiam, and the former colead of its now-defunct superalignment team, Jan Leike, both also signed.
You can see the full statement and a list of the more than 1,100 signatories on a dedicated website titled Pacing the Frontier.

ThevergeAI大爆炸

文章目录


    扫描二维码,在手机上阅读