Anthropic 禁止所有客户访问 Fable 5 与 Mythos 5

内容来源:https://www.engadget.com/2193656/anthropic-blocks-access-fable-5-mythos-5/
内容总结:
美国政府以国家安全为由,要求Anthropic暂停两款新AI模型访问权限
当地时间6月12日,美国人工智能公司Anthropic宣布,为遵守美国政府于当日下达的指令,已全面停止所有用户对其最新发布的AI模型“Fable 5”及“Mythos 5”的访问权限。该公司其他模型及Claude聊天机器人未受影响。
据Anthropic声明,美国政府要求其暂停所有外国公民(无论身处美国境内还是境外,甚至包括公司外籍员工)对这两款新模型的访问,理由涉及国家安全关切。尽管政府并未明确说明具体担忧,但Anthropic推测,此举可能与政府获悉一种针对“Fable 5”的“越狱”方法有关。
“Fable 5”于6月9日首次面向公众发布,旨在将此前仅限“Project Glasswing”合作伙伴使用的顶级网络安全模型“Mythos”的多种能力带给更广泛用户。Anthropic称,“Fable 5”的性能“超越”了该公司以往任何一款模型,在测试中甚至成功通关了《宝可梦 火红》,而Claude却未能完成同系列初代游戏《宝可梦 红》的通关。
为确保模型安全性,Anthropic在声明中列举了多项防御措施:包括设置强效防护以“降低Fable被滥用于网络安全相关任务的可能性”,并强调其“防护措施极为严格,以至于许多用户抱怨范围过于宽泛”。该公司同时承认,任何供应商都无法确保完全抵御越狱尝试,每个模型都可能存在针对性漏洞。其防御策略旨在“让越狱手段要么范围狭窄(非通用型越狱),要么生成成本极高(通用型越狱),并通过严密监控快速检测并阻断任何成功攻击”。
美国政府据称向Anthropic提供了关于一个潜在非通用型越狱手段的口头证据,该信息由某未具名实体向官员透露。Anthropic承诺在24小时内公布更多细节,但明确表示,不认为潜在越狱风险应成为召回商业模型的理由。
曾多次呼吁加强AI监管的Anthropic在声明中强调:“我们始终认为,政府应有权阻止不安全的部署,但前提是必须遵循透明、公平、清晰且基于技术事实的法定程序。”该公司直言,“此次行动并未遵循上述原则。”
中文翻译:
Anthropic 已阻止所有客户访问 Fable 5 和 Mythos 5
此举是为了确保遵守一项以国家安全为由的政府指令。
Anthropic 已禁止所有客户访问 Fable 5 和 Mythos 5,以确保遵守其在6月12日(周五)收到的政府命令。该公司所有其他模型及其 Claude 聊天机器人未受影响。公司在公告中表示,美国政府要求其暂停所有外国公民对其新发布 AI 模型的访问权限,无论对方是否在美国境内,甚至包括 Anthropic 员工,并援引了国家安全方面的考量。
尽管美国政府未具体说明这些担忧,但 Anthropic 认为,这是因为政府获悉了一种破解 Fable 5 的方法。该公司于6月9日刚刚推出 Fable AI 模型,该模型旨在将 Mythos 的许多能力带给公众。回顾一下,Mythos 是其最先进的网络安全模型,仅面向 Project Glasswing 合作伙伴提供。Fable 的能力“超越”了 Anthropic 之前发布的任何模型。例如,在公司测试中,它击败了《宝可梦 火红》,而 Claude 未能击败其原型游戏《宝可梦 红》。
Anthropic 在公告中列举了为确保 Fable 安全所采取的措施。公司表示,已建立强大的保障机制,“以降低 Fable 被滥用于网络安全相关任务的可能性”,并补充称,“我们的保障措施非常严格,以至于许多用户抱怨它们过于宽泛”。公司还解释称,任何提供商都无法确保完美抵御破解尝试,每个模型都容易受到专门为其设计的破解攻击。“我们的目标是让破解要么范围狭窄(对于非通用破解而言),要么制作成本高昂(对于通用破解而言),并结合全面监控以快速检测并阻断任何成功的攻击,”公司在阐述其防御策略时表示。
政府显然向公司提供了关于一种潜在、非通用且范围狭窄的破解方法的口头证据,该方法由一个未具名实体分享给官员。Anthropic 承诺在24小时内分享更多细节,但澄清称,公司不认为潜在的破解应当成为召回商业模型的原因。
“正如我们公开声明的那样,我们认为,作为透明、公平、清晰且基于技术事实的法定程序的一部分,政府应有能力阻止不安全的部署,”Anthropic 写道。该公司一直积极警告需要加强 AI 监管。“而这一行动并未遵循这些原则。”
英文来源:
Anthropic blocks all customers' access to Fable 5 and Mythos 5
It's to ensure compliance with a government directive citing national security concerns.
Anthroic has disabled all of its customers' access to Fable 5 and Mythos 5 in order to ensure compliance with an order it received from the government on Friday, June 12. All its other models and its Claude chatbot are not affected. The company said in its announcement that the US government wanted it to suspend all foreign nationals' access to its newly launched AI models, whether they're inside or outside the US and even if they're Anthropic employees, citing national security concerns.
While the US government didn't specify those concerns, Anthropic believes that it's because the government heard about a method of jailbreaking Fable 5. The company has just launched the Fable AI model, which was designed to bring many of Mythos' capabilities to the public, on June 9. If you'll recall, Mythos is its state-of-the-art cybersecurity model that's only available to its Project Glasswing partners. Fable's capabilities "exceed" any previous model Anthropic has launched. It beat Pokémon FireRed during the company's tests, for instance, while Claude failed to beat Pokémon Red, the original game it was based on.
Anthropic listed the measures it took to ensure that Fable was secure in its post. It said it instituted strong safeguards to "reduce the likelihood that Fable is misused for tasks related to cybersecurity" and added that its "safeguards are so strong that many users have complained that they are overly broad." The company also explained that any provider cannot possibly ensure perfect resistance to jailbreak attempts, and every model is vulnerable to jailbreaks made especially for it. "We aimed to make jailbreaks either narrow (in the case of non-universal jailbreaks) or very expensive to produce (in the case of universal jailbreaks), and to combine this with thorough monitoring to quickly detect and shut down any successful attacks," it said about its defense strategy.
The government apparently gave the company verbal evidence for one potential narrow, non-universal jailbreak that an unnamed entity shared with officials. Anthropic promised to share more details over the next 24 hours, but it clarified that it disagrees that a potential jailbreak should be cause for recalling a commercial model.
"As we have stated publicly, we believe the government should have the ability to block unsafe deployments, as part of a statutory process that is transparent, fair, clear, and grounded in technical facts," Anthropic, which has been vocal about its warnings about the need for more AI oversight, wrote. "This action does not adhere to those principles."
文章标题:Anthropic 禁止所有客户访问 Fable 5 与 Mythos 5
文章链接:https://news.qimuai.cn/?post=4343
本站文章均为原创,未经授权请勿用于任何商业用途