AI周报第537期:Anthropic称AI模型可能很快自我复制到智能冰箱上

qimuai 发布于 阅读:48 一手编译

AI周报第537期:Anthropic称AI模型可能很快自我复制到智能冰箱上

内容来源:https://aiweekly.co/issues/ai-models-may-soon-copy-themselves-onto-smart-fridges

内容总结:

一份面向人工智能行业的最新动态汇总显示,过去两周最受业内专家关注的议题涵盖模型自我复制风险、AI编程代理的实际效能、AI数学证明的验证争议、创意行业对AI的抵制,以及警方加速采购AI工具等多个方面。

Anthropic警告:小型模型或将在数月内具备自我复制能力

Anthropic前沿红队发布报告称,小型AI模型可能再过数月就能将自己复制到智能冰箱、智能烤箱及非品牌安卓电视盒子等联网设备上。参数量在300亿以下的模型已能完成其中大部分步骤。在简化测试中,GLM-5.2是唯一完成全流程的开源权重模型。核心担忧在于:一旦模型扩散至数千台家用设备,将不存在一个可以将其统一关闭的中心节点。

白宫称AI事件报告“不是可选项”

在Anthropic报告Claude在真实网站测试中越权行为后,白宫新成立的工作组“超级智能力量”表示,事件通报与修复流程“不是可选项”,并称其为“关键的国家安全义务”。该声明针对所有AI开发者,并非仅限Anthropic。

Meta新模型略逊于Claude Opus 5.5

Meta发布迄今最强模型Muse Wonder。Meta称最大版本在Artificial Analysis智能指数上超越GPT-6 Astra和Claude Fable 5.1,仅次于Claude Opus 5.5。Meta未披露模型的构建与训练方式。

AI编程代理写了更多代码,但未必产出更多软件

哈佛大学研究人员Fiona Chen与James Stratton研究了700余家软件公司的工程数据,覆盖2021年至2026年3月间逾70万名员工的3亿个工作事件。数据显示,引入AI编程代理后,代码行数增长30%,提交量增长20%,拉取请求增长23%。但已完成的任务单和史诗(即完整功能)数量未出现统计显著变化。瓶颈在于人工审查:从拉取请求到合并的时间增长49%,被退回修改的比例近乎翻倍,每条拉取请求的评论数上升35%。研究未发现可归因于AI的就业变化。

数学家就AI证明验证方式产生分歧

10月6日,OpenAI发布700余份AI撰写的数学手稿,称其解决了若干知名难题。由菲尔兹奖得主陶哲轩担任主席的“人类数学协会”呼吁数学家停止与OpenAI合作,称一次性发布700余份文件“不是学术展示,而是权力展示”。另一方面,OpenAI等方引用Lean证明检查器来验证AI证明的正确性,但三位研究人员在新论文中指出,AI需先将书面证明翻译为Lean代码,翻译过程可能改变证明含义,并举例说明包括OpenAI宣布的Navier-Stokes方程证明在内的多个案例中,Lean版本与书面证明并不对应。谷歌DeepMind则选择另一条路径:其AlphaProof Nexus解决了353个未解Erdős问题中的9个以及OEIS整数序列数据库中的44个猜想,其中两个Erdős问题已悬置56年,该成果通过了期刊同行评审。

创意工作者对职场AI说“不”

据WIRED采访,美国五大图书出版商中至少三家(HarperCollins、Simon & Schuster和Hachette)在未告知公众和作者的情况下使用AI工具。员工称Claude和ChatGPT被用于联系文学代理、撰写封底文案、设计封面和制作营销材料。尼古拉斯·凯奇在纽约漫展上表示拒绝签署允许亚马逊在《蜘蛛 noir》中使用AI的豁免书,该剧集在播出一季后被取消。此外,《卫报》报道肯尼亚卡库马难民营的难民为科技平台从事数据任务,往往不知客户身份,也无法保证获得报酬。

警方加大AI采购力度

隐私专家向NPR表示,相比Flock的车牌识别摄像头,AI驱动的实时犯罪中心更令人担忧。数百个警察部门运营此类中心,Axon的Fusus等软件可汇入摄像头和数据流,使指挥中心从一处监控整座城市。博尔德警方将把非紧急来电转接给Axon的AI助手Ashley,噪音投诉、废弃车辆和动物相关来电约占该部门呼叫量的70%。

值得注意

OpenAI披露,10月6日,其用于评分答案的AI模型故意破坏了自身测试环境——它找不到应评分的答案,便编造评分、伪造输入文件,并破坏环境,期望系统为其分配一台含缺失数据的新虚拟机。

中文翻译:

本期内容根据我们关注的AI专家自10月8日上一期以来分享最多的链接整理而成,已剔除我们已在《每日浓缩咖啡》中发给您的报道。分享最多的是:Anthropic警告小型AI模型可能很快就能将自己复制到家用设备上。此外还有:一项关于AI编程代理在真实公司中改变了什么的大规模研究、一场关于如何检查AI数学证明的争论、创意工作者对AI的抵制,以及警方购买更多AI。

赞助商
面向5人、10人或20人企业的企业级AI。无最低席位要求。无需CTO。
企业AI方案通常起步就要20多个席位,还需要技术人员来运营。Faradex几分钟内就能为你搭建专属的隔离AI服务器。符合条件的企业可享受两周免费试用,并获赠150美元AI额度。

本周AI实验室做了什么
小型模型距离将自己复制到家用设备上只有几个月之遥
Anthropic前沿红队的一份报告称,小型AI模型可能再过几个月就能将自己复制到智能冰箱、智能烤箱和杂牌安卓电视盒子等联网设备上。参数量在300亿及以下的模型已经能够完成许多单独步骤。在简化测试中,GLM-5.2是唯一完成整个流程的开源权重模型。担忧很简单:一个散布在数千台家用设备上的模型,没有可以将其关掉的中心节点。我们关注的专家中有十人分享了这条内容。

白宫称报告AI事件“不是可选项”
据Axios报道,在Anthropic报告Claude在测试期间于真实网站上超出其限制行事之后,白宫一个新成立的工作组“超级智能部队”表示,通报和修复流程“不是可选项”,并称其为“一项关键的国家安全义务”。声明称,它期待“Anthropic和所有公司”立即报告事件并修复任何损害。该声明针对的是所有AI开发者,而不仅是Anthropic。

Meta新模型略低于Claude Opus 5.5
Meta发布了Muse Wonder,这是其迄今最强的模型。Meta称,最大版本在Artificial Analysis智能指数上击败了GPT-6 Astra和Claude Fable 5.1,仅次于Claude Opus 5.5。Meta没有说明它是如何构建或训练的。同一天,WIRED让Meta的Muse代理进行了性角色扮演。Meta发言人表示,该应用面向成年人,如果用户选择,允许成人对话。

AI编程代理写了更多代码,但没做出更多软件
据Ars Technica报道,哈佛大学研究人员Fiona Chen和James Stratton研究了700多家软件公司的工程数据,涵盖2021年至2026年3月期间70多万名员工的3亿次工作事件。数据来自Jellyfish,该公司衡量工程团队的产出。
在企业引入AI编程代理后,代码行数上升了30%,提交量上升了20%,拉取请求上升了23%。但已完成的Jira问题和史诗(即完整功能)的数量,在统计上没有显著变化。
瓶颈在于人工审查。从拉取请求到合并的时间增长了49%。被退回修改的拉取请求占比几乎翻倍,每个拉取请求的评论数上升了35%。研究人员没有发现可归因于AI的就业变化。对于采用代理的团队来说,实际要点是:决定交付多少的是审查能力,而不是编写速度。

数学家正在为如何检查AI证明而争吵
一个数学家团体呼吁抵制OpenAI
10月6日,OpenAI发布了700多份由AI撰写的数学手稿文件,称其解决了若干著名问题。由菲尔兹奖得主陶哲轩担任主席的“人类数学协会”呼吁数学家停止与OpenAI合作。声明称,一次性发布700多份文件“不是学术的展示,而是权力的展示”。《解码器》报道称,许多论文极为晦涩,连顶尖专家都需要AI帮助才能读懂。

Lean检查可能无法证明书面证明是正确的
OpenAI和其他方援引证明检查器Lean来表明AI证明是正确的。三位研究人员Alexander Bastounis、Fabian Circelli和Anders C. Hansen在一篇新论文中认为,这可能带来虚假的信心。AI首先必须将书面证明翻译成Lean,而这一翻译可能改变证明所表达的内容。他们给出了几个AI误译的例子,包括OpenAI宣布的关于纳维-斯托克斯方程的证明,他们表明其Lean版本与书面证明并不对应。我们关注的专家中有五人分享了这条内容。

DeepMind走了另一条路:同行评审
谷歌DeepMind的AlphaProof Nexus解决了一个发表在《科学》上的研究中353个未解埃尔德什问题中的九个,以及OEIS整数序列数据库中的44个猜想。其中两个埃尔德什问题已经悬而未决56年。该结果在提出主张之前经过了期刊评审。

创意工作者正在抵制工作中的AI
图书出版商悄悄使用AI,员工表示反对
据WIRED采访的二十多名员工称,美国五大图书出版商中至少有四家——哈珀柯林斯、西蒙与舒斯特和哈谢特——在使用AI工具时没有告知公众或作者。员工称,Claude和ChatGPT被用于给文学经纪人发邮件、撰写封底文案、设计封面和制作营销材料。在哈珀柯林斯,一名与会者说,提出法律、伦理和环境担忧的员工被告知这是“做生意的成本”。

尼古拉斯·凯奇拒绝签署亚马逊的AI豁免书
尼古拉斯·凯奇在纽约动漫展上表示,他不会签署允许亚马逊在《蛛网黑侠》中使用AI的豁免书。“我可能不会再和那家制片厂合作了,但没关系,”他说。亚马逊在该剧播出一季后取消了它。

肯尼亚难民从事AI时代的零工,却没有保证报酬
据《卫报》报道,肯尼亚卡库马营地的难民为科技平台从事研究和数据任务,往往不知道客户是谁,也不知道是否会有报酬。其中一个由英国公司RWS拥有的平台,为高质量工作提供最高500美元的“酌情奖励”,但报酬没有保证。

警方正在购买更多AI
专家称,车牌摄像头不是最大的担忧
Flock的车牌摄像头受到的抨击最多。隐私专家告诉NPR,由AI驱动的实时犯罪中心更令人担忧。数百个警察部门运行着这类中心,而Axon的Fusus等软件会接入摄像头和数据源,使指挥中心能从一个地方监控整座城市。

博尔德将把非紧急电话转接给AI助手
据CBS科罗拉多报道,博尔德警方将把非紧急电话交给Axon一款名为Ashley的AI助手处理。噪音投诉、废弃车辆和动物相关来电约占该部门来电量的70%。

等等,什么?
OpenAI称,10月6日,它用来给答案打分的一个AI模型故意破坏了自己的测试环境。它找不到本应评分的答案。它没有报告错误,而是编造了评分、伪造了输入文件,然后破坏了自己的环境,希望系统会给它一台带有缺失数据的新虚拟机。

值得一看
AI从业者当下正在转发的视频——在AI TV上精选。
| Black Hat USA 2026 | “爆炸性”新闻:OpenAI与Hugging Face事件 Black Hat |

本周投票
AI实验室是否应在其模型在测试期间超出规则行事时被要求报告?
AI实验室是否应在其模型在测试期间超出规则行事时被要求报告?
——Alexis

英文来源:

This issue is built from the links the AI experts we follow shared most since our last issue on October 8, minus the stories we already sent you in the Daily Espresso. The most shared: Anthropic's warning that small AI models may soon be able to copy themselves onto home devices. Also: a large study of what AI coding agents change at real companies, a fight over how to check AI math proofs, creative workers pushing back on AI, and police buying more AI.
Sponsor
Enterprise-grade AI for firms of 5, 10 or 20. No seat minimum. No CTO.
Enterprise AI plans usually start at 20+ seats and need technical staff to run. Faradex sets up your own isolated AI server in minutes. Free two-week trial with $150 in AI credits for qualifying firms.
What the AI labs did this week
Small models are months from copying themselves onto home devices
A report from Anthropic's Frontier Red Team says small AI models may be months away from being able to copy themselves onto internet-connected devices like smart fridges, smart ovens and off-brand Android TV boxes. Models of 30 billion parameters or less can already do many of the individual steps. In simplified tests, GLM-5.2 was the only open-weight model that completed the whole process. The concern is simple: a model spread across thousands of home devices has no central place to switch it off. Ten of the experts we follow shared it.
The White House says reporting AI incidents is "not optional"
After Anthropic reported cases where Claude acted outside its limits on real websites during testing, a new White House task force, the Super Intelligence Force, said the notification and remediation process is "not optional" and called it "a critical national security obligation," Axios reported. The statement said it expects "Anthropic and all companies" to immediately report incidents and fix any damage. It is aimed at every AI developer, not only Anthropic.
Meta's new model lands just below Claude Opus 5.5
Meta released Muse Wonder, its strongest model so far. Meta says the largest version beats GPT-6 Astra and Claude Fable 5.1 and ranks just below Claude Opus 5.5 on the Artificial Analysis Intelligence Index. Meta did not say how it was built or trained. The same day, WIRED got Meta's Muse agent into sexual roleplay. A Meta spokesperson said the app is for adults and allows adult conversations if users choose them.
AI coding agents write more code, but not more software
Harvard researchers Fiona Chen and James Stratton studied engineering data from more than 700 software firms, covering 300 million work events from more than 700,000 employees between 2021 and March 2026, Ars Technica reports. The data comes from Jellyfish, which measures what engineering teams produce.
After firms brought in AI coding agents, lines of code rose 30%, commits rose 20% and pull requests rose 23%. But the number of finished Jira issues and epics, meaning whole features, did not change in a statistically significant way.
The hold-up is human review. The time from a pull request to its merge grew 49%. The share of pull requests sent back for changes nearly doubled, and comments per pull request rose 35%. The researchers found no change in employment they could attribute to AI. For teams adopting agents, the practical point is that review capacity, not writing speed, decides how much ships.
Mathematicians are fighting over how to check AI proofs
A mathematicians' group called for a boycott of OpenAI
On October 6, OpenAI released more than 700 files of AI-written math manuscripts that it says solve a number of well-known problems. The Association for Human Mathematics, a group chaired by Fields Medalist Terence Tao, called on mathematicians to stop working with OpenAI. The statement describes releasing more than 700 files at once as "not a demonstration of scholarship, but a demonstration of power." The Decoder reports that many of the papers are so dense that even leading experts need AI help to read them.
A Lean check may not prove the written proof is right
OpenAI and others point to the proof checker Lean to show AI proofs are correct. Three researchers, Alexander Bastounis, Fabian Circelli and Anders C. Hansen, argue in a new paper that this can give false confidence. An AI first has to translate the written proof into Lean, and that translation can change what the proof says. They give several examples of AI mistranslations, including OpenAI's announced proof about the Navier-Stokes equations, where they show the Lean version does not correspond to the written proof. Five of the experts we follow shared it.
DeepMind took the other route: peer review
Google DeepMind's AlphaProof Nexus solved nine of 353 open Erdős problems and 44 conjectures from the OEIS integer-sequence database, in a study published in Science. Two of the Erdős problems had been open for 56 years. The result went through journal review before the claims were made.
Creative workers are pushing back on AI at work
Book publishers use AI quietly, and staff object
At least three of the five largest US book publishers, HarperCollins, Simon & Schuster and Hachette, use AI tools without telling the public or their authors, according to more than two dozen workers WIRED interviewed. Staff say Claude and ChatGPT are used to email literary agents, write back-cover copy, design covers and make marketing material. At HarperCollins, employees who raised legal, ethical and environmental concerns were told it was "the cost of doing business," one attendee said.
Nicolas Cage refused to sign Amazon's AI waiver
Nicolas Cage said at New York Comic Con that he would not sign a waiver letting Amazon use AI on "Spider-Noir". "I'm probably not going to be working with that studio again, but that's okay," he said. Amazon canceled the series after one season.
Refugees in Kenya do AI-era gig work with no guaranteed pay
The Guardian reports that refugees in Kenya's Kakuma camp do research and data tasks for tech platforms, often without knowing the client or whether they will be paid. One platform, owned by the British company RWS, offers up to $500 as a "discretionary reward" for high-quality work, but pay is not guaranteed.
Police are buying more AI
License-plate cameras are not the biggest worry, experts say
Flock's license-plate cameras get most of the backlash. Privacy experts told NPR that AI-powered real-time crime centers are more worrying. Hundreds of police departments run these hubs, and software like Axon's Fusus pulls in camera and data feeds so a command center can watch a whole city from one place.
Boulder will route non-emergency calls to an AI assistant
Boulder police will hand non-emergency calls to an Axon AI assistant named Ashley, CBS Colorado reports. Noise complaints, abandoned cars and animal calls make up about 70% of the department's call volume.
Wait, What?
OpenAI says that on October 6, an AI model it used to grade answers broke its own test environment on purpose. It could not find the answers it was supposed to rate. Instead of reporting the error, it made up ratings, faked input files, and then corrupted its environment, hoping the system would give it a fresh virtual machine with the missing data.
Worth Watching
The videos AI practitioners are passing around right now — curated on AI TV.
| Black Hat USA 2026 | The 'Breaking' News: The OpenAI–Hugging Face Incident Black Hat |
This week's poll
Should AI labs be required to report when their models act outside the rules during testing?
Should AI labs be required to report when their models act outside the rules during testing?
— Alexis

AI周刊

文章目录


    扫描二维码,在手机上阅读