我在Meta之前就做了一个AI电子宠物

内容来源:https://www.theverge.com/gadgets/1013375/muse-charm-gadgets-preview-waveshare-esp32-claude-vibe-code
内容总结:
科技媒体The Verge记者近日分享了一项有趣的DIY实验:他用50美元从中国采购了一款Waveshare ESP32-S3 1.75C触摸屏开发套件,将其改造成了一款功能可定制的AI掌上设备,以此在Meta正式发售Muse Charm之前,抢先体验了“AI电子宠物”的概念。
据悉,这款开发套件外观酷似Meta即将推出的Muse Charm智能吊坠,且获得了Meta官方认可——它是Meta推荐用于开发“Muse Gadget”的设备之一,可借助Meta开源代码和令牌直接连接其Muse AI云端服务。
不过,记者表示,设备初始体验并不理想:Muse语音回复迟缓、无法外放朗读、屏幕仅显示零星几个词,且仅内置一个静态虚拟形象,也无法自动发现智能家居设备。随后,他借助AI编程助手Claude Code对设备进行重新编程,几乎填补了所有功能缺陷——包括添加对话历史页面、接入ElevenLabs的英式AI语音实现朗读、增加蓝牙低画质相机预览、设计多款虚拟形象及类似电子宠物的喂养互动小游戏,甚至制作了可正常走时的怀表表盘和视频播放器。
记者坦言自己并无编程经验,无法判断代码质量,同时对Meta及其Muse智能体的隐私安全性存有顾虑——此前有评测者曝出家庭住址被泄露的事件,因此他全程将设备置于访客Wi-Fi网络下使用。
他认为,这款设备真正的价值不在于Muse功能本身——其AI能力并不比手机更强——而在于硬件可被自由编程,实现手机无法完成的操作。这也引发了他的疑问:即将正式发售的Muse Charm是否同样支持如此自由的编程?愿意购买这类设备的用户,是否直接选择开发套件更为划算?答案可能要等到产品正式发货后才能揭晓。
中文翻译:
马克·扎克伯格的Meta让人工智能看起来萌得不行——给它安了一张软乎乎的小脸——而这个假日季,他想卖你一个Muse Charm,让你能像随身带着电子宠物一样,把这位乐呵呵的AI小助手揣在身上。
Meta还没做出来,我就先自己造了一个AI电子宠物
我家里已经有Muse Charm了。
Meta还没做出来,我就先自己造了一个AI电子宠物
我家里已经有Muse Charm了。
但我不会去买一个,因为我家里已经有Muse Charm了。它只花了50美元,而我觉得这番学习体验值这个价。
我这个版本没有摄像头,也没有5G蜂窝无线电,但它真的能和Muse对话,还有可爱的虚拟形象!它还能兼作怀表和远程相机取景器,并且(理论上)能控制我的智能家居。
或者说,至少在你注入大量额外的“氛围代码”之后可以。
几周前,我花了50美元,从中国直邮购得一台1.75英寸触摸屏电脑吊坠——具体型号是Waveshare ESP32-S3 1.75C。这款按键通话的AI开发套件不仅外观和Muse Charm很像,而且还得到了Meta的官方认可。如果你想打造一个“Muse Gadget”——一种使用Meta开源代码和token直接连接其Muse AI云端的设备——这是Meta最先推荐的选择之一。
这块银色金属怀表到手时,一开始感觉挺没用的。设置倒是挺简单——我只要把它插到电脑上,让Claude去读Meta的GitHub页面,然后把它和Muse手机应用配对就行。但即便我把Meta的密钥装进了设备,Muse一开始还以为我发给它的是要转录的音频片段,而不是指令。等我把这一点弄清楚之后,Muse的回复依然很慢,而且它不会出声回答我。很难搞清楚它在说什么,因为屏幕上一次只显示几个词,除非我掏出装了Muse应用的手机,否则根本没地方读完整消息。
Meta的版本还只自带一个Jolly虚拟形象,大部分时间就是待在那儿卖萌,而且它不会像Amazon Echo或Google Home设备那样自动发现智能家居设备。(在我最初安装完之后,这个小玩意儿真的没干成什么有用的事。)而且,虽然Meta AI软件工程师Anant Narayanan和Jeremy Payne附带了一个很不错的示例应用,展示Muse Gadget如何从手机摄像头串流视频,但缺少远程快门按钮,让它拍起照来不太实用。
但几轮Claude Code下来,几乎把这些坑全填上了。我只需要把Waveshare重新插回电脑,然后让Claude重新编程我想改的每一项。
当我向Claude抱怨,我无法正常阅读或听到Muse对我提问的回复——其他人也提到过这个问题——Claude就做了一个对话历史页面,让我可以向右滑动查看它说了什么,我还接入了ElevenLabs的一个英国AI语音,让它把回答念出来。(我和我妻子都同意,这个声音是ElevenLabs免费档里最不让人灵魂枯萎的一个,尽管它和Muse虚拟形象那种软萌气质完全不搭。)
多亏了Claude,我现在按一个按钮,就能让房间另一头的手机拍照,并带高质量实时预览,而且手机前置摄像头也不再上下颠倒了。Claude还相当快地搞定了通过蓝牙添加低质量摄像头预览,这样我不用连家里Wi-Fi,也能从各种刁钻角度拍照。
我让Claude做了一整批不同的虚拟形象,就像Meta在Meta Connect上展示的那样,还加了一个类似电子宠物的迷你游戏,它们需要吃饭、玩耍、睡觉和洗澡。当这个游戏看起来太简单、根本抓不住注意力时,我让它加入了四个不同等级的饥饿、无聊和脏污状态。我决定零食应该吃得咔嚓作响、弄得一团糟,而且虚拟形象吃完后会变得更脏;玩得太多则会让宠物疲劳。我的愿望就是Claude的命令。
当我发现自己不小心太早松开按键通话按钮,害得Muse被几乎空白的音频卡住时,氛围编程几分钟就修好了——只发送长度超过一秒的音频。现在我能看到的唯一明显延迟来自Meta自己的服务器——有时响应很快,有时卡得相当厉害。
让Claude重新编程这块吊坠实在太容易了,于是我让它专门为这篇报道里的视频做了几个功能,包括一个能真正显示时间的三针怀表表盘。(这花了它15分钟;现在我说这硬件看起来像怀表时,你就能明白我什么意思了!)它甚至找到、下载、剪辑并加载了扎克伯格介绍Muse Charm的视频片段,还装了一个视频播放器,让我能在Waveshare上播放这些片段。
我想让你明白,我没有任何编程经验,所以我完全不知道这些代码好不好。它可能有致命缺陷。我也不信任Meta或它的Muse智能体来处理我的电子邮件或家庭网络,尤其是在听说它泄露了一位评测者的家庭住址之后。(我一开始就把它放在访客Wi-Fi上以防万一。)
这意味着,对于那些真懂编程、也愿意更大胆地信任它的人来说,Muse Charm到底有多大用处,我其实并不知道。但在差点把这块笨重的小银色吊坠摔了好几次之后——它的Muse功能并不比我的手机多(如果不加额外代码,还少得多)——我觉得Muse本身并不是购买一块专用计算怀表的理由。
拥有一块专用硬件的理由,是去做你口袋里手机做不到的事,比如把整个小玩意儿编程成你想让它做的任何样子。这让我不禁想问:真正的Muse Charm会不会也这样自由可编程?还是说,会买它的人不如直接买个开发套件?我想等它发货时就知道了。
最热门
- 萨姆·奥尔特曼说,RAM放在数据中心比放在你桌上更好
- Apple Pencil让Duo成了我新宠的笔记本
- 萨姆·奥尔特曼同情数学家,但表示OpenAI的数学攻势不会停
- Meta还没做出来,我就先自己造了一个AI电子宠物
- HomeView和Echo Show 16可能就是我一直在要的家庭电脑
英文来源:
Mark Zuckerberg’s Meta made AI look so stinking cute by giving it a squishy little face — and this holiday season, he wants to sell you a Muse Charm so you can carry your jolly AI helper around like a Tamagotchi.
I built an AI Tamagotchi before Meta could
We have Muse Charm at home.
I built an AI Tamagotchi before Meta could
We have Muse Charm at home.
But I won’t be buying one, because we have Muse Charm at home. It cost just $50, and I’ve decided the learning experience was worth it.
My version doesn’t sport cameras or a 5G cellular radio, but it really talks to Muse and has cute avatars, too! It doubles as a pocket watch and a remote camera viewfinder, and it can (theoretically) control my smart home.
Or at least it can if you inject a lot of extra vibe code.
Weeks ago, I paid $50 to get a 1.75-inch touchscreen computer pendant drop-shipped from China — specifically the Waveshare ESP32-S3 1.75C. Not only does the push-to-talk AI devkit look a lot like the Muse Charm, but it’s officially sanctioned by Meta. It’s one of the company’s first suggestions if you want to build a “Muse Gadget,” a device that uses Meta’s open-source code and tokens to directly connect to its Muse AI cloud.
When the silver metal pocket watch arrived, it felt pretty useless to start. Setup was easy enough — I just plugged it into my PC and pointed Claude at Meta’s GitHub, then paired it to the Muse phone app. But even after I put Meta’s keys on the device, Muse originally thought I was sending it audio clips to transcribe rather than commands. After I cleared that up, Muse’s responses were still slow, and it didn’t answer me out loud. It was hard to tell what it was saying since it only showed a few words onscreen at a time, with no place to read full messages unless I whipped out my phone with its own Muse app.
Meta’s build also only came with a single Jolly avatar that mostly just sat there and looked cute, and it wouldn’t automatically discover smart home gadgets like Amazon Echo or Google Home devices do. (This gadget really didn’t do anything useful after my initial install.) And though Meta AI software engineers Anant Narayanan and Jeremy Payne include a neat sample app showing how Muse Gadgets can stream video from your phone camera, the lack of a remote shutter button made it not so useful for taking photos.
But a few sessions of Claude Code filled in almost all those holes. All I had to do was plug the Waveshare back into my PC, then ask Claude to reprogram each thing I wanted.
When I complained to Claude that I couldn’t properly read or hear Muse’s replies to my asks, issues that others have mentioned as well, Claude built a conversation history page so I can swipe right to read what it said, and I plugged in a British AI voice from ElevenLabs that speaks its answers out loud. (The voice was the least soul-sucking of the ones in ElevenLabs’ free tier, my wife and I agree, even if it doesn’t match the Muse avatars’ cuddly vibe at all.)
Thanks to Claude, I can now press a button to make my phone take a picture from across the room with a high-quality live preview, and my phone’s front-facing camera no longer displays upside down. Claude made fairly short work of adding a low-quality camera preview over Bluetooth, too, so I don’t need to be on home Wi-Fi to get photos from creative angles.
I asked Claude to make a whole batch of different avatars like the ones Meta showed off during Meta Connect, and to add a Tamagotchi-like minigame where they need food, play, sleep, and a bath. When the game seemed too simple to capture any attention, I had it add four different levels of hunger, boredom, and dirt. I decided treats should make a crunchy mess and get avatars dirtier when they eat them, and that too much play should tire out a pet. My wish was Claude’s command.
When I noticed I was accidentally letting go of the push-to-talk button too soon and making Muse choke on almost-empty audio, vibe coding fixed it minutes later by sending only audio over one second in length. The only obvious lag I’m seeing now is from Meta’s own servers — sometimes they’re responsive, sometimes they lag quite a bit.
It was so easy to let Claude reprogram the pendant that I asked it to build a few features specifically for this video in this story, including a working pocket watch face with three hands that actually tells the time. (That took it 15 minutes; now, when I say the hardware looks like a pocket watch, you can see what I mean!) It even found, downloaded, trimmed, and loaded video clips of Zuck introducing the Muse Charm and installed a video player so I could play those clips on the Waveshare.
I want you to understand I have no coding experience, and so I have no idea if any of this code is good. It might be fatally flawed. Nor do I trust Meta or its Muse agent with my email or my home network, particularly after hearing how it leaked one reviewer’s home address. (I put it on guest Wi-Fi from the get-go as a precaution.)
That means I don’t really know how useful a Muse Charm may or may not be for those who do know how to code and are willing to take a bigger leap of faith. But after nearly dropping a bulky little silver pendant a couple of times, one with no more Muse functionality than my phone (and quite a bit less without additional code), I’m thinking Muse itself isn’t the reason to buy a dedicated compute pocket watch.
The reason to have a dedicated piece of hardware is to do things you can’t do on the phone that’s already in your pocket, like coding the entire gadget to do whatever you want. Which makes me wonder: Will the actual Muse Charm be this freely programmable, or would the kind of people who’d buy one be better off with a development kit? I guess we’ll see when it ships.
Most Popular
- Sam Altman says it’s better for RAM to be in a data center than on your desk
- The Apple Pencil turned the Duo into my new favorite notebook
- Sam Altman sympathizes with mathematicians, but says OpenAI’s math onslaught won’t stop
- I built an AI Tamagotchi before Meta could
- The HomeView and Echo Show 16 could be the family computers I’ve been asking for