纽约查封十余个名人深度伪造网站

内容来源:https://www.wired.com/story/new-york-seizes-a-dozen-celebrity-deepfake-websites/
内容总结:
纽约曼哈顿地区检察官办公室近日宣布,已查封12个传播深度伪造色情内容的网站域名。这些网站长期发布未经当事人同意的虚假色情视频,受害者超过1200人,绝大多数为女性,其中包括知名演员、政界人士、社会活动家、运动员、音乐人及社交媒体网红等公众人物。
检察官阿尔文·布拉格在声明中表示,此类侵犯隐私的行为会持续影响受害者的职业生涯和个人生活,对其心理健康造成巨大伤害。他呼吁潜在受害者联系该办公室的网络犯罪部门。目前,对网站运营者及视频上传者的调查仍在进行中。
此次查封行动依据纽约州刑事诉讼法执行,被认为是自2017年底深度伪造技术出现以来,针对此类网站规模最大的执法行动之一。随着人工智能技术不断进步,一个由网站、应用程序和机器人组成的灰色产业链已经形成,专门用于“脱去”女性照片中的衣物或生成包含女性的露骨色情视频,且内容日益逼真,数秒内即可生成。
虽然深度伪造技术广泛被用于侵害普通女性和女孩——相关内容常在私密社交媒体群组中传播——但名人也纷纷发声,讲述被伪造色情内容所带来的种种伤害以及删除这些内容的困难。尽管针对深度伪造的立法进展缓慢,但美国《下架法案》正逐步赋予删除此类图像的途径,其中部分条款允许执法官员查封和关停相关网站。
曼哈顿地区检察官办公室尚未公开被查封网站的具体名称。但在此次宣布之前,有媒体独立观察到多个网站主页在上周晚些时候被替换为“此域名已被查封”的通知,网站页面显示,依据纽约州最高法院签发的查封令,这些网站已被接管。
战略对话研究所研究员莱奥妮·厄米希长期研究深度伪造创作生态。她表示,此次查封是打击“合成未经同意的私密影像”的重要胜利,表明即便各司法管辖区法规尚不统一,协调一致的有效执法仍可实现。她还指出,尝试通过VPN从其他地区访问这些网站似乎也已不可行。
这些网站可能曾被浏览数百万次,许多网站名称中包含“名人性爱”等字样,或承诺提供“真实深度伪造”内容。网站上存有大量全球知名人士的虚假视频,其中一个网站声称“使用多位女演员的面部制作深度伪造内容”。视频时长可达数分钟,包含完全露骨的色情场景,通常是将名人或公众人物的面部替换到现有色情视频中。网站存档版本显示,部分视频被观看数万次,其中一个网站自称自2018年起便已上线。
美国阳光项目非营利组织首席研究员本杰明·舒尔茨表示,大多数视频以真实色情影片为模板,将原演员的面部替换为受害者面部。他在研究政治人物遭深度伪造侵害的过程中接触过部分被查封网站,发现许多视频疑似转载自臭名昭著的深度伪造平台MrDeepFakes,该平台在运营者被记者曝光后已下线。舒尔茨还指出,至少有两个被查封网站为当选官员建立了包含姓名和职务的个人页面,并附有伪造视频合集。他近期的研究发现,共有56名欧洲政治人物在这些网站上被提及或出现,其中包括16名美国政治人物和2名英国政治人物。
战略对话研究所研究员厄米希表示,尽管此次查封令人鼓舞,但深度伪造产业中仍有许多环节在造成严重危害。她认为,有效干预需要从多个节点入手,包括合成私密影像的创作工具、内容的发现与推广渠道、维持网站运营的托管和技术基础设施,以及使运营者得以变现的支付和联盟系统。
中文翻译:
近十年来,滥用深度伪造的“色情”网站发布了数千条未经当事人同意的视频,将女性——包括知名名人、政客和公众人物——置于性场景之中。如今,纽约官员查封了十多个此类有害网站,这很可能是迄今为止针对露骨深度伪造网站规模最大的一次打击行动。
周一,曼哈顿地区检察官办公室宣布查封了12个域名,称这些域名被用于“非法”分享、发布和销售名人深度伪造视频。该办公室表示,这些网站上约有1200人——绝大多数为女性——被以未经同意的性图像和视频形式呈现。其中包括社交媒体网红、演员、活动人士、运动员、音乐人和政客。
“这些可怕的隐私侵犯会跟随受害者进入她们的职业生涯和个人生活,对情感和心理健康造成巨大伤害,”地区检察官阿尔文·布拉格在一份声明中表示,并敦促潜在受害者站出来联系其办公室的网络犯罪部门。该办公室表示,对网站责任方以及上传受害者有害视频者的调查仍在进行中。
此次查封依据纽约州刑事诉讼法执行,可能是自2017年底深度伪造技术首次出现以来,针对托管露骨深度伪造视频网站最具意义、覆盖面最广的行动之一。随着人工智能技术的进步,一个由网站、应用程序和机器人组成的暗黑产业已经出现:它们旨在“脱去”女性照片中的衣物,或制作包含女性的露骨性视频。这些图像和视频越来越逼真,且可以在几秒钟内生成。
虽然深度伪造技术被广泛用于针对非知名女性和女孩——通常在私密社交媒体群组中传播——但名人们也公开谈论过被制作成此类内容所遭受的种种伤害,以及删除这些内容的困难。尽管针对深度伪造的法律出台缓慢,但美国的《下架法案》正越来越多地允许删除此类图像,其中部分条款允许执法官员关闭并查封网站。
曼哈顿地区检察官办公室尚未公开点名其查封的网站。然而,在布拉格宣布之前,WIRED独立观察到其中几个网站的首页在上周末被替换为下架通知——“此域名已被查封”——这些网站现在表示,它们已根据纽约州最高法院签发的查封令被接管。
“这些下架行动是打击合成未经同意的私密影像(NCII)斗争中的重大胜利,”战略对话研究所(ISD)研究员莱奥妮·厄米格表示,她研究过深度伪造创作生态系统。厄米格说,州法律的执行表明有害内容是可以被遏制的,而且如果使用VPN尝试从其他地点访问这些被查封的网站,似乎也无法访问。“这表明,即使在监管本身仍然跨司法管辖区碎片化的情况下,有意义的协调执法也是可以实现的。”
这些网站很可能被浏览了数百万次。许多网站使用的名称包含“性感名人”等短语,或承诺提供“真实的深度伪造”。它们托管了世界上一些最著名名人的虚假视频,其中一个网站称“多位女演员的面孔被用于深度伪造”。
视频时长可达数分钟,包含完全露骨的性场景——通常是将名人或公众人物的面孔替换到现有的色情视频中。这些网站的存档版本显示,部分视频已被观看数万次,其中一个网站声称自2018年起就已上线。
“大多数视频的形式是实际的色情电影,经过篡改后展示的是目标人物的面孔,而非原演员的面孔,”非营利组织美国阳光项目首席研究员本杰明·舒尔茨说。舒尔茨一直在记录针对政治人物的深度伪造滥用行为,并在研究过程中遇到过其中一些网站。他说,许多视频似乎是从MrDeepFakes网站转载的内容,该网站是一个臭名昭著的深度伪造平台,在其创建者被记者揭露身份后已下线。
“至少在两个被查封的网站上,民选官员被建立了包含其姓名和职务的个人资料页面,旁边是一格一格托管其肖像的篡改视频,”舒尔茨说。通过最近的研究,舒尔茨表示有56名欧洲政客被提及或出现在这些网站上,其中包括16名美国政客和两名英国政客。
虽然ISD研究员厄米格表示这些下架行动令人鼓舞,但深度伪造产业中还有许多其他环节正在造成严重伤害。“有效的干预需要针对生态系统的多个节点,包括用于创建合成NCII的工具、这些内容的发现和推广、维持其在线运行的托管和技术基础设施,以及使运营者能够从中获利的支付和联盟系统,”厄米格说。
评论
回到顶部
英文来源:
For the best part of a decade, abusive deepfake “pornography” websites have published thousands of nonconsensual videos depicting women, including high-profile celebrities, politicians, and public figures, into sexual situations. Now, in what is likely the largest takedown of explicit deepfake websites to date, officials in New York have seized more than a dozen of the harmful sites.
On Monday, the Manhattan District Attorney’s Office announced the seizure of 12 domains which it says have been used for “unlawfully” sharing, publishing, and selling celebrity deepfake videos. Around 1,200 people—overwhelmingly women—were depicted in nonconsensual sexual images and videos on the websites, the office says. These included social media influencers, actors, activists, athletes, musicians, and politicians.
“These horrific violations of privacy follow victims into their careers and personal lives and take an immense toll on emotional and mental well-being,” district attorney Alvin Bragg said in a statement, urging potential victims to come forward and contact his office’s cybercrime bureau. The office says its investigations into who is responsible for the websites, plus those who uploaded damaging videos of victims, are ongoing.
The seizures, carried out under New York’s criminal procedure laws, mark perhaps one of the most significant and sweeping actions against websites hosting explicit deepfake videos since the technology first emerged at the end of 2017. As artificial intelligence technology has improved, a dark industry of websites, apps, and bots has appeared: They are designed to “undress” photos of women or create graphic sexual videos that include them. The images and videos are increasingly realistic and can be generated in seconds.
While deepfake technology is widely used against non-famous women and girls—often being shared in private social media groups—celebrities have spoken out about the many harms of being depicted in the content and the challenges of getting it removed. While laws against deepfakes have been slow to emerge, the US Take It Down Act increasingly allows images to be removed, with part of the law allowing law enforcement officials to take down and seize websites.
The Manhattan District Attorney’s Office has not publicly named the websites it has seized. However, ahead of Bragg’s announcement, WIRED independently observed several of the sites’ homepages being replaced by takedown notices—“THIS DOMAIN HAS BEEN SEIZED”—late last week, with the sites now saying they have been taken over following a seizure warrant issued by a New York State Supreme Court.
“The takedowns are a significant win in the fight against synthetic nonconsensual intimate imagery (NCII),” says Leonie Oehmig, a researcher at the Institute for Strategic Dialogue (ISD), who has studied the deepfake creation ecosystem. Oehmig says that enforcement of state laws shows that the harmful content can be tackled and that the seized sites don’t appear to be accessible if using VPNs to try and access them from other locations. “This shows that meaningful, coordinated enforcement is achievable even where regulation itself remains fragmented across jurisdictions.”
The websites were likely viewed millions of times. Many used names that included phrases such as “sex celebrity” or promised “real deepfakes.” They hosted false videos of some of the world’s most famous celebrities, with one saying, “various actresses’ faces are used for deepfakes.”
Videos could be several minutes in length and include fully sexually explicit scenes—often swapping the faces of celebrities or public figures into existing pornographic videos. Archived versions of the websites show some videos had been watched tens of thousands of times, with one of the websites claiming to have been online since 2018.
“Most videos took the shape of actual pornographic movies, manipulated to instead show targets’ faces instead of the original actors,” says Benjamin Shultz, the lead researcher at the American Sunlight Project, a nonprofit. Shultz, who has been documenting deepfake abuse against political figures and had come across some of the websites during this research, says that many videos appeared to be reposts of content that had originally be shared on the MrDeepFakes website, a notorious deepfake platform that was taken offline after its creators were unmasked by reporters.
“On at least two of the seized websites, elected officials were given profiles containing their name and position, along with a grid of manipulated videos hosting their likeness,” Shultz says. Through recent research, Shultz says that 56 European politicians had been mentioned or appeared on the websites, including 16 US politicians and two based in the UK.
While Oehmig, the ISD researcher, says the takedowns are encouraging, there are many other parts of the deepfake industry that are causing serious harm. “Effective intervention needs to target the ecosystem at multiple points, including the tools used for the creation of synthetic NCII, the discovery and promotion of these, the hosting and technical infrastructure that keeps them online, and the payment and affiliate systems that enable operators to monetize them,” Oehmig says.
Comments
Back to top