This is The Stepback, a weekly newsletter breaking down one essential story from the tech world. For more on the legal morass of AI, follow Adi Robertson. The Stepback arrives in our subscribersβ inboxes at 8AM ET. Opt in for The Stepback here.
The song was called βHeart on My Sleeve,β and if you didnβt know better, you might guess you were hearing Drake. If you did know better, you were hearing the starting bell of a new legal and cultural battle: the fight over how AI services should be able to use peopleβs faces and voices, and how platforms should respond.
Back in 2023, the AI-generated faux-Drake track βHeart on My Sleeveβ was a novelty; even so, the problems it presented were clear. The songβs close imitation of a major artist rattled musicians. Streaming services removed it on a copyright legal technicality. But the creator wasnβt making a direct copy of anything β just a very close imitation. So attention quickly turned to the separate area of likeness law. Itβs a field that was once synonymous with celebrities going after unauthorized endorsements and parodies, and as audio and video deepfakes proliferated, it felt like one of the few tools available to regulate them.
Unlike copyright, which is governed by the Digital Millennium Copyright Act and multiple international treaties, thereβs no federal law around likeness. Itβs a patchwork of varying state laws, none of which were originally designed with AI in mind. But the past few years have seen a flurry of efforts to change that. In 2024, Tennessee Gov. Bill Lee and California Gov. Gavin Newsom β both of whose states rely heavily on their media industries β signed bills that expanded protections against unauthorized replicas of entertainers.
But law has predictably moved more slowly than tech. Last month OpenAI launched Sora, an AI video generation platform aimed specifically at capturing and remixing real peopleβs likenesses. It opened the floodgates to a torrent of often startlingly realistic deepfakes, including of people who didnβt consent to their creation. OpenAI and other companies are responding by implementing their own likeness policies β which, in the absence of anything else, could turn into the internetβs new rules of the road.
OpenAI has denied it was reckless launching Sora, with CEO Sam Altman claiming that if anything, it was βway too restrictiveβ with guardrails. Yet the service has still generated plenty of complaints. It launched with minimal restrictions on the likenesses of historical figures, only to reverse course after Martin Luther King Jr.βs estate complained about βdisrespectful depictionsβ of the assassinated civil rights leader spewing racism or committing crimes. It touted careful restrictions on unauthorized use of living peopleβs likenesses, but users found ways around it to put celebrities like Bryan Cranston into Sora videos doing things like taking a selfie with Michael Jackson, leading to complaints from SAG-AFTRA that pushed OpenAI to strengthen guardrails in unspecified ways there too.
Even some people who did authorize Sora cameos (its word for a video using a personβs likeness) were unsettled by the results, including, for women, all kinds of fetish output. Altman said he hadnβt realized people might have βin-betweenβ feelings about authorized likenesses, like not wanting a public cameo βto say offensive things or things that they find deeply problematic.β
Soraβs been addressing problems with changes like its tweak to the historical figures policy, but itβs not the only AI video service, and things are getting β in general β very weird. AI slop has become de rigueur for President Donald Trumpβs administration and some other politicians, including gross or outright racist depictions of specific political enemies: Trump responded to last weekβs No Kings protests with a video that showed him dropping shit on a person who resembled liberal influencer Harry Sisson, while New York City mayoral candidate Andrew Cuomo posted (and quickly deleted) a βcriminals for Zohran Mamdaniβ video that showed his Democratic opponent gobbling handfuls of rice. As Kat Tenbarge chronicled in Spitfire News earlier this month, AI videos are becoming ammunition in influencer drama as well.
Thereβs an almost constant potential threat of legal action around unauthorized videos, as celebrities like Scarlett Johansson have lawyered up over use of their likeness. But unlike with AI copyright infringement allegations, which have generated numerous high-profile lawsuits and nearly constant deliberation inside regulatory agencies, few likeness incidents have escalated to that level β perhaps in part because the legal landscape is still in flux.
When SAG-AFTRA thanked OpenAI for changing Soraβs guardrails, it used the opportunity to promote the Nurture Originals, Foster Art, and Keep Entertainment Safe (NO FAKES) Act, a years-old attempt to codify protections against βunauthorized digital replicas.β The NO FAKES Act, which has also garnered support from YouTube, introduces nationwide rights to control the use of a βcomputer-generated, highly realistic electronic representationβ of a living or dead personβs voice or visual likeness. It includes liability for online services that knowingly allow unauthorized digital replicas, too.
The NO FAKES Act has generated severe criticism from online free speech groups. The EFF dubbed it a βnew censorship infrastructureβ mandate that forces platforms to filter content so broadly it will almost inevitably lead to unintentional takedowns and a βhecklerβs vetoβ online. The bill includes carveouts for parody, satire, and commentary that should be allowed even without authorization, but theyβll be βcold comfort for those who cannot afford to litigate the question,β the organization warned.
Opponents of the NO FAKES Act can take solace in how little legislation Congress manages to pass these days β weβre currently living through the second-longest federal government shutdown in history, and thereβs even a separate push to block state AI regulation that could nullify new likeness laws. But pragmatically, likeness rules are still coming. Earlier this week YouTube announced it will let Partner Program creators search for unauthorized uploads using their likeness and request their removal. The move expands on existing policies that, among other things, let music industry partners take down content that βmimics an artistβs unique singing or rapping voice.β
And throughout all this, social norms are still evolving. Weβre entering a world where you can easily generate a video of almost anyone doing almost anything β but when should you? In many cases, those expectations remain up for grabs.
- Most of this recent conversation is about AI videos of people doing simply weird or silly things, but historically, research indicates the overwhelming majority of deepfakes have been pornographic images of women, often made without consent. Beyond Sora thereβs a whole different conversation about things like the output of AI nudify services, and the legal issues are similar to those concerning other nonconsensual sexual imagery.
- On top of the basic legal issue of when a likeness is unauthorized, there are also questions like when a video might be defamatory (if itβs sufficiently realistic) or harassing (if itβs part of a larger pattern of stalking and threats), which could make individual situations even more complicated.
- Social platforms are used to being almost always shielded from liability through Section 230, which says they canβt be treated as the publisher or speaker of third-party content. As more and more services take the active step of helping users generate content, how far Section 230 will shield the resulting images and video seems like a fascinating question.
- Despite long-standing fears that AI will make it truly impossible to distinguish phantasms from reality, itβs still often simple to use context and βtellsβ (from specific editing tics to obvious watermarks) to figure out whether a video was AI-generated. The problem is many people donβt look closely enough or simply donβt care if itβs fake.
- Sarah Jeongβs warning about seamlessly manipulated photographs is even more relevant now than it was when she published it in 2024.
- The New York Times has a comprehensive look at Trumpβs particular affinity for AI-generated content.
- Max Readβs analysis of Sora as a social platform and whether it will βwork.β