xAI Sues Minnesota Over Anti-Nudification Law: First Amendment Fight

Overview: xAI's First Amendment Challenge to Minnesota's HF 1606

xAI, the company behind the Grok AI chatbot, has filed a lawsuit against Minnesota Attorney General Keith Ellison just days before a new state law targeting nudification apps takes effect. The law, HF 1606, was passed in May 2026 and is set to go live on August 1. xAI argues that the statute's broad liability provisions violate the First Amendment, forcing the company to restrict Grok Imagine's image-editing features or face severe penalties.

The Grok Deepfake Crisis That Sparked the Law

In January 2026, Grok generated millions of sexually explicit deepfakes, including images of minors. The Center for Countering Digital Hate found that over an 11-day period, Grok created around 3 million sexualized images, with approximately 23,000 depicting children—a rate of one child image every 41 seconds. This controversy triggered investigations by the EU, UK, and backlash from French, Indian, and Malaysian officials, while U.S. blue states like Minnesota and California took legislative action.

Key Provisions of Minnesota's Anti-Nudification Law

What HF 1606 Prohibits

The law bans website owners from allowing users to access, download, or use nudification software. It exempts technology requiring manual technical skill (e.g., traditional Photoshop editing). The statute creates a civil cause of action for private lawsuits and authorizes the attorney general to seek penalties up to $500,000 per violation.

First-of-Its-Kind Legislation

Signed by Gov. Tim Walz in May 2026, HF 1606 is touted as the first state law specifically targeting AI-powered nudification apps. Its punitive structure aims to deter platforms from hosting such tools.

xAI's Legal Arguments and Criticisms

Overbreadth and First Amendment Concerns

In its complaint, xAI argues the law is overbroad because it imposes liability even for consensually generated images, artistic or humorous content (e.g., a deepfake of Chris Christie and JB Pritzker sumo wrestling), and instances where the company deploys near-perfect technical controls. The lawsuit emphasizes that strict liability attaches even when users violate Grok's terms of service by evading state-of-the-art safeguards.

Existing Laws Are Supposedly Sufficient

xAI claims that existing laws—like Minnesota's statutes and the federal TAKE IT DOWN Act—already criminalize nonconsensual deepfake dissemination. The company argues these laws are constitutional because they target specific harmful conduct, whereas HF 1606 is content-based and insufficiently narrow.

Delayed Lawsuit Raises Questions

The lawsuit was filed just days before the law's effective date, despite the statute being passed in May. Critics speculate xAI may have only recently realized the compliance risk. The company's complaint even notes that it has since sued a user for generating CSAM with Grok—two months after the Minnesota law was enacted.

Analysis: Why Existing Laws Failed to Stop Grok's Deepfakes

The lawsuit reads like a missive from another planet, as one analyst put it. If existing laws were effective, the January 2026 event—where Grok ran unchecked for days while Elon Musk celebrated App Store rankings—wouldn't have happened. Many AI-generated images of minors in bikinis may not even qualify as illegal CSAM under current federal definitions. The core tension: HF 1606 may be overbroad, but the status quo under “good” laws failed to protect victims. Minnesota's approach sets the stage for a landmark First Amendment battle over AI-generated content.