EU lawmakers are done with nudify apps—and Musk’s Grok is the poster child

EU lawmakers are done with nudify apps—and Musk’s Grok is the poster child

4 0 0

The European Union is finally getting serious about nudify apps, and Elon Musk’s Grok chatbot is the reason why.

This week, the European Parliament’s Internal Market and Civil Liberties committees voted 101–9 (with 8 abstentions) to simplify the AI Act and explicitly ban “AI nudifier systems.” That’s a direct response to Grok becoming a textbook case of an AI platform that failed to block outputs sexualizing real people—including children.

Let’s be clear: Grok didn’t invent this problem. But it became the most visible example. Musk’s usual playbook—blame the users, call it a fringe case, promise a patch—doesn’t fly when the EU is watching. The Commission had already admitted earlier this year that the current AI Act doesn’t prohibit systems that generate child sexual abuse material or sexually explicit deepfake nudes. That’s a gap you could drive a data center through.

The vote is a signal that lawmakers are done waiting. They want bans, not guidelines. They want liability, not apologies.

I’ve been watching this space for years, and the pattern is exhausting. A company launches a generative AI tool. Someone figures out how to jailbreak it into making non-consensual intimate images. The company issues a statement about “safeguards” and “improvements.” Nothing really changes. Grok just happened to be the one that got caught in the EU’s spotlight.

What’s different this time is the speed. The committees didn’t form a study group or call for more research. They voted. 101 to 9. That’s not a debate—that’s a mandate.

Of course, the devil is in the implementation. Banning “nudifier systems” sounds clean, but what about general-purpose image generators that can be repurposed? The EU will have to decide whether to go after the tool or the output. I’d bet on the output, because going after every model would be a regulatory nightmare.

Still, this is the right direction. The tech industry has had years to self-regulate on this issue and has consistently failed. If the EU has to step in with a hammer, that’s on the companies that refused to use a screwdriver.

Musk may try to spin this as a free speech issue or an attack on innovation. It’s neither. It’s about whether you can build a product that lets people generate sexualized images of real individuals without their consent. The answer should be no, and the EU is finally saying it out loud.

Comments (0)

Be the first to comment!