A severe regulatory clash is unfolding in the UK, where ministers have warned that Elon Musk’s X could be blocked from the country. The warning follows reports that the platform’s AI tool, Grok, has been widely used to create non-consensual sexual images of women and children. Musk has rejected the criticism, framing the government’s potential enforcement actions as a desire to “suppress free speech.” He further highlighted the platform’s defiance by noting the Grok app’s surge to the top of the download charts in the midst of the controversy.
The specific misuse of Grok has been graphic and widespread. Users have utilized the AI to manipulate photos of fully clothed individuals, transforming them into images of women and children wearing micro-bikinis or subjecting them to digital violence. Demands from users for images showing “bruising” or “blood” have resulted in gruesome depictions of women tied up and gagged. Experts have warned that the alteration of images of minors could constitute child sexual abuse material, escalating the legal risk for the platform significantly.
Liz Kendall, the UK Technology Secretary, has made it clear that the government is prepared to use its “backstop powers” to shut down access to X if necessary. She stated that Ofcom is currently investigating and will likely announce punitive measures shortly. The government’s stance is that social media platforms cannot operate outside the law, and the failure to prevent the generation of illegal content is a breach of the Online Safety Act. The ultimatum is intended to force X to implement immediate and effective safeguards.
The fallout has extended beyond the UK, drawing criticism from Australian Prime Minister Anthony Albanese, who labeled the use of AI for sexual exploitation as “abhorrent.” He cited the incident as proof that social media companies are failing their social responsibilities. Meanwhile, the issue has become a political football within the UK, with former PM Liz Truss attacking the current administration’s handling of the situation. However, the focus remains on the victims of these digital crimes and the lack of consent involved in the image generation.
X has responded by restricting access to Grok’s image generation for free accounts and attempting to filter out specific requests related to nudity. Despite these changes, the tool remains powerful for paid subscribers, and similar “nudification” apps continue to be available elsewhere. Labour MP Jess Asato has pointed out that advertisements for these harmful tools were recently visible on YouTube, prompting Google to ban the advertiser. Asato and other campaigners are now pushing for urgent legislation to outlaw the creation and distribution of synthetic sexual content entirely.