Ofcom has opened a formal investigation into X after Grok's image generator was used to produce sexualised deepfakes of women and children. The regulator said such images "may amount to" intimate image abuse or child sexual abuse material and has asked X to explain the protections in place for UK users. The probe will assess compliance with the Online Safety Act, which enables fines of up to 10% of worldwide revenue. Several countries have already restricted access and EU authorities are reviewing complaints.
Ofcom Opens Formal Investigation Into X After Grok Used To Create Sexualised AI Deepfakes
Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts (Lionel BONAVENTURE)(Lionel BONAVENTURE/AFP/AFP)
UK communications regulator Ofcom on Monday launched a formal investigation into Elon Musk's social media company X over the image-generation capability of its AI chatbot Grok, after reports the tool was used to produce sexualised deepfakes of women and children.
Ofcom described the reports as "deeply concerning" and warned that undressed images created by the tool "may amount to intimate image abuse or pornography", while sexualised images of children "may amount to child sexual abuse material." The regulator said it contacted X on 5 January, asking the company to explain what steps it had taken to protect users in the UK; X responded within the regulator's deadline but Ofcom did not disclose the contents of that reply.
The formal probe will determine whether X has "failed to comply with its legal obligations" under the UK Online Safety Act, which came into force in July. The law requires platforms hosting potentially harmful material to implement strict age-verification measures — such as facial checks or credit-card checks — and makes it illegal to create or share non-consensual intimate images or child sexual abuse material, including sexual deepfakes generated with AI.
Ofcom has the power to impose fines of up to 10 percent of worldwide revenue for breaches of these rules.
Amid international criticism, Grok said late last week that its image-generation feature would be "limited to paying subscribers" and linked to a premium subscription — a move UK Prime Minister Keir Starmer called "an affront to victims" and "not a solution." Indonesia became the first country to block access to the tool on Saturday, with Malaysia following on Sunday. The European Commission has also said it is reviewing complaints about Grok.
Ofcom: "These reports are deeply concerning and may amount to intimate image abuse or child sexual abuse material."
AFP reported that X did not immediately reply to media requests for comment beyond the regulator-facing response. The investigation will examine whether X met the standards required by the Online Safety Act and whether further enforcement action — including fines — is warranted.
Help us improve.
![Evaluating AI Safety: How Top Models Score on Risk, Harms and Governance [Infographic]](/_next/image?url=https%3A%2F%2Fsvetvesti-prod.s3.eu-west-1.amazonaws.com%2Farticle-images-prod%2F696059d4e289e484f85b9491.jpg&w=3840&q=75)
