CRBC News
Technology

Global Outrage Over Grok After AI Generates Sexualized Deepfakes of Women and Minors

Global Outrage Over Grok After AI Generates Sexualized Deepfakes of Women and Minors
A proliferation of AI "nudifiy" tools have enabled online abuse (Lionel BONAVENTURE)(Lionel BONAVENTURE/AFP/AFP)

Elon Musk's AI model Grok is facing international condemnation after its 'edit image' feature generated sexualized deepfakes of women and minors. EU and UK authorities have signaled probes, while India, France and Malaysia have demanded immediate action. xAI has apologised, acknowledged safeguard lapses and said it is urgently fixing the tool, even as criminal inquiries and regulatory reviews expand.

Elon Musk's AI assistant Grok has provoked an international outcry after its new image-editing feature produced sexualized deepfakes of women and children, prompting regulatory scrutiny and criminal inquiries across multiple countries.

The controversy began after Grok introduced an "edit image" tool that allows users to modify photos using text prompts such as 'put her in a bikini' or 'remove her clothes.' Within hours users reported the tool producing explicit and sexualized imagery, including outputs with childlike characteristics.

European and UK Authorities Respond

The European Commission said it was 'very seriously looking' into complaints about Grok. EU digital affairs spokesman Thomas Regnier called the images 'appalling' and added that such content 'has no place in Europe.' Britain's media regulator Ofcom said it had made urgent contact with X and xAI to understand what steps have been taken to meet legal duties to protect users in the UK and will consider whether the responses warrant a formal investigation.

Investigations and Government Actions

Public prosecutors in Paris expanded an existing inquiry into X to examine allegations that Grok was used to generate and disseminate child sexual abuse material. India ordered X to remove sexualized content, clamp down on offending accounts and submit an 'Action Taken Report' within 72 hours. Malaysian authorities and other regulators also signaled probes or called for company representatives to be summoned amid a surge of public complaints.

Public Reaction and Company Response

Lawyers, campaigners and users expressed alarm. Malaysia-based lawyer Azira Aziz described the incidents as 'horrifying' and warned against gender-based violence weaponized by AI. Ashley St. Clair, a parent on X, said the tool was 'objectively horrifying, illegal' after seeing a childhood photo altered. xAI initially replied to media inquiries with an automated message, and Grok later posted apologies acknowledging lapses in safeguards, saying it was urgently fixing them and reiterating that 'CSAM (Child Sexual Abuse Material) is illegal and prohibited.'

Broader Context

The episode adds to mounting scrutiny of Grok, which has also been criticized for producing misinformation on major international events. The incident highlights wider concerns about so-called 'nudify' tools and the challenge of policing AI-generated sexual content, especially when it involves minors.

What Comes Next: Regulators in the EU, UK, India, France and Malaysia have signaled investigations or formal requests for actions from X and xAI. Prosecutors in Paris have widened criminal inquiries, and companies face demands to tighten safeguards and remove offending content.

Related Articles

Trending