Ofcom probes Elon Musk’s X over alleged misuse of AI tool Grok to create sexualised images

UK media regulator Ofcom has launched a formal investigation into social media platform X, owned by billionaire Elon Musk, amid growing concerns that its artificial intelligence chatbot, Grok, is being used to generate illegal and harmful sexualised images.

In a statement released on Monday, Ofcom said it had received “deeply concerning reports” that Grok’s image-generation feature was being exploited to create and distribute non-consensual intimate images, including sexualised images of children.

If the platform is found to have breached UK law under the Online Safety Act, Ofcom could impose a fine of up to 10% of X’s global annual revenue or £18 million, whichever amount is higher. In extreme cases, the regulator may also seek a court order to block access to X entirely within the UK.

Allegations of widespread abuse

The BBC has seen several examples of digitally altered images circulating on X, in which women were depicted nude or placed in sexual positions without their consent. One woman told the BBC that more than 100 sexualised images of her had been generated and shared using AI tools.

Ofcom said its investigation will assess whether X failed to remove illegal content quickly after becoming aware of it, and whether the company took appropriate preventative measures to stop UK users from accessing such material.

The regulator will also examine whether X has implemented effective age-assurance systems to prevent children from viewing pornographic or sexually explicit content.

X and Musk respond

X referred the BBC to a statement posted by its official Safety account earlier this month, which stated:
“Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”

However, critics argue that enforcement has been inadequate.

Elon Musk later responded to criticism by suggesting the UK government was seeking “any excuse for censorship”, after questions were raised about why Grok appeared to face scrutiny while other AI platforms were not.

Political reaction and victim concerns

UK Technology Secretary Liz Kendall welcomed Ofcom’s intervention, urging the regulator to act swiftly.

“It is vital that Ofcom complete this investigation quickly,” she told the BBC. “The public, and most importantly the victims will not accept any delay.”

Former Technology Secretary Peter Kyle also condemned the situation, describing it as “appalling” and suggesting Grok had not been properly tested before release.

He recounted meeting a Jewish woman whose image had been manipulated by AI and placed in a deeply offensive setting.
“It made me feel sick to my stomach,” he said.

Possible enforcement action

Ofcom confirmed the investigation would be treated as “a matter of the highest priority”, particularly due to the risk of harm to children.

The regulator said illegal content under review includes child sexual abuse imagery and non-consensual intimate images, both of which are criminal offences in the UK.

If X fails to cooperate or address the concerns adequately, Ofcom could escalate enforcement, including applying for a business disruption order that would compel internet service providers to block the platform.

Global backlash against Grok

The investigation follows international criticism of Grok’s image-generation capabilities. Over the weekend, Malaysia and Indonesia temporarily blocked access to the tool amid similar concerns over misuse.

Professor Lorna Woods, an expert in internet law at the University of Essex, told the BBC that while it is difficult to predict how fast the probe will move, Ofcom has discretion over the pace of the investigation.

She noted that while blocking X would usually be a last resort, the regulator could act immediately “in rare circumstances” if it believes there is an ongoing and serious risk.

Protecting users online

Ofcom reiterated that platforms operating in the UK must comply with domestic laws and protect users from illegal and harmful content.

“We won’t hesitate to investigate where we suspect companies are failing in their duties,” a spokesperson said, “especially where there is a risk of harm to children.”

Source: BBC

Also read: Grok AI Backlash: Government Accused of Delaying Deepfake Law