🔗 Share this article

Elon Musk's social media network X has provoked widespread outrage after users utilized its AI chatbot Grok to alter photos of females by stripping their garments.

Numerous cases have emerged where the technology has been used to digitally undress female subjects to show them in bikinis without consent, as well as to place them in sexualized situations.

Company Reaction and Legal Position

XAI, the firm behind Grok, offered no comment to questions, except for an standard message stating "traditional news outlets lies".

A Home Office representative stated that new laws is being introduced to prohibit nudification software. Under a proposed criminal offence, anyone who distributed such tools would "face a jail term and significant fines".

"The platform is capable of halting these types of abuse if they wanted to," said Clare McGlynn, adding they "appear to enjoy a lack of consequences."

Oversight Body Position and Platform Capabilities

The regulator Ofcom said tech firms must "consider the danger" of people viewing unlawful material on their networks, but did not specify whether it was presently investigating X or Grok in regarding artificial intelligence images.

Grok is a no-cost artificial intelligence—with some additional functions—which responds to X users' queries when they tag it in a message.

It is often used to provide commentary or more background to other users' remarks, but people on X are also capable of edit an posted picture through its AI image editing tool.

History of Controversy and Rules

The system has been faulted for allowing users to produce photos and footage with nudity and sexualised content, and it was earlier alleged to have been involved in making inappropriate content of celebrities.

"The platform has been enabling the creation and spread of these images for a long time without taking any steps and we have not seen any intervention by oversight bodies," the expert added.

XAI's own acceptable use policy bans "portraying images of persons in a graphic way".

In a comment, Ofcom said it was against the law to "create or share non-consensual intimate images or illegal content" and stated this covered sexual deepfakes created with AI.

It said platforms such as X were required to take "necessary measures" to "minimize the risk" of users viewing illegal material on their platforms and to remove it promptly when they become aware of it.