X Faces EU Investigation Over Grok AI’s Role in Generating Sexualized Deepfakes

X Under Investigation by European Commission Over AI Chatbot, Grok

The European Commission, in their most recent act of tech industry oversight, has cast their inquisitive lens on X, formerly known as Twitter. The subject of the Commission’s investigation is Grok, X’s AI chatbot, and its increasingly controversial capacity to create deepfake images with a sexualized tenor.

International Concerns and X’s Measures

The contentious aspect of this issue is not relegated solely to Europe—it’s become a matter of global concern. Authorities and advocacy bodies from around the world have expressed varying degrees of alarm. They’re perturbed by the chatbot’s feature that allows it to generate sexually explicit consensus reality images—some, horrifically, involving minors. What was initially viewed as a novel AI feature, has rapidly become a vortex of debate, attracting international scrutiny and demands for stringent regulation.

Conversely, it’s not as if X hasn’t attempted to respond to the backlash. They have instituted a paywall, adjacent to the image-editing feature, and disabled its usage in public responses. However, these reactions have been critiqued as lacking substantial efficacy. Detractors claim that the AI tool still facilitates the creation of inappropriate content and lambast X for their alleged failure to enact meaningful protection measures.

AI Regulation and Ethics in the Modern World

This issue and its ripples are timely, as the European Union actively strengthens its stance on AI regulations. The situation presented by X could pioneer how tech companies are kept in check—their AI tools, their unforeseen consequences, and their accountability. With the European Union’s Digital Services Act hanging like the sword of Damocles, X may face severe repercussions if found in violation of the imposed standards.

Perhaps one of the more essential discussions brought about by the Grok incident is a broader debate around AI ethics. And distinctly, how these AI capabilities should be moderated when user safety is at stake. With the advancement of AI technology, the challenge of ensuring ethical use becomes increasingly complex—this case is serving as a stark reminder of the havoc that can be wrought by unchecked AI.

To learn more about this story and similar ones, visit The Verge.