The European Union has launched a far-reaching new investigation into social media platform X, intensifying scrutiny of how artificial intelligence is deployed at scale. At the center of the case is Grok, an AI chatbot integrated into the platform, which regulators say generated millions of sexualized images of women and children in a matter of days. The inquiry marks a defining moment for Europe’s effort to police the risks of generative AI.
Officials at the European Commission are examining whether X fulfilled its obligations under the Digital Services Act, the landmark regulation designed to curb illegal and harmful online content. According to preliminary findings, the platform may have failed to adequately assess and mitigate foreseeable risks before deploying Grok widely across the EU.
A strong political signal
European Commission President Ursula von der Leyen described the images as illegal and deeply disturbing, stating that Europe would not tolerate practices that undermine human dignity, particularly when children are involved. Her remarks underscore the political sensitivity of the case and the determination of EU institutions to demonstrate that digital rules carry real consequences.
Regulators are especially concerned that some of the AI-generated images could qualify as child sexual abuse material under European law, even if they depict synthetic rather than real individuals. This legal gray area has become one of the most contentious issues in global debates over AI-generated content.
The role of the Digital Services Act
Under the Digital Services Act, large online platforms must proactively identify systemic risks, implement safeguards, and respond rapidly when illegal content emerges. The EU is now assessing whether X treated these requirements as a formality rather than a core responsibility. Critics argue that safeguards were introduced only after public backlash, not as part of a robust pre-deployment risk assessment.
The investigation also expands an earlier probe launched in 2023 into X’s algorithmic transparency. The company’s recent decision to rely more heavily on Grok-driven algorithms could, according to regulators, amplify harmful content if left unchecked.
A pattern of enforcement actions
The case follows a significant fine imposed on X in December for breaching transparency rules. That penalty, amounting to €120 million, was seen as a warning shot. The current investigation raises the stakes considerably. Possible outcomes range from further fines to mandatory changes in how AI tools are designed and deployed within the EU.
A global precedent in the making
Beyond Europe, the case is being closely watched by governments and tech companies worldwide. The EU has positioned itself as a global leader in digital regulation, willing to prioritize fundamental rights over rapid technological expansion. If Brussels succeeds in enforcing meaningful constraints on AI-driven platforms, it could influence regulatory approaches far beyond Europe.
At the same time, technology firms warn that overly restrictive rules could stifle innovation and push AI development elsewhere. The investigation into X thus encapsulates a broader tension between innovation, accountability, and the protection of vulnerable users.
What comes next
For X, the outcome could shape its future operations in Europe. For the EU, it represents a critical test of whether its digital rulebook can keep pace with the realities of artificial intelligence. The findings will likely resonate across the tech industry, signaling how far regulators are prepared to go to enforce accountability in the digital age.