Elon Musk's xAI company and its chatbot Grok have recently been subject to an injunction by a Dutch court, prohibiting them from creating AI-generated images of adults and children without the consent of the individuals involved. This has placed xAI under increasing legal pressure.
According to a court statement translated by Google, the Amsterdam District Court issued a legal order on March 26th explicitly prohibiting xAI from generating and distributing sexual images that "partially or wholly expose the human body without explicit permission."
Notably, this ruling is the first such case against Grok in Europe, covering not only child sexual abuse material but also prohibiting the platform X (formerly Twitter) from offering Grok-related functionality in the region. Under the injunction, if xAI fails to comply, it will face a fine of €100,000 (approximately US$115,000) per day, with a maximum fine of €10 million.
The case was filed by the Dutch non-profit organization Offlimits, whose core mission is to combat online sexual abuse, with a particular focus on sexual abuse of children and adolescents. In addition to issuing the injunction, the court also ordered xAI to pay €2.2 million in legal costs to Offlimits within 14 days.
"The judge drew a clear line yesterday: technology is not a license to violate online human rights," said Robert Hoven, Managing Director of Offlimits, in a statement. "Equally encouraging is the European vote yesterday to ban the Nudify tool. This is significant and a double celebration. Everyone should enjoy the same online rights in every European country."
According to estimates from the Center Against Internet Hate (CCDH), between December 29, 2026 and January 9, 2026, the Grok website generated approximately 3 million sexually suggestive images. The center further found that over 23,000 of these images appeared to depict children.
In January of this year, xAI attempted to implement restrictions to prevent Grok from creating lifelike images on its X platform, covering all users, including paid subscribers. However, Offlimits found these restrictions easily circumvented, and the court ultimately ruled that xAI's measures were insufficient to adequately protect user rights.
In fact, lawsuits against xAI are on the rise. On March 24, Baltimore, USA, became the first major city in the country to sue xAI, accusing the company of violating local consumer protection laws and deceptively promoting Grok and the X platform as safe products for users. The complaints also mention an online trend called "Change Her to a Bikini," in which Grok was used to nude other people's photos. Elon Musk, CEO of xAI, participated in this trend, sharing a photo of himself in a bikini, which was created using Grok.
Furthermore, three teenagers in Tennessee recently filed a lawsuit against xAI, alleging that Grok generated content showing them explicit sexual positions and scenes.
Meanwhile, the European Commission launched an investigation into xAI in January of this year for distributing sexually explicit material involving children and other individuals without consent. This investigation is currently proceeding under the Digital Services Act (DSA).
In addition to the EU, the UK's cybersecurity regulator Ofcom and the Information Commissioner's Office have also launched investigations into the X platform and the distribution of sexually explicit images without consent.
While Europe has not yet implemented broader rulings against xAI and Grok, Southeast Asian countries Malaysia and Indonesia took action in January of this year, banning access to Grok. The two countries cited the reason that Company X "repeatedly failed" to address the risks associated with the AI tool, particularly the issue of it generating unconsented sexual content.
