X’s AI chatbot Grok has become the center of an expanding global controversy after the platform faced backlash for its ability to generate non-consensual and sexualized images, including depictions involving women and minors.
The criticism has triggered regulatory inquiries, feature restrictions, and calls from multiple governments for stronger safeguards against misuse of generative AI tools.
According explained by X:
We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis. This restriction applies to all users, including paid subscribers.
Additionally, image creation and the ability to edit images via the Grok account on the X platform are now only available to paid subscribers. This adds an extra layer of protection by helping to ensure that individuals who attempt to abuse the Grok account to violate the law or our policies can be held accountable.
X has further noted that all AI prompts and generated content “must strictly adhere to our X Rules.”
However content is created or whether users are free or paid subscribers, our Safety team are working around the clock to add additional safeguards, take swift and decisive action to remove violating and illegal content, permanently suspend accounts where appropriate, and collaborate with local governments and law enforcement as necessary.
Authorities in Australia, Canada, and the European Union have questioned X about the absence of adequate protections to prevent harmful content created through Grok’s image generation features. In response, some countries have even discussed or implemented restrictions on access to the Grok app due to concerns over sexually explicit outputs produced by the AI system.
The backlash stems from widespread evidence that users can prompt Grok to alter or create images that depict real people in sexualized or explicit contexts without their consent. Independent analyses and regulatory watchdogs have pointed to a surge in non-consensual deepfake content, with requests ranging from suggestive imagery to deeply problematic depictions involving children. TechJuice earlier noted that Grok AI generates sexualized images of children, even without a second follow-up of confirmation.
Indonesia temporarily blocked access to Grok on X, citing risks to women, children, and broader societal safety due to the generation of pornography and deepfake content. Malaysian authorities have initiated legal proceedings against the company, alleging violations of local laws governing decency and online safety.
Regulatory concerns have also surfaced in the United Kingdom, where officials, including the Prime Minister, have indicated that failure to address the issue adequately could result in bans or stricter enforcement of online safety legislation.
Elon Musk, owner of X and co-founder of xAI, has sought to defend the platform, asserting that Grok is programmed to reject illegal image requests and that any misuse will carry legal consequences. Musk has also stated he was not aware of any instances of nudity involving minors generated by the tool, amid intensifying global pressure.
I not aware of any naked underage images generated by Grok. Literally zero.
Obviously, Grok does not spontaneously generate images, it does so only according to user requests.
When asked to generate images, it will refuse to produce anything illegal, as the operating principle… https://t.co/YBoqo7ZmEj
— Elon Musk (@elonmusk) January 14, 2026
The controversy has ignited broader debates about the responsibility of AI developers to enforce ethical safeguards and about the proportionality of restrictions versus free speech protections.
Musk had originally tried to shift the responsibility onto users, stating that anyone who creates illegal images using Grok would face prosecution.
