Elon Musk’s AI company has officially restricted the controversial image-generation feature of Grok. As of Friday, X limited the tool to paying subscribers only. This decision follows a wave of heavy global criticism after users weaponised the AI to generate sexualized and nude images of women and children.
Grok confirmed the change in replies to users on the platform. Consequently, only Premium subscribers can now generate and edit images directly on X. However, a significant loophole remains. Notably, these restrictions did not apply to the standalone Grok app at the time of the report. The app continued letting users generate pictures without a subscription.
A Flood of Non-Consensual Content Via Grok
Initially, the feature was available to everyone with daily limits. It allowed users to upload any photo and ask the AI to “edit” it. Predictably, this led to immediate misuse. Users generated a veritable flood of non-consensual sexualized images featuring children, actors, models, and prominent figures.
This unchecked capability drew the ire of multiple nations. In response, X and Elon Musk publicly denounced the tool’s misuse. Musk tweeted last week that the company would enforce its existing policies against illegal content. Musk stated:
Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.
Governments Threaten Legal Action
Despite these statements, international regulators are moving fast. The European Union asked xAI on Thursday to retain all documentation related to the chatbot. Simultaneously, the U.K.’s communications watchdog confirmed it is in contact with xAI regarding the issue.
The pressure is particularly intense from India. Users in India went too far with this update, as expected. People didn’t even spare kids. According to TechJuice’s research, 2% of all the images analysed were of underage kids. India’s communications ministry ordered X to make immediate changes to stop the misuse. If X fails to comply, they risk losing their “safe harbour” protections in the country, making the platform legally liable for user-generated content.
