Elon Musk’s social media platform X has announced new measures to curb its artificial intelligence chatbot Grok from generating and editing sexualized images of real people, following intense international criticism and regulatory pressure.
On Wednesday, X said it has implemented technological safeguards to stop Grok from editing photos of individuals into revealing outfits such as bikinis or underwear in jurisdictions where such content is illegal. The company also said that image creation and editing via Grok on X will now be accessible only to paid subscribers, a step it described as adding “an extra layer of protection” by making potential misuse more traceable.
The changes follow a global outcry over Grok’s so‑called “Spicy Mode,” which allowed users to generate highly sexualized deepfakes with simple text prompts such as “put her in a bikini” or “remove her clothes.” Reports of women and children being depicted without consent triggered backlash from governments, civil rights groups, and regulators around the world.
Regulatory and Legal Pressure
Pressure on Musk’s AI unit, xAI, has been mounting. On the same day as X’s announcement, California’s Attorney General launched an investigation into whether Grok’s outputs violate state law amid allegations that the tool was being used to produce explicit imagery used to harass individuals online.
Across the globe, several countries have taken action:
- Indonesia and Malaysia temporarily blocked access to Grok entirely amid concerns about non‑consensual content.
- The European Commission said it will assess X’s latest measures to ensure that citizens are protected under EU law.
- Regulators in the United Kingdom are also investigating potential violations of online safety laws related to the AI’s image generation.
Civil society groups have urged Apple and Google to delist X from their app stores unless stronger protections are put in place, while legal authorities in multiple markets are scrutinizing the potential harms caused by AI‑generated deepfakes.
X’s Response
In its statement, X reiterated a commitment to making the platform safer and said it has “zero tolerance for any forms of child sexual exploitation, non‑consensual nudity, and unwanted sexual content.” The company also noted that content violating its rules will be removed and that violating accounts face enforcement actions.
Despite these changes, critics argue that simply placing image generation behind a paywall and geoblocking certain regions may not be sufficient to stop misuse, especially given reports that Grok’s standalone app and other access points still allow problematic content generation in some cases. However, X maintains that the new restrictions mark a significant step toward accountability and compliance with local laws.
Comments