Human Rights vs Technology: Indonesia Launches the World's First Grok Porn Image Ban

AI Chatbot Grok has recently become the center of an international controversy. In early 2025, the Indonesian government took measures to disable this tool developed by xAI, a company under Elon Musk, citing the prevention of pornographic image generation, becoming the first country in the world to take such a radical action. This move reflects the increasingly serious attitude of governments worldwide toward digital security and human rights protection.

Global Pornographic Image Controversy Facing Grok

Shortly after its launch, Grok faced criticism for its potential to generate deepfake content containing pornographic images. This is not an isolated incident—governments and regulatory agencies from Europe to Asia have identified similar issues and have launched investigations. The generation and dissemination of pornographic images have become a key focus area in AI ethics regulation.

Indonesia’s Firm Stance

The Indonesian Ministry of Communications and Digital Affairs acted swiftly to become the first country to ban such AI tools. The ministry not only issued the ban but also summoned executives from X to communicate and negotiate. The reasoning behind this is clear and compelling.

Human Rights Protection as a Core Consideration

Mutiya Hafid, Minister of Communications and Digital Affairs of Indonesia, emphasized the seriousness of the issue in an official statement: “The government believes that non-consensual deepfake behavior poses a serious threat to human rights, citizen dignity, and citizen safety in the digital space.” This statement indicates that the generation and dissemination of pornographic images are not only technical issues but also violations of fundamental human rights.

The government’s ban reflects a clear value judgment—prioritizing human rights protection over digital innovation. Indonesia’s action may serve as a reference case for other countries when formulating AI regulation policies.