Microblogging platform X has acknowledged a lapse in content moderation and removed around 3,500 pieces of content while deleting more than 600 accounts after the Union IT Ministry raised concerns over obscene material linked to the Elon Musk backed AI chatbot Grok, government sources said on Sunday. The platform has assured Indian authorities that it will comply with all applicable laws going forward.
The action comes amid increasing pressure on Grok from regulators across the world, as governments intensify scrutiny of generative artificial intelligence tools over content moderation failures, data safety concerns and the spread of non consensual sexually explicit images that have appeared on X in recent days.
According to government sources, X accepted its mistake and informed the authorities that corrective measures have been taken. The platform has blocked thousands of objectionable posts and removed hundreds of accounts, while also assuring that such obscene imagery will not be allowed in the future.
Earlier, X had stated through its Safety handle that it takes action against illegal content on its platform, including child sexual abuse material, by removing such content, permanently suspending accounts and cooperating with law enforcement agencies when required. The platform had also said that users prompting Grok to generate illegal content would face the same consequences as those directly uploading such material.
X has faced strong backlash globally over the misuse of Grok for creating digitally manipulated and sexually explicit images through user prompts. Governments in Europe and Asia have warned the platform of consequences if it fails to adhere to online safety norms, while public calls for strict action against both X and Grok have intensified.
On January 2, the IT Ministry issued a directive to X, asking it to immediately remove all vulgar, obscene and unlawful content generated through Grok or face legal action. The ministry also sought a detailed action taken report within 72 hours, outlining technical and organisational safeguards, the role of the Chief Compliance Officer, action against offending users and mechanisms to ensure compliance with Indian laws.
The ministry noted that Grok AI, developed by X and integrated into the platform, was being misused to create fake accounts and generate obscene images and videos of women in a derogatory manner. It added that even genuine images uploaded by women were being targeted through prompts, image manipulation and synthetic outputs, reflecting a serious failure of platform level safeguards and enforcement.
The government made it clear that compliance with the IT Act and related rules is mandatory and that the safe harbour protection under Section 79 of the IT Act is conditional on strict adherence to due diligence obligations. Authorities warned that failure to comply could result in the loss of legal immunity and invite action under the IT Act and the Bharatiya Nyaya Sanhita.
X was directed to strictly enforce its user terms and AI usage restrictions, including imposing deterrent measures such as suspension and termination of violating accounts. It was also asked to remove or disable access to unlawful content without delay, in line with timelines prescribed under the IT Rules, 2021, while preserving evidence.
While X initially responded with a detailed reply reiterating its respect for Indian laws and guidelines, the government felt the response lacked crucial information, including specific takedown details and concrete steps taken to address and prevent the misuse of Grok. This prompted the authorities to seek further clarification and stronger action.
X has now conveyed to the government that it has accepted the concerns and will comply with Indian regulations, sources said.
Beyond India, the issue has drawn attention in the United Kingdom and the European Union. UK Prime Minister Keir Starmer described the misuse of AI generated imagery as disturbing, while the European Commission has reportedly asked X to preserve documents related to Grok. The UK communications regulator Ofcom said it has sought urgent clarification from X and xAI regarding steps taken to meet legal obligations to protect users and added that it would assess whether a formal investigation is required.
Meanwhile, three Democratic senators in the United States have urged Apple and Google to suspend X and Grok from their app stores, alleging violations of platform terms of service.
Discussion about this post