Advertisement
When should a housing society in Mumbai start considering re...
From GST on JDAs to SEBI’s REIT reclassification and the S...
Stay ahead in the world of real estate with our daily podcas...
Stay ahead in the world of real estate with our daily podcas...
Microblogging platform X has removed around 3,500 posts and deleted over 600 accounts after the IT Ministry raised concerns over obscene content linked to its AI chatbot, Grok. The action follows reports of non-consensual and manipulated explicit images circulating on the platform, prompting regulatory intervention. X acknowledged the lapse and assured compliance with Indian laws, including stricter enforcement of content moderation and AI usage rules. The government warned that failure to meet due diligence under the IT Act could invite legal action. Similar concerns have been flagged by regulators in the UK, EU, and US, highlighting growing global scrutiny over AI misuse, platform accountability, and online safety safeguards.
Microblogging platform X has removed around 3,500 pieces of content and deleted more than 600 accounts after the Ministry of Electronics and Information Technology (MeitY) raised concerns over obscene material linked to its AI chatbot, Grok, government sources said on Sunday. The platform has acknowledged its lapse and assured authorities that it will comply with Indian laws going forward. Advertisement
The action follows increased scrutiny of Grok, an AI chatbot developed by xAI and backed by Elon Musk, after reports of non-consensual, sexually explicit and manipulated images circulating on X. Regulators in several countries have expressed concern over content moderation, data safety, and misuse of generative AI tools.
According to government sources, X accepted responsibility for the issue and confirmed that it has blocked the identified content and taken action against offending accounts. The platform has also assured that it will not allow obscene imagery in the future and will strengthen enforcement mechanisms.
Earlier this month, the IT Ministry directed X to immediately remove all vulgar, obscene, and unlawful content generated or shared through Grok. The ministry asked the company to submit a detailed action taken report within 72 hours, outlining technical and organisational measures, the role of its Chief Compliance Officer, and steps taken against violating users and content.
In its directive, the ministry noted that Grok was being misused to create and circulate obscene images and videos of women, often through fake accounts and image manipulation. The issue, it said, was not limited to impersonation but also targeted women who had shared their own images online, resulting in derogatory and unlawful content. The ministry described this as a serious failure of platform-level safeguards and a misuse of AI technologies in violation of Indian law.
The government made it clear that compliance with the Information Technology Act and related rules is mandatory. It warned that failure to meet due diligence obligations could lead to the loss of legal protections available to online intermediaries under Section 79 of the IT Act, and could invite action under other applicable laws, including the Bharatiya Nyaya Sanhita.
X was also instructed to strictly enforce its user terms and AI usage restrictions, including suspending or terminating accounts found in violation. The ministry asked the platform to remove unlawful content without delay while preserving evidence, as required under the IT Rules, 2021.
While X had earlier responded by reiterating its commitment to Indian laws and outlining its content takedown policies, the government found the response lacking in specific details on actions taken and preventive measures. This led to a tougher stance and further engagement with the company.
Pressure on X is not limited to India. Regulators in the United Kingdom and the European Union have also raised concerns over Grok-generated deepfake content. The UK communications regulator Ofcom has sought urgent clarification from X and xAI, while the European Commission has reportedly asked the company to retain documents related to Grok. In the United States, lawmakers have urged app store operators to review the platform's compliance.
X has now assured Indian authorities that it will adhere to local regulations and strengthen safeguards to prevent future misuse of its AI tools.
Source: PTI
5th Jun, 2025
25th May, 2023
11th May, 2023
27th Apr, 2023
Advertisement
Facebook
Whatsapp
