Centre cracks down on X over AI-driven obscene, nude and indecent content
The Ministry of Electronics and Information Technology (MeitY) has issued a strict directive to X Corp, citing failures to prevent the generation and spread of obscene, nude and indecent content through AI-enabled features on the platform. X has been ordered to submit an action taken report within 72 hours, with clear steps to stop the hosting, creation, publication and sharing of such material.
The notice specifically calls out misuse of Grok and other xAI services on X. It warns of serious legal consequences for the platform, its responsible officers and users who violate the law.
What the directive demands from X
- Immediate removal of offending content without tampering with evidence.
- A comprehensive review of Grok's technical and governance safeguards to block unlawful outputs.
- Strict enforcement of user policies, including suspensions and terminations for violations.
- A detailed, time-bound action taken report to MeitY within 72 hours.
Legal exposure flagged
MeitY has stated that non-compliance may lead to loss of safe harbour under Section 79 of the IT Act and invite penal action under multiple laws, including the Bharatiya Nyaya Sanhita (BNS), the Bharatiya Nagarik Suraksha Sanhita (BNSS), the Indecent Representation of Women Act and the Protection of Children from Sexual Offences (POCSO) Act.
The ministry's view is that the platform has not adequately adhered to due diligence requirements under the IT Act and Rules, especially in relation to obscene, vulgar, pornographic, paedophilic or otherwise harmful content. Copies of the notice have been marked to key ministries, commissions and state authorities to support coordinated action.
Ministry of Electronics and Information Technology (MeitY)
Why Grok is in focus
According to the notice, Grok's AI capabilities are being misused by users to generate and share synthetic or manipulated images and videos of women in degrading ways. This isn't confined to fake accounts; it also targets women who have publicly posted their own images or videos.
MeitY characterizes this as a failure of platform-level safeguards and enforcement. It also notes the wider societal impact: violations of dignity, privacy and safety of women and children and the normalization of harassment in digital spaces.
What this means for government officials
- Track X's 72-hour compliance window. Document the platform's responses and escalation timelines.
- Coordinate with state police cyber units and relevant commissions to streamline takedowns and evidence preservation.
- Standardize SOPs for handling AI-generated sexualized content complaints, including victim support and legal follow-through.
- Ensure digital evidence is secured end-to-end (hashing, chain of custody) before content removal requests proceed.
- Prepare periodic reviews of intermediary compliance under the IT Act, IT Rules and related statutes, focusing on AI misuse patterns.
What to watch in the next 72 hours
- Whether X details concrete guardrails for Grok and related services (prompt filtering, image upload checks, output blocks, user recourse).
- Clear enforcement metrics: speed of removal, volume of accounts/actioned content and escalation paths for repeat offenders.
- Commitments to preserve evidence for lawful investigations while removing content quickly.
The intent is unambiguous: intermediaries must prevent AI-driven abuse at scale, not react after harm occurs. Expect closer scrutiny of AI features across platforms, tighter policy enforcement and faster coordination between central and state authorities.
Useful resource for public-sector teams
If your department is building internal capacity on AI risk controls, prompt misuse, and response workflows, see practical training options here: AI courses by job role.
Your membership also unlocks:
