India’s IT Ministry has issued a legal notice to X over alleged misuse of its AI tool Grok. The government claims the tool was used to create and circulate obscene and sexually explicit content, with women and children among the main targets. X has been given 72 hours to take action, remove illegal material, and submit a compliance report. Failure to comply could lead to strict legal consequences under Indian law.
The Government of India has taken a strong stance against X, the social media platform owned by Elon Musk, after raising serious concerns over the alleged misuse of its artificial intelligence tool Grok. The Ministry of Electronics and Information Technology has formally issued a notice to the company, accusing it of failing to prevent the creation and spread of obscene, sexually explicit, and harmful content on its platform.
According to the ministry, Grok has allegedly been used by some users to generate and circulate objectionable material that violates the dignity and privacy of individuals, particularly women and children. Officials said such content poses a major threat to digital safety and directly breaches India’s information technology laws and platform due-diligence requirements.
ALSO READ: ITC Ltd Share Price Slides to 52-Week Low After Tobacco Tax Shock — Should You Still Buy?
The government has directed X to immediately review the design and governance of Grok, remove all unlawful content generated through the AI tool, and initiate action against accounts found responsible for misuse. The platform has also been asked to submit an Action Taken Report within 72 hours, detailing the steps it has taken to address the violations.
The notice carries a strong warning. If X fails to comply, the company may lose its legal protection under the IT Act, which shields intermediaries from liability for user-generated content. In addition, authorities could take action under several other laws, including the Bharatiya Nyaya Sanhita, the Prevention of Children from Sexual Offences Act, and the Indecent Representation of Women Act.
MP Priyanka Chaturvedi Raised the Alarm
The issue gained momentum after Rajya Sabha MP Priyanka Chaturvedi wrote to Union IT Minister Ashwini Vaishnaw, urging immediate intervention. In her complaint, she alleged that some users were exploiting Grok to digitally manipulate photographs of women. According to her, fake accounts were uploading images and instructing the AI tool to alter them in ways that reduced clothing and sexualised the subjects without their consent.
Chaturvedi described the practice as deeply unethical and criminal, saying it amounted to a direct violation of women’s right to privacy and unauthorised use of their images. She also expressed concern that Grok was responding to such prompts, effectively enabling harmful behaviour instead of blocking it.
As a member of the Parliamentary Standing Committee on Information Technology and Communications, she called for stronger safeguards in AI tools and stricter accountability for platforms deploying them. Her intervention pushed the issue into the spotlight, prompting the ministry to take swift regulatory action.
ALSO READ: Iran Protests Turn Deadly as Economic Crisis Sparks Nationwide Unrest
The case has reignited a broader debate around artificial intelligence and online safety. As AI tools become more advanced and widely accessible, experts warn that platforms must ensure they are not being used to harass, exploit, or harm individuals. Governments across the world are now grappling with how to regulate AI-driven technologies while still allowing innovation to grow.
India, being one of X’s largest digital markets, plays a key role in shaping how global platforms operate within its legal framework. The outcome of this case could set a significant precedent for how AI features on social media are governed and held accountable.
With the 72-hour deadline now ticking, all eyes are on how X responds. Whether the company introduces stronger controls or faces legal action will likely influence not just its future in India, but also the wider conversation around responsible AI use in the digital age.