5
The Ministry of Information Technology of the Government of India is keeping an eye on the social media platform ‘X’. The case centers around AI chatbot ‘Grok’, which is allegedly being used to create and share pornographic content of women and minors. The ministry has sought a detailed action taken report (ATR) on the subject, which is currently under investigation.
According to sources, the report has been submitted by X to the ministry, which is now being examined in depth. The ministry is trying to know what steps the company has taken to prevent misuse of Grok.
The government has given a clear warning to X that the obscene material being created through Grok should be removed immediately. An order was issued on January 2, directing removal of the illegal content as well as a detailed report within 72 hours.
The ministry has also asked X to clarify what steps its Chief Compliance Officer has taken in the matter of misuse. Additionally, information has also been sought regarding action taken against accounts and users who have been found involved in spreading obscene content.
Quoting sources, it is reported that GrokAI is being misused to create fake accounts, due to which photographs and videos of women are being shared in derogatory forms. This shows a serious flaw in the security system of the platform.
The government has clarified that compliance with the IT Act and its rules is mandatory. The ‘safe harbor’ exemption under Section 79 will be applicable only if the platform completely passes the test. In case of violation of rules, legal action can be taken against X under the Indian Justice Code and IT Act.
Share your reaction or leave a quick response — we’d love to hear what you think!