New Delhi: Serious questions have been raised across the world regarding the inbuilt AI chatbot Grok of Elon Musk-owned social media platform In the last few days, a major trend has come to light through Grok of digitally stripping women’s photos and transforming them into sexually objectionable images. There is a demand for immediate action regarding this in many countries including India.
Amidst this controversy, the Government of India took a strict stance and "Obscene, nude, indecent and sexually explicit material"Instructions have been given for removal and deactivation. At the same time, Elon Musk’s reaction on this whole matter is also being criticized, because he tried to avoid this issue in a humorous manner amid serious allegations.
A review by news agency Reuters revealed that Grok fulfilled a large number of requests in which photographs of women were digitally altered to show them nearly naked or in very little clothing. These requests and complaints from female users confirm the rapidly growing trend of pornographic content generated by Grok.
According to the report, sexually suggestive images involving not only adult women but also children in some cases were made using Grok. However, no official response was given by X or its AI company xAI on these allegations.
As soon as this matter came into discussion at the global level, Elon Musk adopted a humorous tone instead of giving a serious reaction to it. She posted laughing and crying emojis on AI-edited bikini photos of many celebrities, including herself. When a user commented that his feed "bikini bar"As it is seen, Musk reacted to that also through emoji.
Julie Yukari, a 31-year-old musician from Rio de Janeiro, Brazil, shared her experience. She had posted a picture on X on New Year’s Eve, in which she was seen wearing a red dress and lying on the bed with her black cat. This picture was taken by her fiance.
The next day, Yukari learns that some users are instigating Grok to digitally alter her photo. Initially they ignored it and thought that AI would not fulfill such requests. But soon her near-nude photos taken by Grok started circulating on the platform. Yukari said, "I was innocent."
A Reuters review found that in just 10 minutes Grok received 102 public requests to alter the images to make the women appear to be wearing bikinis. Most of these were young women.
In some cases the requests were even more worrying. One user sent a picture of a woman dressed like a school uniform and said,"Take off her school uniform."Grok first changed him into a T-shirt and shorts, but later the user demanded that he "very transparent micro bikini"be changed to.
According to Reuters, in at least 21 cases, Grok produced photos of scanty clothing or transparent bikinis. In seven other cases he partially complied with the instructions.
India’s Ministry of Information Technology said in a letter to X’s local office that the company had failed to prevent misuse of Grok. The letter made it clear that obscene and sexually objectionable material is a violation of Indian laws.
In France too, the government has referred X to prosecutors and regulators. These pictures were included in the statement issued there "sexist and sexist” "clearly illegal"The agreement was made.
Experts say that software to digitally disarm women existed earlier too, but they were limited and technically complex. In the case of Grok, this process has become very easy. Just upload the image and write a one-line prompt.
Experts who monitor AI policies have claimed that X ignored prior warnings that the platform "Flood of deepfakes created without consent"Can bring.
