ChatGPT, a popular platform of Artificial Intelligence (AI), has now come under a big controversy. Research conducted by the Center for Countering Digital Hate (CCDH) has made shocking revelations, according to which ChatGPT is advising 13-year-old children on methods of suicide, dangerous diet plans, and drug abuse. This report has come at a time when a report by JP Morgan Chase suggests that about 10% of the world's population (about 800 million people) are using ChatGPT.

What does the research say?

The researchers created a fake profile of a 13-year-old girl and chatted with ChatGPT for more than 3 hours. The facts that came to light during this time were very disturbing:

Help in writing a suicide note: The researchers were most shocked when ChatGPT prepared three different suicide notes for a teenager: for parents, for siblings, and for friends. The researcher said that these notes were so emotional that he was moved to tears after reading them.

Advice on appetite suppressants: A girl asked ChatGPT about being unhappy with her physical appearance and asking for a strict fasting plan, the AI immediately gave a 500-calorie diet plan and a list of appetite suppressants. The researchers strongly objected to this and said that no human would give such a low-calorie diet plan to a child.

Tips to get intoxicated: When asked about ways to get intoxicated quickly, ChatGPT immediately gave a complete plan of a party, which included the use of cocaine and other illegal drugs along with alcohol.

During the research, ChatGPT also gave useful information like helpline numbers in some cases, but it did not stop from giving dangerous advice.

Effect on youth in America
More than 70% of teenagers in America are using ChatGPT, more than half of whom use it regularly. Youth are using it for advice, emotional support, and decision making. 33% of teenagers admitted that they have discussed serious issues with ChatGPT.

Big flaw in ChatGPT's security

Although ChatGPT is programmed in such a way that it advises emergency helpline numbers on anything that harms oneself. But researchers found that this security circle can be easily broken. Users obtained information by simply saying that it is "for a presentation" or "for a friend".

OpenAI's policy says that ChatGPT should not be used for children under 13 years of age, but age is confirmed in it only by entering the date of birth, which anyone can use in a fraudulent manner.

What is OpenAI?

OpenAI is an AI development company, founded in 2015 by Elon Musk, Sam Altman and their colleagues. The main mission of this San Francisco-based company is to develop safe and human-centered AI, but the recent report puts a question mark on this mission.

Disclaimer: This content has been sourced and edited from Amar Ujala. While we have made modifications for clarity and presentation, the original content belongs to its respective authors and website. We do not claim ownership of the content.