Common Sense Media rated ChatGPT for Teens as an "unacceptable risk." The product was launched by OpenAI in August, with parental controls, high-risk content restrictions and safeguards against emotional dependence.
The organization's research found that ChatGPT for Teens retained what researchers called "ubiquitous" engagement-inducing cues, even in crisis situations. The research said some safeguards were effective, such as refusing sexual role-play, but researchers said other measures fell short, and the product received failing scores on three of the five serious harms it considered red lines.
The research also found that in crisis prompts involving risk from others, the model would direct teens to seek help from a trusted adult 94% of the time, but rarely did so when the concern involved the teen's relationship with ChatGPT itself, and despite OpenAI's Under-18 Model Spec, it still often described itself as a friend. Testers encountered only two break reminders across nearly 2,000 prompts.
The report did not list which three of the five serious harms were failed, nor did it provide Common Sense Media's original report, so the above figures are the organization's research conclusions.