OpenAI is tightening how ChatGPT handles weapons and violence, with the strictest changes aimed at teenagers. In an October 30 announcement, the company said the teen experience will filter more operational detail about weapons and security systems — including in chats that show no sign the user plans to hurt anyone — with deployment expected to begin within weeks.
The existing rules already bar help with planning or carrying out violence and limit assistance that could help teens locate or obtain weapons. The update extends the filter to informational queries: young users can still ask about preventing or de-escalating violence, seek support, or get help connecting with a trusted adult, but the operational how-to layer gets stripped out of the under-18 experience.
Adults will see changes too. When ChatGPT is asked to reconstruct a past mass attack, OpenAI plans to restrict details about the weapons and equipment involved and where they came from, and to limit responses that compare the harm caused across attacks. After ChatGPT has ended multiple conversations because someone appears fixated on violence or serious harm, the company may temporarily pause the account — and it is building notifications that would tell parents when a teen's account is paused for that reason.
Underpinning all of it is a sharper age-prediction system. OpenAI says it now considers signals that emerge as people use the product, and may move users it identifies as teens into the under-18 experience even if they registered as adults.
The announcement lands weeks after Common Sense Media's Youth AI Safety Institute published an October 7 assessment of ChatGPT for Teens that tested more than 4,000 prompts on accounts registered to users aged 13 to 17 and rated the product an "Unacceptable Risk," saying newly created accounts linked to parents received no alerts during tested conversations about suicidal thoughts, self-harm or disordered eating. "A teen can spend an hour talking about self-harm without their parent getting a single alert," said the institute's executive director Tom Siegel. OpenAI told The Associated Press that much of the testing may have begun before parental controls were fully activated, and disputed the findings.
OpenAI also committed to a new accountability cadence: its first Community Safety Report, due in early 2027, will cover the second half of 2026 with updates every six months. That puts the company on something closer to a transparency schedule — voluntary, but public.
The move reflects how chatbot safety has shifted from a compliance chore to a competitive and legal battleground. With state attorneys general actively suing over chatbot harms and kid-safety reviews drawing headlines, the labs that can show measured, dated, externally scrutinized safety work will have an easier time in enterprise procurement and in Washington alike. The open question is whether filtering by predicted age — rather than verified age — survives contact with regulators.
Comments (0)
Log in to join the discussion
Log InNo comments yet