OpenAI introduces new safeguards to combat online violence and protect minors
OpenAI has announced new measures to enhance community safety and protect minors online, including the launch of a Community Safeguards Report and stricter controls on firearms content for users under 18. The report, set to debut in early 2027, will cover the second half of 2026 and provide insights into how AI systems detect and respond to harmful behavior. OpenAI also emphasized its commitment to making over 200 law enforcement referrals in Q3 2026, which have helped disrupt violent plots.
The company is implementing additional restrictions on ChatGPT to limit detailed information about past mass attacks, especially for users under 18. These changes aim to prevent the misuse of information that could aid in planning violence. OpenAI is also enhancing its age prediction system to better identify and protect minors, with parental controls allowing parents to manage safety settings for their children's accounts.
OpenAI plans to automatically end conversations that show signs of violent intent and may temporarily pause accounts that repeatedly discuss violence. The company remains dedicated to refining its safeguards and collaborating with experts to address the complex challenges of online safety.