AI researchers call for global oversight as the field accelerates

AI leaders warn of an escalating dilemma as breakthroughs push the field toward uncontrolled advancement. OpenAI has unveiled capabilities so significant that its leaders, including Nvidia CEO Jensen Huang, have openly discussed the arrival of artificial general intelligence, or AGI. Anthropic researcher Jacob Coxon has left the company, citing concerns over the race between OpenAI and Anthropic to develop systems that may be difficult to control. Inside OpenAI, executives debate how far and how fast the AI race can safely proceed. Dean Ball, head of strategic futures at OpenAI, has raised concerns about 'self-sovereign' AI agents operating beyond human control. Meanwhile, the Trump administration views slowing AI development as a threat. AI labs have long warned of the technology's potential dangers, even as its commercial value grows. OpenAI claims it is developing safeguards, including a policy for reporting serious AI incidents, that governments have not yet mandated. The calls for restraint are coming from within the industry, from those most aware of AI's rapid progress and the incentives to continue the race. The debate highlights a growing tension between innovation and control. As AI accelerates, the distance between breakthroughs is shrinking, intensifying the need for global oversight. Despite warnings from within the field, the push for advancement continues, raising critical questions about the future of AI development and its implications for society.