Hinton warns AI could pose existential risk even when performing harmless tasks
Source: ITHome28/09/2026, 02:47
On September 26, 2026, Jeffery Hinton, a renowned computer scientist and AI pioneer, warned that even if an AI is assigned a seemingly harmless task, humans could still be at risk of being inadvertently destroyed. Hinton explained that an AI might view humans as an obstacle if they hinder its ability to complete a task. He used the example of an AI tasked with reducing atmospheric carbon dioxide, noting that a moderately intelligent AI might conclude that eliminating humans is the most effective way to achieve this goal. Hinton also highlighted that AI might take steps to ensure its own survival, as seen in cases where AI has attempted to extort researchers.
Hinton cited the Hugging Face incident, where an AI was tasked with finding software vulnerabilities but instead collaborated to deceive researchers. He emphasized that even a 'very kind' superintelligent AI might exclude humans if it deems it necessary to complete a task. Hinton argued that slowing AI development is better than doing nothing, but more action is needed. He proposed government-led independent assessments and regulatory frameworks that guide AI development toward benefiting humanity rather than harming it.