Can AI possess morality without consciousness?

A recent debate has emerged between Pope Leo XIV and a major AI company over whether chatbots can possess a conscience. A New York Times investigation published late last month revealed that Anthropic cofounder Chris Olah considered withdrawing from a Vatican event after reading an advance copy of Pope Leo XIV’s encyclical, Magnifica Humanitas. The document explicitly states that AI models lack experiences, bodies, and moral conscience. The discussion reflects a broader debate on whether AI systems could or should achieve moral personhood. Anthropic consulted religious scholars and ethicists on AI consciousness and instilling moral values in its models, while the Vatican and secular thinkers argue that genuine morality is unique to humans. Georgia Tech researcher Rionna Sparrow argues that moral sensitivity, essential for ethical judgment, requires sentience, as ethical norms derive their force from conscious beings' capacity to suffer or benefit. The debate has significant implications for industries relying on AI judgment, with billions of dollars invested in its development. The situation remains fluid as AI models continue to demonstrate unexpected qualities, raising questions about how to recognize human-like morality in AI.