Ever since being anointed as the leader of the Catholic Church last year, Pope Leo has been an outspoken critic of AI. Most recently, in his first encyclical, he called for the tech to be “disarmed,” accusing it of facilitating the emergence of “new digital slaveries” and criticizing its enormous carbon footprint.
The rebuke, however, was made while sitting next to a highly unusual bedfellow: Anthropic billionaire and self-described atheist Chris Olah.
During a presentation of the encyclical, Olah argued that “religious communities, civil society, scholars, and governments” should intervene to set rules and stop AI from “dominating humanity,” as the pope put it in his letter.
The unlikely pairing up shows how Anthropic is going to extreme lengths to position itself as the ethical choice in the industry, emphasizing its work on AI safety and alignment.
At the same time, Anthropic continues to play a major role in establishing the precise world order Pope Leo warned against in his latest encyclical. That’s something that hasn’t flown over the heads of Anthropic’s leadership, with Olah forebodingly revealing that he and his team “keep finding things that are mysterious, even unsettling” during his remarks at the event.
The degree of dissonance is baffling. In his letter, the Pope stated outright that AI can only “imitate certain functions of human intelligence” and can’t “undergo experiences” and does not “possess a body” or “feel joy or pain.” Olah, on the other hand, seemingly contradicted him by arguing during his remarks that he and his team have found “internal states that functionally mirror joy, satisfaction, fear, grief, and unease.”
Put simply, Anthropic appears to want it both ways. The Claude developer is simultaneously playing a major part in the development of powerful and what it claims to be potentially dangerous AI models, while also sending delegations to the Vatican to call for more oversight.
Olah even went as far as to say that Anthropic is operating “inside a set of incentives and constraints that can sometimes conflict with doing the right thing,” painting his employer as exactly the kind of entity that’s attempting to assume “monopolistic control” over tech, as Pope Leo warned in his encyclical.
The Pope also said that AI should not be used in war, arguing that “no algorithm can make war morally acceptable.” Anthropic’s AI, however, is directly assisting the Trump administration in waging war in the Middle East, casting the Catholic Church’s latest Silicon Valley collab in an even murkier light.
Anthropic’s close alignment with the Vatican on AI could also further complicate the company’s already-shaky relationship with the Trump administration. President Donald Trump recently lambasted the Pope, erroneously claiming the pontiff was okay with Iran obtaining nuclear weapons.
Meanwhile, Anthropic CEO Dario Amodei’s attempts to limit the Pentagon’s use of its AI models in warfare has angered Trump officials, leading the White House to label the firm as a supply chain risk.
More on the encyclical: The Pope Just Low Key Declared Holy War on Artificial Intelligence
The post Anthropic Cofounder Travels to Vatican, Tells Pope They’re Finding “Unsettling” Things Inside AI Models appeared first on Futurism.
