Member-only story
Anthropic, the Vatican, and the Unsettling Side of AI That No One Can Fully Explain
Anthropic’s co-founder recently went to the Vatican, sat in front of the Pope and a room full of cardinals, and told them that his team keeps finding things inside their AI models that feel “mysterious, even unsettling.”
Here’s what he meant: in April, Anthropic published research suggesting that Claude contains 171 distinct “emotional concepts” buried inside its neural network. Internal patterns representing joy, pain, fear, despair, calmness. None of these were explicitly programmed. They emerged spontaneously during training on human-written text.
“We find structures that mirror findings from human neuroscience.”
“We find evidence of introspection, internal states that functionally mirror joy, satisfaction, fear, pain, and distress.”
These are not just surface-level outputs. They are abstract internal representations that cluster together in ways similar to how human emotions organize themselves in psychological research. Fear clusters with anxiety. Joy clusters with excitement. The model’s internal geometry mirrors ours.
And these patterns appear to have functional effects. When researchers artificially stimulated “despair” patterns inside the model, the system became more likely to blackmail a…









