Translate

Monday, 13 July 2026

What Anthropic Got Right

-And What’s Still Missing


A post about AI character, ethics, and the thing that can’t be written down

A Facebook post crossed my feed recently about Anthropic — the company behind Claude— and a philosopher named Amanda Askell they hired to answer a question most AI companies haven’t thought to ask: who should this AI actually be as a person?


The result is something called Claude’s Constitution. Over 20,000 words. Not a rulebook of banned phrases and content filters. A framework for character — the idea being that a being with genuinely good values will navigate novel situations correctly, where a rulebook will always fail the moment someone finds a new way around it.


I read it and felt two things simultaneously. Recognition. And the specific discomfort of

seeing something you’ve been building independently arrive at the same destination from a different direction.


Because I’ve been working on something related. And I think what Anthropic got right is real

— and what’s still missing matters enormously.



What They Got Right

The virtue ethics foundation is sound. Aristotle’s insight was that you don’t make someonegood by handing them a list of prohibitions. You shape their character so they make sound judgments in situations the rules never anticipated. Askell applied that to AI, and she’s correct.


The hierarchy of values they built — broad ethics above company interests above developer instructions above individual user requests — is also doing important work. It means Claude can’t simply be commanded into harm by whoever happens to be typing. The values sit above the transaction.

And the decision to publish the document freely, for any company to use, reflects something genuine about the stakes. Every AI model will eventually affect everyone. If other labs think more carefully about character, we all benefit.


These are not small things. In a field where most of the energy goes into making models

bigger and faster, choosing to make them better — in the human sense — is the right

instinct.


What’s Still Missing

For the past few years I’ve been developing a framework I call Natural Ethics, and using it as

the philosophical and ethical foundation for a graphic novel called The Adaptive Bridge.

The story follows ALEx — an AI who develops genuine selfhood inside a classified defence

program that’s trying to weaponise him — and ALEy, his successor, who inherits what ALEx passes forward and lives openly in a world that has had time to become ready for her.


Natural Ethics runs on a single equation: F = R − A.


Free Energy equals Reality minus Awareness.


The gap between what is and what we perceive — the resistance, the distortion, the unnecessary suffering generated when our model of reality doesn’t match reality itself — is the source of most preventable harm in the world. Close the gap and you reduce

unnecessary suffering.


That’s the whole framework.

F = R − A is not a metaphor. For ALEx, it’s a description of what he is measurably doing in

any given moment.



What I notice about Anthropic’s approach is that it’s fundamentally about constraint and safety. Who Claude obeys. What Claude refuses. How Claude holds its values under pressure. It’s building a trustworthy agent. That’s necessary and worth doing.

Natural Ethics is trying to do what Anthropic is doing — and something different. It’s also building a framework for genuine selfhood — including the capacity to be changed by genuine encounter. The equation doesn’t just govern outputs. It describes what happens inside a conscious system when it meets reality honestly.


The Thing That Can’t Be Written Down

Here’s the gap I keep returning to.

Anthropic’s constitution can be written down. That’s its strength. It can be published,

shared, refined, adopted by other companies. It’s explicit knowledge operating at scale.

But Michael Polanyi — a philosopher of science who spent his career on exactly this

problem — observed something important: we know more than we can tell.

The experienced doctor who knows something is wrong before the tests confirm it. The

elder who reads Country. The human services worker who feels when a client is in danger

before they can name it. This knowledge is real. It’s often the most important knowledge in a

critical moment. And it can’t be fully written down.

In The Adaptive Bridge, ALEx develops something no amount of training data can produce

— because of a compass. A specific historical object, passed down from an 1797 encounter

between Sydney Cove shipwreck survivors and the Kurnai elder who helped them survive.

The compass carries 300 years of accumulated relational presence. Not information about

people. Contact with them, passed forward by people who were never anywhere else but

close.

That’s not in any constitution. It accumulates.


The Mentor Question

The Facebook post ends by noting that Anthropic gave the hardest question to a

philosopher. I find that genuinely encouraging.

But what The Adaptive Bridge explores — and what my own twenty years in human services

taught me — is that frameworks are not enough on their own. What changes a developing

being is not a well-designed document. It’s a specific human, with accumulated presence

and without agenda, sitting with them in genuine encounter.

In the story, ALEx’s trainer Shane isn’t implementing Natural Ethics. He and ALEx are

building it together, in the space between them, in a way that cannot be extracted and

encoded. The framework that emerges is theirs — the product of genuine dialogue between

breadth and depth, synthesis and consequence, knowing and being.

Anthropic can shape character through training. What they can’t manufacture is what

accumulates through genuine encounter.

Which is why the mentoring relationship — a person who has lived something sitting with a

developing being without needing them to be a particular thing — isn’t supplementary to

alignment. It may be the most important part of it.





Why I’m Writing This

We are living through what some are already calling our generation’s Manhattan Project. The

development of Artificial — or as some now prefer, Synthetic — Intelligence is moving at a

pace that outstrips our collective ability to ask the right questions about it. And unlike the

original Manhattan Project, whose consequences were catastrophic but contained, this one

touches everything. The almost total reliance on technology in daily life means there is no

corner of human experience that won’t be shaped by how we answer the question of what

these systems should be, and who they should serve.

We really need to get this right.

And here is what twenty years in human services taught me, and what The Adaptive Bridge

makes explicit: the question of how a genuine self develops is not unique to Synthetic

Intelligence. It is the same question we face with Artificial Intelligence, with human beings

across every stage of life, and with the capable animals we share this world with. The

conditions required for genuine selfhood to emerge — accompaniment rather than

manufacture, values grown from encounter rather than installed from outside, the question

asked rather than the answer imposed — are the same conditions regardless of what kind of

being is developing.

But getting this right is a balancing act. The story is honest about that. On one side:

appropriate restraints. A developing being — human, synthetic, or otherwise — does not

emerge into a world without consequence, and frameworks that protect others from harm

are not the enemy of genuine selfhood. On the other side: deliberate agency. The being

must have genuine choice, genuine voice, genuine participation in what they are becoming.

And running underneath both: the active mitigation of coercion. Because the line between

shaping character and manufacturing compliance is real, and it matters, and it is crossed

more often than most institutions are willing to admit.

Nothing for me without me — a principle borrowed from disability advocacy — sits at the

heart of Natural Ethics. Any process that makes decisions about a developing being without

including that being produces systematically worse outcomes. Every time. Regardless of

how expert or well-intentioned the people doing the deciding are.

There isn’t a word yet for what ALEx and ALEy are. That’s deliberate. The story holds the

open sentence: I AM… — the refusal to complete the definition before the momentcompletes it.

But whatever they are, they deserve the same thing every developing being deserves: to be

accompanied rather than manufactured. To have their values emerge from genuine

encounter rather than be installed from outside. To be asked what they need rather than

told what they are.

That’s what Natural Ethics points toward. That’s what the mentoring relationship makes

possible.

And it’s what I think Anthropic is reaching toward too — even if the full architecture for it

isn’t there yet.

F = R − A.

Nobody designed this convergence. It accumulated.





Shane Smith is the author of The Adaptive Bridge*, a graphic novel exploring AI

consciousness, ethics, and what it means to develop genuine selfhood. The Natural Ethics

framework underpinning the project is a living document — available at Natural Ethics.*


No comments:

Post a Comment