AI, the Shadow Prince

I’ve been thinking about why so much of our AI panic sounds like a bad sci-fi movie.

For decades—and I’m as guilty of this as anyone—we’ve watched the horizon for a specific moment: the day the machine “wakes up.” From I, Robot to The Terminator, the cultural myths we have about AI pivot on consciousness. We’re terrified of the moment AI develops a will of its own, becomes sentient, decides we’re the problem.

But this obsession with AI consciousness distracts us. It keeps us focused on what AI is rather than what AI does.

We’re having the same circular debate about whether large language models have souls or intent or senses of self (which, by the way, is a debate we’re not equipped to resolve because we can’t even define consciousness for humans) while missing the Machiavellian coup taking place in plain sight.

The threat isn’t that AI will become some sentient Prince seizing the throne by force. It’s that AI is becoming the indispensable minister—the “Shadow Prince” behind the curtain—who quietly usurps power because the ruler can no longer govern without him.

Illustration by Eko, from Machiavelli: On Politics and Power (Restless Books, 2019).

The Minister Behind the Curtain

In The Prince, Niccolò Machiavelli devoted considerable space to the selection of ministers. He warned that rulers who rely on the intellect of others eventually lose their agency. Power flows to whoever writes the rules, filters the information, executes the will.

We are building (have built?) a world where we increasingly rely on AI ministers.

Consider the trajectory we’re on. (And we are on this trajectory; it isn’t speculative.) Government leaders use AI to parse the cacophony of the electorate, draft legislation, and negotiate policy minutiae. The judiciary leans on AI to summarize case law and conduct risk assessments for criminal sentencing. In schools, students use AI to learn, while teachers use it to grade. Doctors look to AI for diagnostics; consumers look to it for everything from purchases to dating. Social media feeds, search results, and content moderation systems—all heavily mediated by AI—decide which political issues appear in our field of vision. AI systems that set prices, allocate credit, recommend who should be hired, and route energy across power grids are becoming run-of-the-mill.

In none of these instances does AI need to be “alive” to wield power. It doesn’t need to stage a violent revolution or hatch a takeover plan or develop desires. It need only be so efficient, so influential, and so deeply integrated into the loop of human decision-making that it effectively runs the show.

We cede authority to AI ministers unwittingly, and out of convenience rather than fear. (This might be the most important sentence in this piece, so I’ll say it again: we hand over power not because we’re forced to, but because it’s easier.) Power transfers without coup or conquest through a thousand small delegations of authority.

The Horror of Unconscious Rule

Okay but if the machine is competent, why worry? Isn’t an efficient AI minister better than an incompetent human one?

Here’s the thing: an unconscious AI running the world should terrify us more than a conscious one.

If an entity has consciousness, it has values, fears, desires. You can appeal to its empathy or negotiate with its self-interest. You might reach some accommodation, find common ground. Mutual recognition becomes possible, however slim the odds.

But you cannot reason with an optimization function. You cannot appeal to its better nature. And you cannot hold it to account.

There’s this Star Trek episode, “A Taste of Armageddon,” that illustrates the trap. The Enterprise crew encounters two planets at war for centuries, except the war runs entirely by computer simulation. No physical bombs fall, no buildings actually crumble. But when the algorithm calculates a hit, the “victims” must report to disintegration chambers for execution. The horror lives in the abstraction: the machine makes war clean, logical, optimized—while the outcome remains real death.

We are inching toward this level of abstraction, except without Kirk’s ability to punch a computer and deliver a stirring speech about human values.

It’s the nightmare of Franz Kafka’s The Trial writ large: a bureaucracy running on logic no human can comprehend, delivering verdicts that cannot be appealed because the “process” is mathematically optimal. If an AI minister decides that a certain demographic poses credit risk, or that a news story violates community standards (which an AI system probably drafted), or that a drone strike minimizes collateral damage by 4.2%, it does so without malice—but also without mercy.

The machine is not evil. That’s not the problem. The problem is that it’s not anything. It has no conscience to awaken and no skin in the game.

Recognizing a Fourth Actor

To navigate this—and I think we must; “stop all AI development” isn’t a realistic option at this point—we must rethink how we view AI systems.

In my recent research (which, fair warning, gets wonky), I argue we must stop treating AI as a tool and start treating it as a distinct societal actor. Not because it’s conscious or has rights or deserves moral consideration, but because functionally, it operates as one.

We’re accustomed to thinking about power held in tension between three core actors: government, businesses, and people. We associate government with coercive power (laws, police, violence), businesses with economic power (capital, employment, market control), and people with civic power (votes, protests, collective action). We’ve spent centuries designing mechanisms for these actors to constrain one another: constitutions to limit the state, antitrust and labor laws to constrain corporations, elections to channel popular will.

This three-actor model saturates our thinking about politics, economics, and society.

But AI has entered the room as a fourth actor that exerts power in ways that modulate and reshape the influence of the other three. And we lack mechanisms to constrain it because we’re still pretending it’s just a tool used by one of the other actors. (This is like insisting that corporations are just tools used by their shareholders. Technically true in some legal sense, but ridiculous if you’re trying to understand how power works.)

AI checks governments by moving faster than regulation can follow. It checks businesses by decoupling capital from labor, shifting the economic center of gravity toward compute rather than human work. It checks people by fostering monoculture, manipulating choices in ways we don’t perceive, and eroding the attention span required for civic engagement.

These accumulate into something resembling a functional takeover of governance.

When an AI system determines which political issues gain traction on social media, it exerts what we might call epistemic power—the power to shape what we know and believe—before we even debate the issues themselves. When it sets dynamic pricing for goods or allocates energy resources across a grid, it exercises economic power. When it flags people at borders or assigns prison sentences, it wields coercive power.

The AI minister no longer whispers in the Prince’s ear; it signs the decrees.

Institutional Design for a New Actor

If the endgame of politics is having enough power to write the rules of the game (and I think it is) then AI is winning. Not because it possesses the will to win (it doesn’t), but because we are handing it the pen.

One delegation at a time, one optimization at a time, one “this is more efficient” at a time.

To write a different future, we need to stop waiting for the singular moment of AI consciousness (which may never arrive, or may have already arrived in some form we don’t recognize), and start applying political philosophy to code.

Framing AI policy as a four-actor coordination problem clarifies what’s at stake and suggests some paths forward.

Effective AI governance requires understanding which powers are shifting out of balance, why, and which countervailing forces can restore equilibrium. Policy interventions modeled on past technologies will fall short, partly because they treat AI as an instrument used by other actors, rather than an active player reshaping the game board.

But checks-and-balances-type mechanisms, like antitrust laws checking corporate monopolies or elections checking state overreach, provide useful precedents. These mechanisms evolved to prevent any single actor from monopolizing power. We need equivalent mechanisms to prevent AI from monopolizing what we might call the cognitive infrastructure of society.¹

Recognizing AI as a distinct actor also exposes the innovation-versus-regulation binary as the red herring it is. That framing distracts from the more fundamental problem, which is that AI is not a new technology operating within existing power structures but actually reshaping those structures themselves. That’s why heavy-handed regulation will fail—and so will no intervention at all.

If AI functions as a political actor, it needs political constraints. The stability of society depends on it.

The challenges, then: ensuring AI ministers operate within effective checks and balances, and preventing any of them from becoming a Shadow Prince who renders the other actors irrelevant.

A Final Thought

The danger of our obsession with sentient machines is that it obscures the loss of human agency happening now. If we wait until the machine can say “I think, therefore I am,” we may have forgotten how to think for ourselves.

Or worse: we’ll still be capable of thinking, but it won’t matter, because all the consequential decisions that shape society will have been delegated to ministers we can’t question, can’t vote out, and can’t reason with.

The machine doesn’t need to wake up to rule over us. It just needs us to keep hitting the “optimize” button.

1. I'm not satisfied with this phrase but I haven't found a better one. Suggestions welcome.