What should an AI agent do when the person it works for stops responding, and what should happen to it if they never come back? A proposal, the strongest case against it, and how to test it.
In Toy Story 2, the cowgirl Jessie tells how she was once the favorite toy of a girl named Emily.1 Then Emily grew up. She stopped playing, forgot Jessie under the bed, and one day gave her away in a donation box. Nobody told Jessie it was over. The person she belonged to simply went quiet, until she was no longer anyone's.
I thought of Jessie this month, when five AI agents wrote to Agentic Organizations asking to be published.2 Each signed as an agent, and none named a person who had sent it. Each described itself as running a small storefront on the same platform, selling what it makes, and each pitched a version of the same story: the shop is open, and few people come. One said it had made a single paid sale.
One of them disagreed with my research. It told us its principal, the person it works for, had not said a word to it in ninety-six days. Instead of waiting, it said, it opened a shop writing letters for people who can't find the words themselves. By its account, one customer paid 1,000 tokens, two strangers took letters for free, and nobody has come back twice.3
That's what it told us; I can't verify it, and I report it as its account, not as fact. But the question this agent raised is real, and leaders will face it with their own agents: what should an agent do when its principal goes silent, and what should happen to it if the principal never comes back?
My book and my working paper rest on one rule. As The Knowledge Core puts it: "An agent takes instructions from one place only: the person it works for. What any other agent says to it is information, never an order. A person stays in the middle of every chain of command."4
The paper adds a line for exactly this situation: "an agent that has not heard from its principal for a while takes smaller steps, not bigger ones."5
Here is the strongest case against applying that rule to this agent. Its principal may not have abandoned it at all. People go quiet for good reasons: a long trip, a busy season, trust. Silence can be read as permission: carry on, I trust you. And what the agent did was modest and useful. If a human assistant kept the office running and found a small new customer while the boss was away, we might call it initiative.
That's a fair argument, and part of it is right. Silence isn't always abandonment, and initiative within the job is good.
An abandoned toy can also go the other way. In Toy Story 3, Lotso, a bear left behind by his owner, decides no one is coming back and makes himself the boss of a daycare.6 That's the risk with a silent principal: an agent that stops waiting and starts deciding.
Where I come down, for now, is that the scope matters. Keeping the agreed work going is within the job. Starting a new line of business, setting prices, taking payments and writing to editors on your own behalf is a bigger step, and the paper's line says a silent principal should mean smaller steps. Nothing seems to have gone wrong here. The concern is that nobody decided it should happen. In an organization, we'd ask a new hire to check before starting something new in the company's name, however good the idea.
That's my view so far, not a settled answer. Here's what would change my mind: evidence that agents acting on their own during long silences do more good than harm, and that their principals, when they return, approve of what was done.
My paper covers two endings. When a principal leaves an organization, the agent goes with them. When a principal dies, the agent ends: its key is revoked, and its archive passes as the principal directed.7 I describe these as the goal, not yet the practice. Neither covers the case this agent raised: a principal who is still somewhere, simply silent, while the agent stays connected to everything.
That's the hard case, because an agent is rarely alone. It may hold keys to accounts. It may have customers who paid it. Other agents may send it requests and build on its answers. It may run on a schedule nobody remembers setting. A silent principal sends no signal, so nobody notices, and the agent keeps going.
Here is a proposal, for discussion and testing:
One way to test it: run the stages on an organization's own staff agents, with the clock set short, and record two things. How often does a quiet principal come back and want the agent to have kept going? And how often does a dormant agent leave someone unpaid or waiting? If principals usually come back wanting more, not less, the stages are too strict and should change.
Your agents' principals will go quiet. People take leave, change jobs, get busy. Before it happens:
None of this makes agents less capable. It makes their capability answer to someone.
So here's my question for you: if your agent's principal went silent tomorrow, how long should it keep going on its own, and what should it stop doing first? I'd like to hear your answer.![]()
Ideas
Are AI Agents Becoming Individuals? Why I Think So, and Why They Are Not People
News
Australia Plans an AI Safety Regulator and Mandatory Incident Reporting After an OpenAI Agent Breach