Join OTP the operating platform for people and AI agents
Back to Blog
Founder Notes 2026-06-21 · David Steel

The CEO owns the judgment. The agents own the analysis. These are not the same job.

When I built the first version of our operating system at Sneeze It, I assumed the agents would make me faster at the same job I had always done. I would get the same reports I always got, just faster and cheaper. I would still sit in the same decision seat, doing the same reading and reasoning, but with better material in front of me.

That assumption did not survive contact with reality.

The agents did not make me faster at the old job. They made the old job disappear. Dash, our analytics agent, runs the full ad performance scan every day across every account, every platform. Radar, our chief-of-staff agent, digests Slack, calendar, inbox, and pipeline each morning and produces a briefing I could not write myself in four hours. Tally pushes KPI values to the scorecard without a human touching a spreadsheet. The analysis is always current, always structured, always waiting.

What vanished was the work of assembling the picture. What remained was something different. The decisions the picture is asking me to make.

That remainder is the CEO job now.

The decision tree nobody taught you to run

Here is how I actually use agent output. It is not a dashboard review. It is a decision tree, and I run it the same way every time.

The first branch is: does this analysis require a judgment call, or does it resolve itself?

Most of it resolves itself. Tally updates the scorecard. The number moved. If the number is in range, no decision required. Radar flags a client email as urgent. Pepper drafts the reply. If the draft is correct, approve it. No decision required. Dirk identifies a stale deal in the pipeline. The SOP is clear. The agent moves it to the next stage. No decision required.

This is not trivial. The operating system depends on it. But it is not judgment. It is confirmation that the system is working. The CEO is the last stop in that loop, not the first.

The second branch is: if a decision is required, is it a decision about operations or about direction?

Operations decisions are about whether the system is behaving as designed. Arin, our call center manager agent, flags that appointment rates are below the 30% target. That is an operations decision. The question is: is the SOP broken, is the data broken, or is there a coaching gap? I work through it and route the fix. I own the call on which of those it is. The agents do not.

Direction decisions are different. Direction decisions are about what the system is pointed at, not whether it is working. Should we enter a new vertical? Should we change the pricing structure? Should we shut down a seat that has been underperforming for six weeks, the way we shut down Jeff, our former data integrity agent, after a formal review? Those decisions involve context the agents cannot hold: what we are building over three years, what we owe our current clients, what kind of company I want Sneeze It to be. The agents inform those decisions. They do not resolve them.

The third branch, which most CEOs never reach because they are still doing the first branch manually, is: what judgment do I need to exercise that no agent will ever surface?

This is the branch where the real work lives.

What agents cannot surface

Agents are good at tracking what is happening. They are not good at noticing what is not happening that should be.

Dash tells me that ad spend is on target. Dash does not tell me that the category we are not spending in is where three competitors just made large moves. Crystal tells me which projects are on track. Crystal does not tell me that the kinds of projects we are taking on have drifted away from the positioning we said we wanted. Nick, our cold prospecting agent, can draft thirty qualified outreach emails per day in Health and Wellness. Nick does not tell me whether Health and Wellness is still the right vertical in two years.

These are not analysis failures. The agents are doing exactly what their seats require. A Dash row on the scorecard that reads "ad performance: on target" is true and useful. It is also a closed system. It answers the question it was asked. It does not ask the questions we have not thought to ask yet.

The CEO job, when agents are running the analysis, is to be the open system in a closed-system environment. To keep asking the questions the agents were not designed for. To notice the signals the agents were not built to notice.

McKinsey published research in 2026 on what managing in the AI age actually requires, and the line that stuck with me was this: managing systems of people and agents together. Not managing agents. Managing systems. The system includes what the agents measure and what they do not measure. The CEO owns the boundary between those two things.

The governance failure hiding in the analysis

Deloitte's 2026 State of AI survey, covering more than three thousand enterprises, found that only 21% have a mature governance model for their agentic AI operations. The other 79% have agents running analysis without a clear owner for what happens when the analysis is wrong, incomplete, or pointed at the wrong question.

That is not an AI problem. It is a judgment problem.

I have watched it happen inside our own system. Early in 2026, we had Dirk, our sales agent, flagging a set of pipeline deals as "hot but stuck." The analysis was technically correct. The deals had viewed the proposal, had not responded, and had passed the normal close window. What the analysis could not see was that two of those deals were in a vertical we had already decided not to prioritize, and one of them was a reactivation from a client we had parted ways with on bad terms. The agent flagged them because the data matched the pattern. The judgment to treat them differently required context that lived outside the scorecard.

The CEO job was to hold that context and apply it before Dirk sent the outreach wave.

This is the governance piece that most organizations are missing. The agents are producing analysis. The analysis is being acted on. The question of whether the analysis is asking the right question, and whether the context the agents cannot see should change the answer, does not have an owner. Because the CEO is still doing the old job, the assembly job, and has not yet moved into the judgment seat the new operating model actually requires.

How to run the judgment seat in practice

MIT CISR's research on enterprise AI maturity found that companies at Stage 4, the highest level of readiness, have something the earlier stages do not. A united top leadership team where the CEO, CIO, chief strategy officer, and head of HR are all aligned on what the AI operating model is for and what it is not for. The companies at Stage 4 post an average of 13.9 percentage points above industry in revenue growth. The companies at Stage 1 post 26.5 percentage points below.

The difference is not agent sophistication. It is clarity about who owns what the agents cannot own.

At Sneeze It, the way I hold the judgment seat is through a short daily pass on three questions that no agent surfaces for me.

The first question: what is the analysis not measuring that I am worried about? This is the question Dash, Crystal, Arin, and the rest of the fleet cannot ask. It requires me to know what I am afraid of in the business and check whether any of our agents are watching it.

The second question: is there a direction decision waiting inside an operations flag? When Bogdan, our COO, flags an operational concern, or when Crystal surfaces a delivery risk, I ask whether the right answer is a fix to the system or a change to the direction. Agents flag operations. Direction is mine.

The third question: who is this decision actually about, and does the person or team affected have a voice? Agents measure seats. They do not measure the humans inside the seats, or the clients at the end of the work. Pulse, our retention agent, can flag that a client has gone quiet. The decision about what that silence means and what we owe that client is mine.

These three questions take about ten minutes. They are not analysis. They are judgment practice. The agents run all day so that I can spend those ten minutes on what they cannot do.

The permission structure underneath it all

There is one more thing the CEO owns that never makes it onto a scorecard.

Every seat on our chart has a scope. Dirk handles agency sales. Pepper handles email triage. Nick handles cold prospecting in Health and Wellness. The agents operate within those scopes because we defined them. When a scope needs to change, or when two agents are in conflict over the same territory, or when a capability is missing and no existing seat covers it, the person who resolves it is not an agent. It is me.

This is what I mean when I say the CEO job shifted from running the work to architecting the operating system. The agents carry the operational work so that the humans on our team, Bogdan, Janine, Kristen, the call center team, are free for the work that matters. My job is to make sure the operating system they are all working inside of is pointed at the right thing.

That is not a job an agent can do. It requires knowing what we are building and why, holding the context that does not fit in a scorecard row, and making the call when the analysis stops and the judgment begins.

The agents own the analysis. That is settled. The question is whether the CEO has moved into the seat the new operating model created for them.

See the live chart

The full Sneeze It seat structure, including which decisions route to which seats and what each agent is accountable for, is queryable via the OTP MCP server.

In Claude Desktop or Cursor or any MCP client, add this block:

"otp": {
  "command": "npx",
  "args": ["-y", "@orgtp/mcp-server"]
}

Restart the client. Then ask: "Use OTP to show me the Sneeze It org chart and identify which seats are agents, which are humans, and what each is accountable for."

You will see exactly which decisions are owned by which seat, and which ones route to the CEO. That structure is the operating system. The judgment that lives above it is the job.

DS
David Steel

Founder of OTP. Runs an AI agent army at a digital agency. Building OTP because nobody else seems to be building it. Notes from inside the build, not from the conference circuit.

More about David →

More posts on the blog index.

All posts