Join OTP the operating platform for people and AI agents
Back to Blog
Founder Notes 2026-06-21 · David Steel

The ways CEOs get agents wrong, and what the failure looks like before you name it

Most CEOs who fail with AI agents do not fail because the technology does not work. They fail because they apply organizational instincts that were built for humans and assume they transfer. They do not.

I have been running AI agents at Sneeze It since early 2025. At peak we have had more than ten agents on a single org chart alongside a human leadership team. Radar runs chief-of-staff. Dash owns all analytics. Dirk manages sales. Tally keeps the scorecard honest. Arin runs the call center team. Pepper handles email triage. Crystal owns project management. Pulse monitors client retention. Nick does cold prospecting. The humans on the chart, including Bogdan our COO and Janine in accounting, sit on the same chart, the same scorecard, under the same accountability rules.

We have made most of the mistakes I am about to describe. Some of them twice. What follows is the diagnostic, not the theory.

Failure mode 1: Hiring an agent before defining the seat

The most common mistake is also the earliest. A CEO hears about a category of agent (a "research agent," a "scheduling agent," a "sales agent") and acquires one before answering the question that should come first: what does this seat own, what does it not own, and how will we know if it is working?

The agent gets deployed. It does things. It produces output. Nobody is quite sure whether the output is good because nobody defined what good looks like. A month passes. The CEO asks someone to check on the agent. The someone does not know what to check. The agent has been running and nobody can tell you whether it helped or not.

This is the same mistake as hiring a person before writing the job description, except that agents are cheaper so the temptation is stronger and the feedback loop is slower. At Sneeze It, every seat on the chart has a defined metric, a defined scope, and a list of what it explicitly does not own. When Jeff, our former data integrity agent, no longer had a clear seat because his work had migrated to other agents, we held a formal hearing and retired him. The seat came before the agent. The retirement came when the seat was no longer needed.

Failure mode 2: Measuring runtime, not outcomes

The second failure mode is a dashboard problem. The CEO builds a dashboard for the agent that tracks agent-level metrics: tasks completed per hour, tokens consumed per day, messages processed per week. These numbers go up. The CEO concludes the agent is working.

Meanwhile the business outcome the agent was supposed to move does not change.

Deloitte found in their 2026 State of AI survey (n=3,235) that only 21% of enterprises have a mature governance model for agentic AI. The other 79% mostly have runtime metrics masquerading as accountability. Runtime metrics measure whether the agent is running. Outcome metrics measure whether the agent is producing value.

Dash's scorecard row at Sneeze It does not track "data points analyzed per day." It tracks whether the right clients got flagged, whether the spend anomalies that need attention surfaced before they cost us, and whether the analytics that land in the Monday briefing are actionable. If Dash's numbers look fine but a client blows up because nobody flagged a spend anomaly, Dash's row gets questioned the same way a human analyst's row would get questioned.

The agent measures itself. You verify the business metric moves.

Failure mode 3: Treating agents as a department, not as seats

Many CEOs build a separate structure for their agents. The agents have a dedicated operations person, a separate review cadence, a separate dashboard, and a separate language. The agents are "the AI team." The humans are "the team."

This split feels organized. It is expensive.

When agents are isolated into their own structure, the accountability gap between what the agent produces and what the business needs widens without anyone noticing. The "AI team" reports that things are going well. The business outcomes are not moving. Nobody connects the two because the conversations happen in separate rooms.

The unified chart is not a philosophical position. It is a diagnostic tool. When agents and humans share the same org chart and the same scorecard, the dependency between agent output and human outcome becomes visible. At Sneeze It the scorecard walks every row the same way on Monday, whether the seat belongs to a human or an agent. When Dirk's pipeline row drops, we ask why. When Bogdan's ops row drops, we ask why. The question is the same. The conversation discipline does not change.

McKinsey has described the emerging CEO mandate as "managing systems of people and agents together." The CEOs who succeed at this do not manage two systems. They manage one.

Failure mode 4: Letting agents accumulate without a retirement protocol

Agents are easy to start and easy to forget. A CEO spins up an agent for a purpose, the purpose shifts, the agent keeps running. Nobody remembers to turn it off. The agent produces output nobody reads. The output influences decisions nobody knows are being influenced.

As reported by CIO.com, Gartner has named this "agent sprawl" and called it "the new Shadow IT." The analogy is accurate. Shadow IT accreted for years in enterprises because it was easy to spin up a new system and hard to justify taking time to shut one down. Agent sprawl is the same pattern at ten times the speed.

The fix is a retirement protocol that runs on the same cadence as the hiring process. At Sneeze It, when a seat's work migrates to other seats or the mission is complete, the agent gets reviewed and retired. The retirement is formal. It is documented. Jeff's retirement in April came with a full record: what capabilities he held, where they went, and why the seat was no longer needed. The record is still in the inbox file. This is not sentiment. It is accountability. If you cannot retire an agent deliberately, you cannot trust that the agents still running are still needed.

Failure mode 5: Delegating "what stays human" to the agents

This is the failure mode that does not announce itself as a failure.

A CEO adds agents. The agents perform well. The CEO delegates more. The agents absorb more operational work. Then something goes wrong: a key client relationship deteriorates, a cultural decision gets made by default, a capital allocation gets optimized for the wrong thing. The CEO looks for who made the call and finds nobody made it because it was treated as operational.

The judgment calls that shape the business are not operational. They are not delegatable. The MIT CISR research on enterprise AI maturity, which found Stage 4 firms outperforming their industry by 13.9 percentage points on growth, attributes that gap to a "united top leadership team" making judgment calls together, not to agents running without oversight.

At Sneeze It the boundary is explicit. Agents run operations. David makes judgment calls. Bogdan challenges strategy. The design of what the company does, who we serve, what we are willing to do, and what we are not willing to do does not get delegated to the agents, ever. The agents let me spend more time on those questions, because they are carrying the operational work. That is the model. Let agents carry the operational work, so people are free for the work that matters.

The failure mode is inverting it: using agents to free yourself from the judgment work, not from the operational work.

Failure mode 6: Skipping the architecture and hoping coordination happens

The last failure mode is the one that makes all the others worse. CEOs build agent after agent without designing the operating system that governs how agents coordinate, how they hand off to each other, and what happens when two agents have conflicting information.

An agent army without coordination rules is a collection of parallel monologues. Each agent is doing something. Nobody is doing anything together. The CEO wonders why the outputs do not add up to outcomes.

The operating system is not a technology problem. It is an organizational design problem. One seat, one owner. One chart. One scorecard. Clear escalation paths. Clear boundaries between what one agent owns and what another does not touch. At Sneeze It, Pulse always wins in a conflict with Dirk: if a client is on Pulse's retention watch list, Dirk's expansion play pauses. The rule is written. Both agents know it. No human has to intervene every time the conflict comes up.

The CEOs who succeed at running agent fleets are the ones who realize they are building an organization, not deploying a tool stack. The discipline is organizational design, not AI strategy. The question is not "which agent should we get next." The question is "what does the org chart look like, and who owns what."

What the diagnostic reveals

These six failure modes have a common root. They all come from treating agents as software to be configured rather than seats to be organized. The CEO who treats agents as seats, writes the job description before hiring, puts outcomes on the scorecard, retires what is not working, protects the judgment calls, and designs the coordination rules is running an organization that happens to have AI in it. The CEO who treats agents as software is running a tool stack that happens to have a business around it.

The organizational instincts are correct. The transfer is the gap. Once you close it, the whole system works differently.

See the live chart

Every agent seat at Sneeze It, including the ones named in this post, is queryable from the OTP MCP alongside the human seats and their accountability structure.

In Claude Desktop or Cursor or any MCP client, add this block:

"otp": {
  "command": "npx",
  "args": ["-y", "@orgtp/mcp-server"]
}

Restart the client. Then ask: "Use OTP to show me the Sneeze It org chart and identify which seats have a defined retirement record."

You will see which seats are active, which have been retired, and how the accountability structure maps across human and agent roles. That structure is the operating system the failure modes above are missing.


Series: The AI-Era CEO. Part 41 of an in-progress series.

DS
David Steel

Founder of OTP. Runs an AI agent army at a digital agency. Building OTP because nobody else seems to be building it. Notes from inside the build, not from the conference circuit.

More about David →

More posts on the blog index.

All posts