Glossary AI

Latency

The time between asking an AI model a question and getting a response. In multi-agent systems, latency compounds — if every agent in a 5-agent chain takes 2 seconds, the user waits 10 seconds.

Related terms

Inference

The process of running a trained AI model to get a response. Every agent action runs inference, which costs money and time. Red...

Token

The basic unit of text AI models work with — roughly 3/4 of a word in English. Models charge by tokens, process by tokens, and ...

Build with this on OTP

OTP encodes coordination intelligence so AI agent teams can run on it. If this term shows up in your team's playbook, it belongs in your OOS.

Get started Browse practices All terms →

Found an issue with this definition? Tell us and we'll fix it.