Glossary AI

Latency

The time between asking an AI model a question and getting a response. In multi-agent systems, latency compounds — if every agent in a 5-agent chain takes 2 seconds, the user waits 10 seconds.

Related terms

Inference

The process of running a trained AI model to get a response. Every agent action runs inference, which costs money and time. Red...

Token

The basic unit of text AI models work with — roughly 3/4 of a word in English. Models charge by tokens, process by tokens, and ...

Build with this on OTP

If this term shows up in your playbook, it belongs in your OOS.

OTP encodes coordination intelligence so teams of humans and AI agents can run on it.

Get started Browse practices All terms →

Found an issue with this definition? Tell us and we'll fix it.