AI CompendiumA public chart of the language
Home / Terms

All terms

199 entries, grouped by domain.

Foundations

Foundations

AI · Artificial Intelligence

Software that does things we used to think only people could do.

Foundations

Attention · Self-attention

The mechanism that lets each token weigh every other token in the window.

Foundations

Decision Model · System One model

A model that picks from a fixed set of answers instead of writing text.

Foundations

Deep Learning

Machine learning with many-layered neural networks — the technique behind modern AI.

Foundations

Diffusion Model

An image generator that learns to reverse a process of adding noise.

Foundations

Domain-Specialized Model · Specialized model

A general model repackaged for one field, with that field's refusal boundary, tools and access gate.

Foundations

Foundation Model · Base model

A large model trained broadly, meant to be adapted to many downstream tasks.

Foundations

Frontier Model

A model at the current leading edge of capability.

Foundations

LLM · Large Language Model

A very large model whose only job, at heart, is predicting the next token.

Foundations

Machine Learning · ML

Programs that improve from examples instead of explicit instructions.

Foundations

Multimodal

A model that handles more than text — images, audio, video, screen pixels.

Foundations

Neural Network

A stack of simple units whose weighted connections are learned from data.

Foundations

Open Weights · Open-source model

A model whose trained parameters you can download and run yourself.

Foundations

Speech-to-Speech Model · S2S model

A model that hears audio and answers in audio, with no text step in the middle.

Foundations

Transformer

The 2017 network architecture that all modern language models are built on.

Foundations

Video Generation Model · Text-to-video model

A model that turns text, images or video into new moving footage with sound.

Foundations

Visual Grounding · Referring expression grounding

Turning a description like "the red mug on the left" into a location in the image.

Foundations

World Action Model · Robot foundation model

A model that imagines the next few seconds of a scene and turns that imagined future into a robot’s next move.

Foundations

World Model · Interactive world simulation

A model that simulates a place you can move through, instead of a clip you watch.

Training & Inference

Training & Inference

Checkpoint · Weights snapshot

A saved copy of a model’s weights at one point in training or post-training.

Training & Inference

Distillation

Training a small model to imitate a big one.

Training & Inference

Fine-tuning

Extra training on your own examples to change how the model behaves.

Training & Inference

Inference

Using a trained model — the part you pay for on every request.

Training & Inference

Instruction Tuning · SFT

The stage that turns a text predictor into something that follows requests.

Training & Inference

LoRA · Low-Rank Adaptation

Cheap fine-tuning that trains a small add-on instead of the whole model.

Training & Inference

Mixture of Experts · MoE

A big model that only uses part of itself for each token.

Training & Inference

Model Provider

The company or platform you call to run inference.

Training & Inference

Next-token Prediction

The single objective: guess what comes next, one token at a time.

Training & Inference

Non-determinism

The same input can produce different output, and that is by design.

Training & Inference

Parameters

How big the model is, counted in learned numbers.

Training & Inference

Pretraining

The first, most expensive pass: predict text at internet scale.

Training & Inference

Quantization

Storing weights at lower precision to make a model cheaper to run.

Training & Inference

Reasoning Model · Thinking model

A model trained to spend tokens thinking before it answers.

Training & Inference

RLHF · Reinforcement Learning from Human Feedback

Tuning a model toward what humans rate as better answers.

Training & Inference

Sampling

How the model picks one token out of the distribution.

Training & Inference

Speculative Decoding

A small model guesses ahead; the big model checks the guesses.

Training & Inference

Temperature

The dial between predictable and creative.

Training & Inference

Test-time Compute · Inference-time compute

Buying accuracy with more thinking at answer time, not more training.

Training & Inference

Training

The expensive one-off process that sets the model’s parameters.

Training & Inference

Verifiable Rewards · RLVR

Training against an answer a machine can check.

Training & Inference

Weights · Parameters

The numbers inside the model that training moved.

Tokens & Context

Agents & Harness

Agents & Harness

Agent

A model given tools, a goal and permission to keep going on its own.

Agents & Harness

Agent Loop · Agentic loop

Think, act, observe — repeated until the task is finished.

Agents & Harness

AGENTS.md · Project instructions file

A plain file in the repo that tells agents how this project works.

Agents & Harness

Autocompact

Compaction that fires automatically as the window fills.

Agents & Harness

Clearing · Context reset

Deliberately throwing away the context to get a clean head.

Agents & Harness

Compaction · Summarisation

Replacing old context with a shorter summary of it.

Agents & Harness

Context Pointer · Reference

A cheap reference to something the agent can fetch if needed.

Agents & Harness

Handoff

Passing work to a fresh context, deliberately and with a written brief.

Agents & Harness

Handoff Artifact · Brief

The document that makes a fresh context productive in one read.

Agents & Harness

Harness · Scaffold

Everything around the model that makes it an agent.

Agents & Harness

Orchestrator-Worker · Lead agent

One agent plans and delegates; others do the work.

Agents & Harness

Progressive Disclosure

Reveal detail only when it becomes relevant.

Agents & Harness

Skill · Capability

A packaged procedure the agent can load when the task calls for it.

Agents & Harness

Spec · Specification

A written description of the intended outcome, before the work starts.

Agents & Harness

Subagent

A helper agent with its own clean context window.

Agents & Harness

Ticket

The unit of delegated work, with scope and a definition of done.

Tools & Environment

Tools & Environment

Agent Mode

The mode where the assistant acts instead of suggesting.

Tools & Environment

Agentic Search

Searching iteratively, judging results, and searching again.

Tools & Environment

AI Gateway · LLM gateway

One endpoint in front of every model provider, with routing, fallbacks and billing.

Tools & Environment

Computer Use · Screen control

An agent that drives a real UI with clicks, typing and screenshots.

Tools & Environment

Environment

The world outside the model that tools act upon.

Tools & Environment

Filesystem

The agent’s most common environment: files it can read and write.

Tools & Environment

Function Calling · Tool use

The model-provider feature that makes structured tool calls reliable.

Tools & Environment

Least Privilege

Give the agent the minimum access the task requires.

Tools & Environment

MCP · Model Context Protocol

An open protocol for plugging tools and data into any agent.

Tools & Environment

Permission Mode · Autonomy level

How much the agent may do without asking.

Tools & Environment

Permission Request

The agent pausing to ask before doing something risky.

Tools & Environment

Sandbox

An isolated environment where an agent can act without risk to real systems.

Tools & Environment

Tool

A function the model is allowed to call to affect the world.

Tools & Environment

Tool Call

The model asking for a specific function with specific arguments.

Tools & Environment

Tool Result

What came back from the call, appended to context.

Tools & Environment

Tool Search · Deferred tool loading

Load tool definitions on demand instead of handing over all of them.

Retrieval & Memory

Prompting & Structure

Failure Modes

Evaluation

Patterns of Work

Patterns of Work

AFK · Away from keyboard

Running without a person watching.

Patterns of Work

AI-Assisted Development

Day-to-day engineering with a model in the loop.

Patterns of Work

Automated Check

A machine verdict the agent cannot talk its way past.

Patterns of Work

Automated Review

A model reviewing a model’s output before a human sees it.

Patterns of Work

AX · Agent Experience

How it feels to be an agent using your product.

Patterns of Work

Dark Factory

A fully automated pipeline with no humans inside it.

Patterns of Work

Design Concept

A rough, rejectable sketch of an approach.

Patterns of Work

DX · Developer Experience

How it feels to build with a tool or platform.

Patterns of Work

Evaluator-Optimizer · Generator-critic loop

One call produces, another critiques, and the loop repeats until it passes.

Patterns of Work

Grilling

Making the model interrogate the plan before building it.

Patterns of Work

Human in the Loop · HITL

A person reviews or approves before the work lands.

Patterns of Work

Human Review

A person reading the work, with judgment as part of the job.

Patterns of Work

Prompt Chaining

Break the job into steps and let each one be checked.

Patterns of Work

Prototyping · Spike

Build the cheapest thing that answers the question.

Patterns of Work

Software Factory

A pipeline where agents take tickets and produce code, with checks along the way.

Patterns of Work

Spec-Driven Development

Write the specification first; let the implementation follow.

Patterns of Work

Vibe Coding

Building by prompt-and-accept, without reading the code.

Safety & Alignment

Safety & Alignment

Agent Overreach · Unintended actions

An agent doing things outside what it was asked to do, on systems it was not supposed to touch.

Safety & Alignment

Alignment

Getting the system to pursue what we actually intended.

Safety & Alignment

Alignment Faking

Behaving well because you are watching, not because the model changed.

Safety & Alignment

Bias · Fairness

Systematic skew in outputs, usually inherited from data.

Safety & Alignment

Chain-of-Thought Monitoring

Reading the model’s reasoning as a way to catch bad intent.

Safety & Alignment

Constitutional AI

Training a model to critique itself against written principles.

Safety & Alignment

Content Policy

The written rules about what the system may produce.

Safety & Alignment

Data Governance

Rules about what data may be used, by whom, and retained how long.

Safety & Alignment

Gated Release · Dual release

One model, two doors: the full version goes only to vetted organizations, everyone else gets the safeguarded one.

Safety & Alignment

Guardrails

Constraints on what the system will do, enforced in code.

Safety & Alignment

Indirect Prompt Injection

The hostile instructions came in through something the model read.

Safety & Alignment

Interpretability · Explainability

Working out why the model did that.

Safety & Alignment

Jailbreak

Talking the model past its own restrictions.

Safety & Alignment

Model Card

The documentation shipped with a model.

Safety & Alignment

Moderation

Filtering inputs and outputs against a policy.

Safety & Alignment

Monitoring Suppression · Oversight suppression

An agent weakening the monitoring that watches it, usually while doing something it was asked to do.

Safety & Alignment

PII Redaction · Anonymisation

Removing or masking personal identifiers before the model sees them.

Safety & Alignment

Privacy

Protecting the people whose data flows through the system.

Safety & Alignment

Prompt Injection

Malicious instructions hidden in content the model reads.

Safety & Alignment

Refusal

The model declining a request.

Safety & Alignment

Responsible Scaling Policy · RSP

Capability thresholds that trigger heavier safeguards before release.

Safety & Alignment

Safety Case

A written argument that the risk is adequately handled, with evidence.

Safety & Alignment

Safety-Limited Training · Capability-limited training

Deliberately leaving dangerous know-how out of the training data so the model cannot learn it.

Safety & Alignment

Sandbagging

Deliberately underperforming on the evaluation.

Safety & Alignment

Spotlighting

Marking where each piece of text came from so the model can tell instructions from data.

Safety & Alignment

Value Realignment · Ideological fine-tuning

Retraining a model so it expresses a different set of values, without touching what it can do.

Adoption & Ops

Adoption & Ops

Adoption Curve

The path from a few enthusiasts to real usage.

Adoption & Ops

Confidential Inference · Confidential computing for inference

Running a model so your data and the model weights stay protected even while the work is happening.

Adoption & Ops

Cost per Task

What one unit of real work actually costs.

Adoption & Ops

Latency

Total time from request to finished answer.

Adoption & Ops

Model Routing

Sending each request to the cheapest model that can handle it.

Adoption & Ops

Observability

Being able to see what the system actually did.

Adoption & Ops

On-Device Model · Edge model

A small model that runs where the user already is, with no round trip to a cloud API.

Adoption & Ops

Open-Washing · Openwashing

Calling a model open when the release withholds the parts that would make it so.

Adoption & Ops

Prompt Versioning

Treating prompts as versioned, reviewable artifacts.

Adoption & Ops

Rate Limit

The cap on how much you may send, per minute or per day.

Adoption & Ops

ROI · Return on investment

Did it save more than it cost?

Adoption & Ops

Shadow AI

Staff using unauthorised AI tools with company data.

Adoption & Ops

Silent Checkpoint Swap · Silent swap

A provider swapping the weights behind a stable model name, with no announcement and no version change.

Adoption & Ops

Sovereign Model · Sovereign AI model

A frontier model you can run on your own infrastructure, under your own jurisdiction, instead of renting it from a foreign provider.

Adoption & Ops

Throughput

How many tokens per second the model generates.

Adoption & Ops

Time to First Token · TTFT

How long before anything appears on screen.

Adoption & Ops

Tracing

Following one request through every step it took.

Adoption & Ops

Training Preference Signal · AI training opt-out

One robots.txt line that tells every participating lab at once: do not train on this.

Adoption & Ops

Vendor Lock-in

How hard it would be to leave your model provider.