The Irreducible Context

The smallest context that could answer a question — and the gap between it and the smallest a general policy actually reaches.

Why it matters in a memory layer

Measured here, the four facts the exam needs fit in 43 tokens and no policy gets below 52. The nine-token gap is one memory the packer cannot know is redundant: it is a genuine second answer to a question the ranker scored highly, and nothing tells the system that the employer question needs one fact while the diet question needs three. That is not an engineering shortfall to be optimised away — it is the point at which context assembly runs out of information, and knowing where that point is matters more than shaving it.

Connections

Taught in: Does This Earn Its Tokens?