Skip to content

Cost Profile

Where a system's model calls actually happen, counted rather than assumed.

Why it matters in a memory layer

A retrieval stack pays at read time — embed the query, search, rerank, often a call to synthesise — and indexing is a one-off amortised over every future query. That makes "index once, query forever" a sound way to think about the bill.

Measured here, the profile is inverted and starkly so: the full write path costs 48 model calls and 38 embeddings over 24 turns, and one question costs zero model calls and two embeddings. Not cheap — none.

Count calls rather than seconds. Seconds belong to the machine and the provider; calls are what a bill is denominated in and do not change when the hardware does. And count by patching the client, because a counter added at each call site misses the one somebody wrote last week.

Connections

Taught in: The Write Path Dominates

Used in: Caching, Batching, Routing · Hardening Pass · The Latency Budget · Scaling the Store

Do not confuse with: Write-Path Dominance