Skip to content
ISSUE 001·LIVE·13:44 IL
← Start here

Agent costs and caching

Estimate the cost of a task, including retries and the cache assumptions behind it.

01 · Read the guide

How Prompt Caching Actually Works (And Why Yours Isn't) →

Prompt caching can cut LLM cost by ~90% on repeated context — but only if you understand the prefix-match rule. Here are the silent invalidators that quietly drop your cache hit rate to zero.

02 · Try the tool

Calculate a task's token cost →

Compare local scenarios with dated provider price sources.

One small test

Start with measured input and output tokens. Compare no-cache and cached runs, include retries, and keep infrastructure and tool charges separate.

Keep reading