#Cost Optimization
2 articles — newest first.
- 9 min read
Prompt Caching: the Ordering Discipline That Cuts the Bill
I treat prompt caching as FinOps: order the static prefix first, keep it byte-stable, and stop re-paying to re-read an 8K preamble on every request.
- 7 min read
Semantic Caching That Actually Hits: Matching Meaning at the Edge
The streamerOS support agent kept re-answering the same question phrased ten ways, so I built a semantic cache that matches meaning, not the string.