· 2 min read
Prompt caching is the only discount you control
Cache reads cost a tenth of normal input tokens. The math on when caching pays, when it doesn't, and the mistake that quietly doubles your write costs.
#cost#caching#api
1 article
· 2 min read
Cache reads cost a tenth of normal input tokens. The math on when caching pays, when it doesn't, and the mistake that quietly doubles your write costs.
#cost#caching#api
get new writeups by email
no schedule, no spam. the next writeup, when it exists.