· 3 min read
You probably don't need multi-agent
The orchestrator, the critic, the researcher and the planner walk into your architecture. One model with good tools was already doing the job. The math and the exceptions.
#agents#architecture#cost
Tagged: cost
6 articles
· 2 min read
The price crash quietly turned your 2024 cost hacks into debt
Frontier output pricing is down roughly 88% since early 2023. The clever cost engineering from two years ago is now complexity you pay to keep.
#cost#architecture#pricing
· 3 min read
The small model was the right call and everyone knew it
Frontier models for frontier problems. For the other 80 percent of your pipeline, a small model at a fifth of the price is not a compromise, it is engineering.
#models#cost#architecture
· 3 min read
Track LLM spend like cloud spend or repeat cloud history
OpenTelemetry's GenAI conventions finally standardize token and cost telemetry. Instrument now or meet your bill the way we all met AWS bills, screaming.
#observability#cost#tooling
· 2 min read
Prompt caching is the only discount you control
Cache reads cost a tenth of normal input tokens. The math on when caching pays, when it doesn't, and the mistake that quietly doubles your write costs.
#cost#caching#api
· 4 min read
Fine-tuning is the last resort and that's a compliment
The decision tree for prompting, RAG and fine-tuning, in the order your wallet prefers. Most teams asking about fine-tuning need a better prompt and a dataset they don't have.
#fine-tuning#models#cost