architecture

llm cost control

LLM Proxy vs. SDK Wrappers: Why We Built a Proxy (And What the Latency Numbers Show)

SDK wrappers are the obvious first choice for LLM cost tracking. Here's why they break -- and what the latency benchmarks look like for the proxy alternative.

llm cost control

Building an Open-Source LLM Cost Control Plane

Why we chose a proxy over SDK instrumentation, how TimescaleDB makes budget checks fast, and what the three enforcement modes look like in production.