shinefuer / frugent
git clone https://github.com/shinefuer/frugent.git
v0.1.2 · 6d ago
Python toolkit that validates cost-efficient coding-agent runtime mechanisms (caching, compression, batching, budgeting, cascading routing, tracing, sandboxing) on offline synthetic workloads.
Why you might care
Useful if you want to study or prototype LLM cost-control mechanics without network access or API keys; it runs on seeded synthetic tasks with a fictional rate card and explicitly does not measure real model answer quality. Covers prefix and semantic caching, context compression, request batching, DP-optimal cascade routing, budget admission, span-level cost tracing, and sandboxed tools, with a NumPy core and an optional CPU-only torch extra.
Star history (as recorded here)
GitHub topics
Links
README
Loading README…
Blurb generated by claude-haiku-5-5 5d ago. Star deltas marked ~ are extrapolated from partial history.