jundot / omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
jundot / omlx
tigerless-labs / cost-xray
See what Claude Code and Codex actually send to the API — and what each part costs.
joblib / joblib
Computing with Python functions.
pallets-eco / flask-caching
A caching extension for Flask
ARahim3 / kaggle-tpu-lab
Frontier-class open models on a free Kaggle TPU v5e-8: GLM-5.3-Flash 320B MoE (~165 tok/s, our own JAX engine) and Qwen3.8-27B bf16 (~130 tok/s), 262k context, prefix caching. Works with Claude Code, Codex, opencode and pi.
python-cachier / cachier
Persistent, stale-free, local and cross-machine caching for Python functions.
psf / cachecontrol
The httplib2 caching algorithms packaged up for use with requests.
tritant / ComfyUI_MiniMax_H3_Extender
ComfyUI node for MiniMax H3 that chains multiple video clips with motion context, disk caching, dynamic image references, audio reference support, and seamless final video/audio decoding.
r1c7 / CluxMate
AI coding agent with one Python core and three front-ends — headless CLI, Textual TUI, and an Electron desktop. Works with any OpenAI-compatible API, with risk-tiered permissions, event-sourced replayable sessions, and a fail-closed OS-level sandbox.
apimart-22w / claude-opus-5-api
Claude Opus 5 API (claude-opus-5): model id, per-million-token pricing, cache write and cache read rates, streaming and Anthropic-style requests through an OpenAI-compatible gateway.
Reederey87 / glm53-flash-exl3-2x-dgx-spark
GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode
Elevatormusic / hermes-warm-compaction
Hermes Agent context engine: the main model writes the compaction handoff on its cached prompt prefix
antonkarasbiz / FastAPI-boilerplate
Async FastAPI service template with authentication, background jobs, caching, and PostgreSQL.
0xBakeer / Qwen3.8-27B-FP8-on-a-single-DGX-Spark
Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Speculative decoding and prefix caching benchmarked, plus DFlash 2 — the only Qwen3.8-27B build that can serve it under vLLM.
Qin-sor / agent-context-lab
A minimal coding-agent harness built to measure what context management actually costs: constraint survival after compaction (8%→83%), default-FAIL verification against false completions, and KV-cache prefix design (21%→90%). Stdlib-only, real deepseek-chat runs
devereuxhale6 / openrouter-docs-community
API documentation patterns for prompt caching, reasoning tokens, model fields, and model-specific behavior, with Argolink boundary notes.
sepiablue-ai / ComfyUI-MiniMax-H3-TaoMate-C3
TaoMate-H3 3-step acceleration package for ComfyUI on an RTX 4070 12GB: 4-bit (W4A4) FFN weights, 10% sparse attention and extra INT8 weight caching, with Windows setup and sample workflows.
Victor-Kipruto-Rop / knbs-cbk-pipeline
Ingests KNBS and CBK public indicators, standardizes and transforms them with dbt, stores marts in PostgreSQL, and exposes query + CSV APIs with signed cursor pagination, ETag caching (Redis), and rate limiting.