A local proxy that lets Claude Code, Codex, OpenCode and other coding agents run on free or alternative model providers.
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
Python library that uses LLMs and graph-based pipelines to extract structured data from websites and local documents from a natural-language prompt.
A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.