lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

thesysdev / openui

OpenUI is a framework-agnostic Generative UI framework with a streaming-first language for rendering model-generated interfaces.

CoplayDev / unity-mcp

MCP server and Unity Editor package that lets AI assistants control scenes, scripts, assets, tests, and builds in Unity.

VectifyAI / PageIndex

Python library and SDK that builds a hierarchical tree index of documents so an LLM can reason through it for retrieval, without vector databases or chunking.

trymirai / uzu

Inference engine for running AI models locally inside apps, with Rust core and Swift, Python, and TypeScript bindings.

ScrapeGraphAI / Scrapegraph-ai

Python library that uses LLMs and graph-based pipelines to extract structured data from websites and local documents from a natural-language prompt.

facebookresearch / audiocraft

PyTorch library for audio generation research, providing inference and training code for MusicGen, AudioGen, and EnCodec.

strands-agents / harness-sdk

Open-source SDK for building and running AI agents in Python and TypeScript, with a fully assembled harness and a model-agnostic agent loop.

NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.