vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

paperclipai / paperclip

Open-source Node.js and React app that orchestrates teams of AI agents with org charts, budgets, goals, and a task-manager interface.

ashhart / TensorFold

Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.

ed-donner / llm_engineering

Jupyter notebooks and code accompanying Ed Donner's 8-week LLM engineering course, from local models through building LLM applications.