ollama / ollama

Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

Tencent / WeKnora

Open-source LLM knowledge platform that turns documents into a searchable RAG system, a multi-step reasoning agent, and a maintained wiki.

mudler / LocalAI

Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.

altic-dev / FluidVoice

Open source macOS dictation app that transcribes speech on-device and optionally enhances the text with a local AI model.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

mozilla-ai / llamafile

Packages LLMs and a whisper-based speech-to-text tool into single executable files that run locally without installation.

PrismML-Eng / Bonsai-demo

Demo scripts for running PrismML's Bonsai 2 small LLMs (2B to 27B) locally on Mac, Linux, Windows, or CPU.

docker-mailserver / docker-mailserver

Containerized full-stack mail server bundling Postfix, Dovecot, Rspamd, and ClamAV for SMTP, IMAP, and POP3 with config-file-based setup.

higgsfield-ai / higgsfield

Open-source GPU cluster orchestrator and PyTorch-based framework for training LLMs with billions to trillions of parameters.