Comfy-Org / ComfyUI

Node-graph GUI and Python backend for running diffusion models to generate images, video, 3D, and audio locally.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

gitleaks / gitleaks

Scans git repos, files, and stdin for hardcoded secrets such as passwords, API keys, and tokens.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

google / agentmesh

Agent Mesh is a private network that lets AI agents publish and discover tools and models, with verifiable node identities.

ashhart / TensorFold

Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.

microsoft / BitNet

Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.

mozilla-ai / llamafile

Packages LLMs and a whisper-based speech-to-text tool into single executable files that run locally without installation.

leejet / stable-diffusion.cpp

C/C++ inference engine for diffusion image and video models such as SD, Flux, Wan, and Qwen-Image, built on ggml.