Comfy-Org / ComfyUI

Node-graph GUI and Python backend for running diffusion models to generate images, video, 3D, and audio locally.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

sgl-project / sglang

SGLang is an open-source inference framework for serving large language, vision-language, and diffusion models.

lightseekorg / tokenspeed

TokenSpeed is an LLM inference engine built for agentic workloads, with a C++ scheduler control plane and Python execution plane.

gitleaks / gitleaks

Scans git repos, files, and stdin for hardcoded secrets such as passwords, API keys, and tokens.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

ashhart / TensorFold

Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.

leejet / stable-diffusion.cpp

C/C++ inference engine for diffusion image and video models such as SD, Flux, Wan, and Qwen-Image, built on ggml.

mozilla-ai / llamafile

Packages LLMs and a whisper-based speech-to-text tool into single executable files that run locally without installation.

google / agentmesh

Agent Mesh is a private network that lets AI agents publish and discover tools and models, with verifiable node identities.

microsoft / BitNet

Official C++ inference framework for 1-bit (1.58-bit) LLMs, providing optimized CPU and GPU kernels.

facebook / infer

Static analyzer that finds bugs such as null dereferences and resource leaks in Java, C, C++, and Objective-C code.

ubicloud / ubicloud

Open source IaaS cloud platform that runs on bare metal providers, offering VMs, managed Postgres, Kubernetes, and networking.

deepseek-ai / 3FS

A distributed file system from DeepSeek that uses SSDs and RDMA networks to serve storage for AI training and inference workloads.