vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

YeonwooSung / llm-architecture-from-scratch

Implementing LLM architectures from scratch in PyTorch

DeepSeekV4Flash0731 / DeepSeek-V4-Flash-0731

DeepSeek V4 Flash 0731 - free deepseek v4 flash download, gguf, ollama, deepseek v4 pro 0813. deepseek v4 flash vs pro, benchmark, MoE, 1M context, compressed sparse attention, coding. CUDA/CPU, no API key, Windows local AI. Download:🡇

xlite-dev / Awesome-LLM-Inference

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

InternLM / xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

apimartno / deepseek-v3.2-api-ja

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

apimartno / deepseek-v3.2-api-ko

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

apimartmut0k / deepseek-v3.2-api-cn

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

atharvotech / FreeDeepseekAPI-EN

Local OpenAI-compatible API proxy for DeepSeek Web Chat (Global English Version). Connects DeepSeek to Open WebUI, Claude Code, and OpenAI SDK tools. Maintained by Atharvotech.

apimartmut0k / deepseek-v3.2-api-fr

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.