📈 GH Trending Explorer 🎲 Surprise me

Search: serving · Language: C++ · clear

lemonade-sdk / lemonade

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

▲ ~68/7d ★ 6.0k C++ today
kvcache-ai / Mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

▲ ~49/7d ★ 6.9k C++ today
LucaPazienza / gravityrush_pc

Gravity Rush PC Native Port A community-driven project aiming to bring Gravity Rush to PC as a native port, building upon the technical foundation and approach of the God of War PC port. The goal is to make the game run natively on PC while preserving its original gameplay, unique gravity mechanics, and artistic vision.

▲ 30/7d ★ 30 C++ 1d ago
qpdf / qpdf

qpdf: A content-preserving PDF document transformer

▲ ~23/7d ★ 5.5k C++ 26d ago
TheAssassin / AppImageLauncher

Helper application for Linux distributions serving as a kind of "entry point" for running and integrating AppImages

▲ ~16/7d ★ 8.4k C++ 19d ago
Lymphatus / caesium-image-compressor

Caesium is an image compression software that helps you store, send and share digital pictures, supporting JPG, PNG, WebP and TIFF formats. You can quickly reduce the file size (and resolution, if you want) by preserving the overall quality of the image.

▲ ~12/7d ★ 6.4k C++ 18d ago
1115714829 / llama.cpp-v100

llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.

▲ ~5/7d ★ 47 C++ 6d ago
tensorflow / serving

A flexible, high-performance serving system for machine learning models

▲ ~0/7d ★ 6.4k C++ 2d ago
microsoft / SPTAG

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

▲ ~0/7d ★ 5.0k C++ 4d ago
data61 / MP-SPDZ

Versatile framework for multi-party computation

▲ ~0/7d ★ 1.2k C++ 7d ago
EQEmu / EQEmu

A Fan-Driven Server Platform Preserving the Legacy of a Legendary MMORPG for Over Two Decades and Going

▲ ~0/7d ★ 636 C++ 5d ago
qhfan / FlashPrefillv2

FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving