📈 GH Trending Explorer 🎲 Surprise me

Search: batch · Language: C++ · clear

flashrt-project / FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

▲ ~86/7d ★ 752 C++ today
jmaczan / tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

▲ ~12/7d ★ 1.2k C++ today
ishtms / OpenPocketBaseSDK

PocketBase SDK for Unreal Engine with Blueprint and C++ APIs for records, authentication, files, realtime, batch operations, and admin tooling.