📈 GH Trending Explorer 🎲 Surprise me

Search: llm-inference · Language: TypeScript · AI hidden · clear

AtomicBot-ai / Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

▲ ~35/7d ★ 1.8k TypeScript today
bitcloud-ai / Bittune

Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.

▲ ~35/7d ★ 63 TypeScript 1mo ago
tetherto / qvac

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.

▲ ~9/7d ★ 705 TypeScript today
Nano-Collective / nanocoder

An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

▲ ~5/7d ★ 2.5k TypeScript today
felladrin / MiniSearch

Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space

▲ ~0/7d ★ 601 TypeScript today
tonyd2wild / The-Sparky-Command-Center

Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, optional RouterOS switch monitoring, and per-model decode/prefill/TTFT/KV cards. Point it at your own hardware.