marcus-moorelab91a4 / fps-optimizer-rust
Rust-based FPS optimizer for games: frame-rate stability, lower input latency, process priority tuning, memory cleanup and power-plan presets. Lightweight, reversible, open-source performance tool for Windows.
nickn-eng1989k7 / Fortnite-FPS-Booster-Frame-Rate-Latency-Tuning-for-Windows
Fortnite FPS Booster: frame-rate stability, lower input latency, process priority tuning, memory cleanup and power-plan presets for Fortnite on Windows. Lightweight, reversible, open-source performance optimizer.
xzf-thu / VoiceMem
Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.
fstandhartinger / jevbench
JevBench by Benchmark Heaven: benchmark and leaderboard for AI decision models, measuring typed decision accuracy, calibration, latency and cost.
TacoTakumi / VoiceManager
A low latency streaming STT / STT server to add a voice to your LLM. Also supports batch mode.
selkies-project / selkies
Low-Latency Accelerated Web Remote Desktop Streaming Platform for Self-Hosting, Containers, Kubernetes, or Cloud/HPC
netease-youdao / Confucius4-R2T2
Confucius4-R2T2: A Low Latency and High Accuracy Real-Time Speech Recognition Model
FujitsuPolycom / sparkring
Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.
KoljaB / RealtimeSTT
A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.
GetStream / Vision-Agents
Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.
tile-ai / TileRT
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
OnlyTerp / toolrush
Kill the tool-call tax: harness tool latency back below model TPS. Fast local lanes, persistent pools, session caches. Scratch lab turned real.
x3me / omarchy-nexthop
Splits your Wi-Fi from your ISP, hop by hop. Internet quality monitor plugin for Omarchy.
lemony-ai / cascadeflow
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
YusufB5 / ASCILINE
A high-performance ASCII video rendering engine featuring real-time WebSocket binary streaming and an isolated compiler for serverless static generation. Built for low-latency 30 FPS playback on HTML5 Canvas.
qualcomm / ai-hub-models
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
microsoft / MInference
[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.
usamahz / cpu-performance-engineering
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
QwenAudio / Fun-Audio-Chat
Fun-Audio-Chat is a Large Audio Language Model built for natural, low-latency voice interactions.
ra1nty / DXcam
A Python high-performance screen capture library for Windows using Desktop Duplication API - Updated 2026
mda590 / cloudping.co
AWS Inter-Region Latency Monitoring
Sheltercosmo / jev4pg
Established strong JEV based natural language to SQL performance and well-covered semantic operators for PostgreSQL(PG) with optimized cost and latency. Reusable evidence, with native execution, parallel plans and explainable embeddings in development preview.
jiwidi / jiwo
Small decision models (jev style) for latency critical scenarios
speakrail / speakrail
Speakrail - a low-latency fully-local voice assistant that runs on a single RTX 4090
netease-youdao / Confucius4-T3PO
Confucius4-T3PO: a Low latency and High Quality Text-to-text Simultaneous Translation model via Pareto Policy Optimization
Sega757 / Adaptive-AtomRAG
Sub-millisecond query routing & cost-aware execution for GraphRAG architectures. Adaptive-AtomRAG is a highly optimized conditional routing gateway designed to resolve the latency and cost bottlenecks of heavy Atom-Entity Graph (AEG) RAG systems.
yoheinakajima / glance-speedlab
A measurement-first lab for low-latency local camera inference with Glance.
Seo-yeonLee / CrewBridge
Synthesizing real-time analytics and low-latency data synchronization seamlessly within the NexusEngine ecosystem.
shriramkv / mcp-load-lab
Load and latency harness for Model Context Protocol (MCP) servers. Drives real tools/call traffic at configurable concurrency, measures latency percentiles and throughput, and fails CI when a server misses its performance budget. Stdlib-first, zero required dependencies for stdio.
StarWorkshop / wavrail
Streaming speech recognition toolkit: log-mel features, CTC greedy and prefix-beam decoding, transducer-style frame-synchronous emission, forced alignment, Chinese/English CER-WER metrics, and a chunked streaming pipeline with latency accounting. NumPy core with a CPU-only torch extra; trainable demos on synthetic audio, fully offline.
DINAKAR-S / voice-agent-starter-kit
Self-hosted multilingual (English + 5 Indic) phone voice agent template - LiveKit Agents + Sarvam STT/TTS + OpenAI + Vobiz SIP. ~700ms-1.2s latency, under Rs 5.5/min. Demo: a real-estate site-visit booking agent.
Mayankpratapsingh022 / Turn-Detection-Model-Whisper-Tiny-Dual-Scale-Attention-Classification-Head-for-Low-Latency-Voice-AI
Low-latency, audio-native turn detection model using Whisper Tiny with a dual-scale attention classification head. Optimized for Hindi, Hinglish and Indian English, including fillers, incomplete thoughts and natural pauses. Includes causal training, hard-negative mining, calibrated endpointing.
onurtirpan / agentic-llm-token-and-performance-tests
The same HTTP API in 10 languages at 3 sizes, 30 implementations. Token cost for LLM agents, plus cold start, latency, throughput, CPU and memory. All measured, all verified over live HTTP.
tomiholtz / s3-files-ai-sdk
Give Vercel AI SDK agents a real persistent filesystem with Amazon S3 Files.
AbdelStark / jev-benchmarks
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
X-Square-Robot / X2Streaming-ASR
X2Streaming-ASR is a streaming Automatic Speech Recognition (ASR) system characterized by ultra-low latency and high accuracy.