vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

apache / kafka

Apache Kafka - A distributed event streaming platform

ronitgupta138 / Vectra-Core

⚡ In-Memory Vector Search Engine & HNSW ANN Graph in Java 21 Loom. Sub-millisecond KNN retrieval, 8-bit scalar quantization (SQ8), 16,000+ QPS.

ronitgupta138 / Bharat-Spatial-Engine

🇮🇳 High-Performance Geospatial Administrative Hierarchy & Proximity Query Engine for India's 650k+ Census Settlements (Java 21 Loom, 2D KD-Tree, 38k+ QPS).

groundingpi / GroundAnything

A 4B diffusion grounding model for fast, precise visual evidence extraction. Unifies diverse grounding tasks through parallel decoding, with optional self-speculative decoding delivering 4.51x autoregressive throughput on COCO.

ucxn / Bili.Libre.Speed

哥哥科技的 PiliBro 增强B站，顾名思义—“自由速率”~专为偏爱高倍速、高信息熵的朋友们打造：热爱博物、渴求信息、世界知识资源饥渴、节约时间…想在有限的生命中了解更多信息高效看视频，均可选择！测试宽带真实业务速率，消费级路由增强：网络CDN诊断、高峰调控、弱网优化，助你流畅，护你冲浪！Bro-Tech's PiliPlus FreeRate: high-speed, info-dense viewing for curious, info-hungry minds—learn more in less time. Real-world throughput tests, CDN diagnostics, peak-hour tuning & weak-net optimization.

michaelfeil / infinity

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

timeplus-io / proton

The fastest unified streaming SQL Engine in a single C++ binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute stateful context from streams, logs, metrics, events, and CDC.

developmentseed / obstore

The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.

armadaproject / armada

A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.

awslabs / mountpoint-s3

A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.

RodriMora / dgx-spark-grafana-dashboard

Grafana dashboard for NVIDIA DGX Spark clusters running vLLM: throughput, contention, and GB10 GPU hardware telemetry (NVIDIA-themed, 55 panels)

FNWTalon / LIZARD

GPU-accelerated optical file transfer with megabyte-scale throughput. Android recommended; browser decoder will not give full speed.

eclipse-openj9 / openj9

Eclipse OpenJ9: A Java Virtual Machine for OpenJDK that's optimized for small footprint, fast start-up, and high throughput. Builds on Eclipse OMR (https://github.com/eclipse/omr) and combines with the Extensions for OpenJDK for OpenJ9 repo.

openlake-project / openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

tenox7 / ttyplot

a realtime plotting utility for terminal/console with data input from stdin

alex-petrenko / sample-factory

High throughput synchronous and asynchronous reinforcement learning

samtools / htslib

C library for high-throughput sequencing data formats

SaltyAom / bun-http-framework-benchmark

Compare throughput benchmark from various Bun HTTP framework

MystenLabs / sui

Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language

readysettech / readyset

Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.

BOINC / boinc

Open-source software for volunteer computing and grid computing.

rari-build / rari

rari: High-performance React Server Components framework powered by a Rust runtime, delivering 14.5x faster response times (0.12ms vs 1.74ms) and 53.1x higher throughput (89,371 vs 1,683 req/sec) than Next.js with zero-config setup.

invergent-ai / surogate

Train and serve LLMs at extreme speed and massive throughput.

scalecube / scalecube-services

Microservices library - scalecube-services is a high throughput, low latency reactive microservices library built to scale. It features: API-Gateways, service-discovery, service-load-balancing, the architecture supports plug-and-play service communication modules and features. built to provide performance and low-latency real-time stream-processing

s-andrews / FastQC

A quality control analysis tool for high throughput sequencing data

agjs / gb10-clock-cap

Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd unit.

embeddings-benchmark / embedders-dilemma

Code, datasets, and results for "The Embedder's Dilemma: LLMs Are Better, but at What Cost?" (COLM 2026). MTEB(LLM) benchmarks 10 LLMs and 26 embedding models on 37 tasks with full cost and throughput accounting.

needtobreathe / AuditHook

High-throughput HTTP event ingestion gateway with live SSE telemetry, payload auditing, and localhost dispatch capabilities.

Koukyosyumei / h5i-db

An agent-native workspace for quantitative research: an in-terminal notebook, a high-performance time-series database, and a high-throughput backtesting engine. Written in Rust.

SoundsGoodAI / fast-gpu-asr

High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom CUDA plugins, GPU beam search, and word timestamps - up to 25,000 RTFx on B300.

shriramkv / mcp-load-lab

Load and latency harness for Model Context Protocol (MCP) servers. Drives real tools/call traffic at configurable concurrency, measures latency percentiles and throughput, and fails CI when a server misses its performance budget. Stdlib-first, zero required dependencies for stdio.

ruc-system / quiver-ae

A low-latency, high-throughput, and billion-scale GPU-SSD vector search system.

Quantova / Quantova-Benchmarks

Reproducible execution throughput benchmark for the Quantova node

onurtirpan / agentic-llm-token-and-performance-tests

The same HTTP API in 10 languages at 3 sizes, 30 implementations. Token cost for LLM agents, plus cold start, latency, throughput, CPU and memory. All measured, all verified over live HTTP.

microsoft / garnet

Garnet is a remote cache-store from Microsoft Research that offers strong performance (throughput and latency), scalability, storage, recovery, cluster sharding, key migration, and replication features. Garnet can work with existing Redis clients.