vllm-project / vllm
A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.
vllm-project / vllm
apache / kafka
Distributed event streaming platform for building high-throughput data pipelines and streaming applications.
awslabs / mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
michaelfeil / infinity
Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
BOINC / boinc
Open-source software for volunteer computing and grid computing.
samtools / htslib
C library for high-throughput sequencing data formats
armadaproject / armada
A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.
ronitgupta138 / Vectra-Core
âš¡ In-Memory Vector Search Engine & HNSW ANN Graph in Java 21 Loom. Sub-millisecond KNN retrieval, 8-bit scalar quantization (SQ8), 16,000+ QPS.
ronitgupta138 / Bharat-Spatial-Engine
🇮🇳 High-Performance Geospatial Administrative Hierarchy & Proximity Query Engine for India's 650k+ Census Settlements (Java 21 Loom, 2D KD-Tree, 38k+ QPS).
needtobreathe / AuditHook
High-throughput HTTP event ingestion gateway with live SSE telemetry, payload auditing, and localhost dispatch capabilities.
Koukyosyumei / h5i-db
An agent-native workspace for quantitative research: an in-terminal notebook, a high-performance time-series database, and a high-throughput backtesting engine. Written in Rust.
SoundsGoodAI / fast-gpu-asr
High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom CUDA plugins, GPU beam search, and word timestamps - up to 25,000 RTFx on B300.
ruc-system / quiver-ae
A low-latency, high-throughput, and billion-scale GPU-SSD vector search system.