deepspeedai / DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
deepspeedai / DeepSpeed
hpcaitech / ColossalAI
Making large AI models cheaper, faster and more accessible
taskflow / taskflow
A General-purpose Task-parallel Programming System in C++
crossbeam-rs / crossbeam
Tools for concurrent programming in Rust
puma / puma
A Ruby/Rack web server built for parallelism
uxlfoundation / oneTBB
oneAPI Threading Building Blocks (oneTBB)
epoko77-ai / im-not-ai
AI๊ฐ ์ด ํ๊ธ์ ์ฌ๋ ๊ธ์ฒ๋ผ ์ค๋ฌธํ๋ Claude ์คํฌ โ Korean AI-text humanizer: detects and rewrites translationese, mechanical parallelism, and 71 other AI tells
google / highway
Performance-portable, length-agnostic SIMD with runtime dispatch
xlite-dev / Awesome-LLM-Inference
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
sshnet / SSH.NET
SSH.NET is a Secure Shell (SSH) library for .NET, optimized for parallelism.
TheHPXProject / hpx
The C++ Standard Library for Parallelism and Concurrency
huggingface / nanotron
Minimalistic large language model 3D-parallelism training
xdit-project / xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
jOOQ / jOOL
jOOฮป - The Missing Parts in Java 8 jOOฮป improves the JDK libraries in areas where the Expert Group's focus was elsewhere. It adds tuple support, function support, and a lot of additional functionality around sequential Streams. The JDK 8's main efforts (default methods, lambdas, and the Stream API) were focused around maintaining backwards compatibility and implementing a functional API for parallelism.
SciML / SciMLBook
Parallel Computing and Scientific Machine Learning (SciML): Methods and Applications (MIT 18.337J/6.338J)
AdaptiveCpp / AdaptiveCpp
Compiler for multiple programming models (SYCL, C++ standard parallelism, HIP/CUDA) for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!
gpgpu-sim / gpgpu-sim_distribution
GPGPU-Sim provides a detailed simulation model of contemporary NVIDIA GPUs running CUDA and/or OpenCL workloads. It includes support for features such as TensorCores and CUDA Dynamic Parallelism as well as a performance visualization tool, AerialVisoin, and an integrated energy model, GPUWattch.
nerevu / riko
A Python stream processing engine modeled after Yahoo! Pipes
Lightning-AI / lightning-thunder
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
jfalcou / eve
Expressive Vector Engine - SIMD in C++ Goes Brrrr
vipshop / cache-dit
A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for DiTs.
dlang / phobos
The standard library of the D programming language
oldratlee / fucking-java-concurrency
๐ Simple showcases of java concurrency problems, seeing ๐ is believing ๐ต
NVIDIA-NeMo / labs-molt
A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
MoonshotAI / MoonEP
MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts
kalandra-lang / kalandra
Kalandra is a functional, parallel, distributed programming language.
lucee / Lucee
Lucee is a high-performance, open-source CFML server written in Java. Supporting JDBC, Caching, Parallelism, HTTP, ORM, REST, S3 and dynamic Java integration, Lucee is great for developers aiming to build fast, scalable applications, delivering faster startup, rapid compilation and better runtime performance.
Soulmate-Halo / heterogeneous-gpu-pd-lab
ไฝฟ็จ็จ ๅฏ็ฎๅๅกๅฏน็จ็ๅคงๆพๅญไธปๆบ่ฟ่กๅ ้๏ผไธปๆบๅ ๆฌ AI Max+ 395ใM3 512GใDGX Spark ็ญใ
whitecircle / halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
KarhouTam / FL-bench
Benchmark of federated learning. Dedicated to the community. ๐ค
pivovarit / parallel-collectors
Parallel Collectors is a toolkit easing parallel collection processing in Java using Stream API.
mogill / ems
Extended Memory Semantics - Persistent shared object memory and parallelism for Node.js and Python
binpash / pash
PaSh: Light-touch Data-Parallel Shell Processing
google / paxml
Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.
allover326 / deepseek-v4-cmp170hx
DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallelism, which vLLM does not support upstream.
cloudx-io / setup-go
setup-go with job-isolated caches for high parallelism and high hit rates
agentscope-ai-java / interp-rpc
Typed RPC over a warm pool of PEP 734 subinterpreters โ real parallelism, real error propagation, no hanging calls.
Prasannajaga / deployment-guide
Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).
1115714829 / llama.cpp-v100
llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.
christopherowen / dgx-spark-networking
Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes
buqi-code / buqi-minimax-h3-multigpu
MiniMax-H3 multi-GPU parallel inference for ComfyUI | ๅคๅกๅนถ่กๅ ้่็น:2-8 GPU Ulysses sequence parallel, bit-identical video+audio generation