ashishps1 / awesome-system-design-resources

Learn System Design concepts and prepare for interviews using free resources.

redis / redis

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

mudler / LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

apache / kafka

Apache Kafka - A distributed event streaming platform

Autumn-27 / ScopeSentry

ScopeSentry-Cyberspace mapping, subdomain enumeration, port scanning, sensitive information discovery, vulnerability scanning, distributed nodes

nextcloud / server

☁️ Nextcloud server, a safe home for all your data

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine

PaddlePaddle / FlashMask

Efficient Mask-Aware Distributed Attention for Long-Context Training

phoenixframework / phoenix

Peace of mind from prototype to production

tensorflow / tensorflow

An Open Source Machine Learning Framework for Everyone

doocs / advanced-java

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识

etcd-io / etcd

Distributed reliable key-value store for the most critical data of a distributed system

ClickHouse / ClickHouse

ClickHouse® is a real-time analytics database management system

karanpratapsingh / system-design

Learn how to design systems at scale and prepare for system design interviews

milvus-io / milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

deepspeedai / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

apache / dubbo

The java implementation of Apache Dubbo. An RPC and microservice framework.

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible

remoteintech / remote-jobs

Source for remoteintech.company — a community-maintained directory of remote-friendly tech companies

pingcap / tidb

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.

spacedriveapp / spacedrive

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

huggingface / pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

seaweedfs / seaweedfs

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

alibaba / nacos

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

surrealdb / surrealdb

A scalable, distributed, collaborative, document-graph database, for the realtime web

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

SigNoz / signoz

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

conductor-oss / conductor

Conductor is an event driven agentic workflow engine providing durable and highly resilient execution engine for applications and AI Agents

xuxueli / xxl-job

A distributed task scheduling framework.（分布式任务调度平台XXL-JOB）

hashicorp / consul

Consul is a distributed, highly available, and data center aware solution to connect and configure applications across dynamic, distributed infrastructure.

apolloconfig / apollo

Apollo is a reliable configuration management system suitable for microservice configuration management scenarios.

systemdesign42 / system-design-academy

If you want to become good at AI engineering & system design, join this newsletter 👇

alibaba / spring-cloud-alibaba

Spring Cloud Alibaba provides a one-stop solution for application development for the distributed solutions of Alibaba middleware.

celery / celery

Distributed Task Queue (development branch)

dmlc / xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

valkey-io / valkey

A flexible distributed key-value database that is optimized for caching and other realtime workloads.

dapr / dapr

Dapr is a portable runtime for building distributed applications across cloud and edge, combining event-driven architecture with workflow orchestration.

apache / incubator-seata

:fire: Seata is an easy-to-use, high-performance, open source distributed transaction solution.

taosdata / TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

apache / skywalking

APM, Application Performance Monitoring System

redisson / redisson

Redisson: Valkey & Redis Java Client and Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Valkey and Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache..

PaddlePaddle / Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

temporalio / temporal

Temporal service

Vonng / ddia

《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译

jaegertracing / jaeger

CNCF Jaeger, a Distributed Tracing Platform

dgraph-io / dgraph

high-performance graph database for real-time use cases

nats-io / nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.

apache / shardingsphere

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

lightgbm-org / LightGBM

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

teambit / bit

AI-powered development workspaces with reusable components, architectural clarity and zero overhead.

rqlite / rqlite

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

ceph / ceph

Ceph is a distributed object, block, and file storage platform

tikv / tikv

Distributed transactional key-value database, originally created to complement TiDB

apple / foundationdb

FoundationDB - the open source, distributed, transactional key-value store

prestodb / presto

The official home of the Presto distributed SQL query engine for big data

hyperledger / fabric

Hyperledger Fabric is an enterprise-grade permissioned distributed ledger framework for developing solutions and applications. Its modular and versatile design satisfies a broad range of industry use cases. It offers a unique approach to consensus that enables performance at scale while preserving privacy.

OptimalBits / bull

Premium Queue package for handling distributed jobs and messages in NodeJS.

kubeflow / kubeflow

The Cloud Native AI Platform

apache / pulsar

Apache Pulsar - distributed pub-sub messaging system