ashishps1 / awesome-system-design-resources

A curated list of free system design learning materials and interview preparation problems and concepts.

redis / redis

In-memory data structure store used as a cache, database, message broker, and vector/document query engine.

bojieli / ai-infra-book

《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

encoredev / encore

Infrastructure orchestration from local to your cloud

temporalio / temporal

Temporal service

astroautomata / PySR

Symbolic Learning in Python and Julia

spacedriveapp / spacedrive

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

xevrion / breakscale

Build a system, load it until it breaks, and watch why. A system design simulator for learning distributed systems.

seaweedfs / seaweedfs

Distributed file and object storage system that serves S3, POSIX file system, and Iceberg/Lance table access from one Go binary.

conductor-oss / conductor

Conductor is an event driven agentic workflow engine providing durable and highly resilient execution engine for applications and AI Agents

cadence-workflow / cadence

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

heaven999b / hello-agent-system

👋 Hello Agent System — learn enterprise AI agent system design by building every production layer from scratch. 17 bilingual lessons (EN/中文) with tested exercises: tools, architectures, reliability, security, evals, distributed execution, cost, RAG, release ops. 企业级 Agent 系统设计训练营

systemdesign42 / system-design-academy

If you want to become good at AI engineering & system design, join this newsletter 👇

nats-io / nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.

doocs / advanced-java

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识

etcd-io / etcd

Distributed reliable key-value store for the most critical data of a distributed system

dmlc / xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

Vonng / ddia

《Designing Data-Intensive Application》DDIA 第一版 / 第二版 中文翻译

juicedata / juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

paradigmxyz / reth

Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust

gluster / glusterfs

Gluster Filesystem : Build your distributed storage in minutes

golemcloud / golem

Golem Cloud is the agent-native platform for building AI agents and distributed applications that never lose state, never duplicate work, and never require you to build infrastructure.

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

apache / zookeeper

Apache ZooKeeper

SeleniumHQ / docker-selenium

Provides a simple way to run Selenium Grid with Chrome, Firefox, and Edge using Container Platform, making it easier to perform browser automation at scale

hatchet-dev / hatchet

🪓 An orchestration engine for background tasks, AI agents, and durable workflows

supabase / realtime

Broadcast, Presence, and Postgres Changes via WebSockets

hazelcast / hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

chrislusf / gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

eclipse-zenoh / zenoh

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

event-catalog / eventcatalog

Documentation tool built for software architecture. Document your domains, services, events and schemas — for your teams and your AI agents.

absmach / magistrala

IoT Platform Framework

dobyte / due

A High-Performance Distributed Game Server Framework in Go

resonatehq / resonate

Distributed Async Await — Durable Executions, Dead Simple

DrHazemAli / enterprise-system-design

A source-grounded course and architectural reference for engineers designing systems that must survive real traffic, partial failure, security review, and changing requirements, spanning enterprise system design, distributed systems, AI systems, cybersecurity, reliability, cloud, HPC, edge, and mission-critical infrastructure.

NoKV-Lab / NoKV

The State Layer of Agent Sandbox

TharunKumarReddyPolu / Go-Handbook-for-Software-Engineers

A comprehensive Go handbook for software engineers covering fundamentals, idiomatic Go, concurrency, generics, testing, APIs, databases, performance, microservices, system design, and production engineering.

karanpratapsingh / system-design

Learn how to design systems at scale and prepare for system design interviews

rqlite / rqlite

The lightweight, fault-tolerant database built on SQLite. Designed to keep your data highly available with minimal effort.

akka / akka-core

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

dotnet / orleans

Cloud Native application framework for .NET

git-bug / git-bug

Distributed, offline-first bug tracker integrated in git

longhorn / longhorn

Cloud-Native distributed storage built on and for Kubernetes

authzed / spicedb

Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data

yeasy / blockchain_guide

Introduce technologies on blockchain and distributed ledger, from theory to practice with bitcoin, ethereum and hyperledger.

pixie-io / pixie

Instant Kubernetes-Native Application Observability

MaterializeInc / materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

easegress-io / easegress

A Cloud Native traffic orchestration system. (CNCF Project)

tendermint / tendermint

⟁ Tendermint Core (BFT Consensus) in Go

Eventual-Inc / Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

ag2ai / faststream

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

fluvio-community / fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

dkron-io / dkron

Dkron - Distributed, fault tolerant job scheduling system https://dkron.io

ergo-services / ergo

An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.

restatedev / restate

Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.

purpleidea / mgmt

Next generation distributed, event-driven, parallel config management!

adilkhash / Data-Engineering-HowTo

A list of useful resources to learn Data Engineering from scratch

PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

storj / storj

Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

bloomberg / blazingmq

A modern high-performance open source message queuing system