pgrundev / pgx
PGX — Lightweight Postgres for AI agents. Written in Rust. Thousands of isolated databases in one runtime. 🐘
pgrundev / pgx
omnara-ai / omnara
The open-source managed agent platform. A self-hostable alternative to Claude Managed Agents and OpenAI's Agents API.
Tencent / AI-Infra-Guard
A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
bojieli / ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
HarnessRouter / harnessrouter
HarnessRouter Community Edition: the self-hosted, Apache-2.0 edition of the unified interface for agent harnesses. Run Codex, Claude Code, Hermes, PI, DSH, and more through one API, with sessions, streaming, files, cancellation, and failure handling. Implements the Unified Harness Protocol (UHP), an open standard. Your keys, your infrastructure.
opensandbox-group / OpenSandbox
Secure, Fast, and Extensible Sandbox runtime for AI agents.
semantica-agi / semantica
Graph-Native Infrastructure for Context and Accountable AI Systems
BBuf / AI-Infra-Auto-Driven-SKILLS
—
ForceInjection / AI-fundamentals
AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识。
go-taas / go-taas
Open-source Token as a Service (TaaS) platform on Kubernetes — deploy LLMs, price by model × GPU, and meter/bill usage via an OpenAI-compatible API.
CurvineIO / curvine
AI-Native & Cloud-Native FS: A high-performance file semantic layer for cloud object storage, integrated with high-speed cache. CNCF Sandbox Project.
iflytek / skillhub
Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.
SwanHubX / SwanLab
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
Akun-python / autumn-recruitment
Autumn-Recruit Algo Notes(秋招算法学习仓库)，面向大模型时代的算法、工程与AI学习共建仓库。从数学基础、数据结构，到机器学习、深度学习、LLM、Agent、AI-Infra、语音与数据科学，通过「理解→推导→手写 → 运行 → 验证 → 复盘构建可持续迭代的知识体系。
caura-ai / caura
Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.
mohammadrezwankhan / datacenter-twin-lab
Explore data center power continuity, energy ledgers & infrastructure assumptions through reproducible synthetic models.
Imironman123 / llm-interview-notes
大模型算法 / 应用 / Infra 岗位面试资料：10 份文档、345 道题、约 36 万字。含字节 11 篇面经实录、大模型八股上下篇、RAG / Agent / 推理部署 / AI Infra 四大专题，以及 12 家大厂面经横向对比。
RunanywhereAI / wally
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
Tencent-Hunyuan / UniRL
UniRL is a Framework for Unified Multimodal Model Reinforcement Learning
feiguangba / minivllm
图解 vLLM 推理引擎：100 课动手练习册 + ~500 行可运行的迷你推理引擎 | An illustrated, hands-on course on how vLLM works
CaviraOSS / LongMemory
Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.
Paritok-official / paritok-4b-v1
Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.
tensorlakeai / tensorlake
Tensorlake is a serverless runtime for sandboxes and deploying background agentic applications
usemoss / moss
The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.
lcpu-club / wmhpc-training-camp-x-lcpu-ai-infra-seminars
北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库
DrDroidLab / open-index
Deterministic memory layer for your agents
eskim2001 / dshcloud
DeepSeek Harness (dsh) 自托管多用户云平台：提供隔离工作空间、持久化存储、访问控制与资源配额。Self-hosted multi-user cloud platform for DeepSeek Harness, with isolated workspaces, persistent storage, access control, and resource quotas.
acoder-ai-infra / agenui-studio
Self-hosted studio for generating, previewing, binding, and shipping executable AGenUI interfaces with AI agents.
ai-infra-bench / ai-infra-bench
Evaluating frontier models on real-world ai-infra engineering tasks
infercrane / infercrane
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely release self-hosted models behind one endpoint.
axonel / sentinel
Run coding agents autonomously with isolated Git worktrees, independent verification, and human-controlled integration.
Bifrostapi / ai-api-examples
🚀 One API gateway for GPT, Claude, Gemini, DeepSeek and more. OpenAI-compatible API for developers.
lilinji / ai-infra-odyssey
AI Infra 大话西游之水滴石穿 - 专栏全景硬核技术实战
thu-ml / SLA
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
sandbaseai / sandbase-harness
Local-first, self-hosted AI agent runtime and MCP bridge with sandboxed sessions, memory, credentials, audit/replay, and a local Console.
hsj576 / virtual-ai-infra-team
An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with independent quality gates, a stable OpenAI-compatible API, and automatic rollback.
RaycarlLei / tool-journal
TypeScript execution journal for retryable tools: SQLite durability, lease fencing, explicit uncertainty, and reproducible crash tests.