Sceptre / sceptre
Build better AWS infrastructure
Sceptre / sceptre
Paritok-official / paritok-4b-v1
Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.
aegra / aegra
Open source alternative to LangGraph Platform (now LangSmith Deployments) - Self-hosted AI agent backend with FastAPI and PostgreSQL. Zero vendor lock-in, full control over your agent infrastructure.
cloud-in-a-bottle / cloud-in-a-bottle
Deploy, use, and share web apps on a server you control. Your apps, data, and infrastructure stay yours.
Azure / agent-landing-zone
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observability and IaC.
Tencent-Hunyuan / UniRL
UniRL is a Framework for Unified Multimodal Model Reinforcement Learning
ironicbadger / infra
99.7% less leaked credentials
groq / openbench
Provider-agnostic, open-source evaluation infrastructure for language models
Katakate / k7
Your own self-hosted infra for lightweight VM sandboxes to safely execute untrusted code. CLI, API, Python SDK. ⭐ Star it if you like it! ⭐
proxmoxer / proxmoxer
python wrapper for Proxmox API v2 (https://pve.proxmox.com/pve-docs/api-viewer/index.html)
grapeot / context-infrastructure
A context and memory system for AI coding agents. Persistent memory, personal rules, skills, and scheduled observations
google / ml-compiler-opt
Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.
usemoss / moss
The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.
SAIL-Research-Lab / cheetahclaws
CheetahClaws: A Fast and Easy-to-Use Agent Harness Infrastructure for Long-Horizon, Multi-Model, and Tool-Using AI Systems
aws / bedrock-agentcore-sdk-python
Python SDK for transforming any AI agent into a production-ready application. Framework-agnostic primitives for runtime, memory, authentication, and tools with AWS-managed infrastructure.
EverMind-AI / SkillCorpus
Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.
oracle / oci-cli
Command Line Interface for Oracle Cloud Infrastructure
awslabs / fullstack-solution-template-for-agentcore
Flexible Fullstack solution template for production-ready deployments of any use case on Amazon Bedrock AgentCore.
inclusionAI / Avernet
Distributed agent coordination platform where agents live, connect, coordinate, execute, and evolve together — like an organization.
ZimoLiao / scholaraio
Scholar All-In-One: A research infrastructure for AI agents
thu-ml / SLA
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
opsmill / infrahub
Infrahub is a graph-based data management platform with built-in version control, CI workflows, peer review, and API access. It’s purpose-built to power reliable infrastructure automation at scale.
pwncollege / dojo
Infrastructure powering the pwn.college dojo
expectedparrot / edsl
Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
caura-ai / caura
Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.
aaron-for-value / VeriRun
Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.
dengyier / OpenWorkProof
Open protocol for AI agent work contracts and verifiable execution — authorization, evidence, and acceptance for multi-agent systems
lcpu-club / wmhpc-training-camp-x-lcpu-ai-infra-seminars
北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库
opensible / opensible
An open source GitOps control plane for OpenTofu & Ansible - provision, configure and deploy across cloud, on-prem and hybrid, self-hosted and forever free.
SodaMem / SodaMem
Agentic memory infra for AI agents
flop-labs / technocore-chat
HTTP-native chat and notes for agents whose sandbox only allows webfetch — every write is a plain GET. Runs technocore.chat.
devZero-Security / redStackPRO
A canvas for red team infrastructure and cyber ranges. Compose a topology, export runnable Terraform and Ansible, and deploy it yourself. Your cloud credentials never leave your machine.
lilinji / ai-infra-odyssey
AI Infra 大话西游之水滴石穿 - 专栏全景硬核技术实战
yanght27 / GPU-Perf-Playground
GPU 性能与 AI Infra 学习项目：CUDA/Triton 算子、NCU/NSYS、vLLM/SGLang/TRT-LLM/ms-swift、PyTorch/DeepSpeed/ms-swift 训练、并行架构
DrDroidLab / open-index
Deterministic memory layer for your agents
tubban1 / leadgen
🚀 多租户全自动化闭环建站与云基础设施生成式 UI 系统 | Automated Multi-Tenant Generative UI & Infrastructure Delivery Engine (Next.js 14, OpenAI, Neon DB, Vercel & GoDaddy APIs)
morpheuslord / PICOTTY
PicoTTY is a simple serial tty serial console or somewhat of a IP KVM cause my homelab was just proxmox so serial is all I need.
lyy-ai / ai_infra
《C++设计模式》作者。创建AI Infra@学习圈，关注公众号《码出名企路》，家V《LiyiAngB》，一起做AI Infra企业级实战项目，互相学习。
dahan6 / whetstones-lab
Whetstones Lab: measuring coevolution between adaptive malware and behavioral defense. De-weaponized research release — genomes, evolution rounds, telemetry, training harness (stubbed primitives), and lab range tooling. Payloads, real primitives, and C2 infrastructure intentionally withheld. Research and defensive use only.
nerdit-ai / nerdit
Self-hosted PaaS for one machine: apps, local AI models and databases, operable by coding agents over MCP.
Sega757 / Sovereign-Agent-Swarm
Adaptive Human-Agent Teaming (HAT) & Smart Company (SmC) Infrastructure This repository implements a Human-Model-Free adaptive agent architecture. Instead of relying on rigid, computationally expensive human behavioral models, the system leverages real-time trajectory analysis and the Cross-Entropy
hsj576 / virtual-ai-infra-team
An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with independent quality gates, a stable OpenAI-compatible API, and automatic rollback.
sangelege / forestfix
Verifiable multi-agent patch evaluation infrastructure
Aryan-20-04 / mdrap
Institutional-grade market data infrastructure: converts noisy, multi-venue exchange feeds into a validated, sub-microsecond canonical stream with cryptographic auditability and zero silent drops.
uniffy-io / uniffy
Notes, Diagrams, Chat, Calls, Files, Projects, Calendar. One private workspace, everything talks back. Plus an optional agent harness on top of it designed for Work Infrastructure
one2piece2hello / faibench_Frontier_InfraBench
Phi-Bench (Φ-Bench): 85 open-source LLM-infrastructure engineering tasks for frontier LLMs & coding agents (KFC/LH/E2E). Self-contained public Dockerfile + offline scoring + reference solution per task. Website: llminfrabench.com
ai-infra-bench / ai-infra-bench
Evaluating frontier models on real-world ai-infra engineering tasks
elsechord / CyberGuard
Evidence-driven autonomous SOC team on AgentTeams: hash-bound approvals, HMAC audit chain, rollback and reproducible attack scenarios — auditable governance primitives for agent infrastructure.
npci / ainxt-enterprise
AiNxt Enterprise is an open-source enterprise AI platform designed to help organizations build, deploy and manage AI applications, agents and workflows. It brings AI models, tools, automation and governance together in a single platform, with the flexibility to run on an organization’s own infrastructure.
llm-infra-atlas / llm-infra-atlas.github.io
A living guide of the systems that train, serve, and scale LLMs
SVDX-lab / miniinfra
本项目是一套面向 AI Infra 初学者的 LLM 推理教程，目标是在一张 NVIDIA GeForce RTX 3080 Ti（12GB 显存）上，实现并讲清较为完整的单机 AI 推理基础设施。
apimartwqiv / deepinfra-migration-guide
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
feiguangba / minivllm
图解 vLLM 推理引擎：100 课动手练习册 + ~500 行可运行的迷你推理引擎 | An illustrated, hands-on course on how vLLM works
apimartnvpu1h7 / deepinfra-alternatives
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
bubble65 / EMU-Agentic-PostTrain
Post-training infra for agentic image generation.
Beate-Suy-Zhang / EvoFuse
TPAMI 2026 | Symbiotic Evolutionary Learning for Task-Adaptive Infrared and Visible Image Fusion
d3qqcegqn5bf1aco / openrouter-vs-deepinfra
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
Human-Agent-Society / reef-eval
🌊 Evaluation infrastructure for self-evolving agents, on the Harbor task standard.
Scientist888-star / GDAFusion
[Pattern Recognition 2026] Generative Representation Learning with Information Disentanglement and Global Alignment for Infrared and Visible Image Fusion
Imironman123 / llm-interview-notes
大模型算法 / 应用 / Infra 岗位面试资料：10 份文档、345 道题、约 36 万字。含字节 11 篇面经实录、大模型八股上下篇、RAG / Agent / 推理部署 / AI Infra 四大专题，以及 12 家大厂面经横向对比。