Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Learn how to develop, deploy and iterate on production-grade ML applications.
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
The absolute trainer to light up AI agents.
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.
Open-source inference server and production cluster for all the models your agent needs.
Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort
Machine Learning Engineering Open Book
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
An orchestration platform for the development, production, and observation of data assets.
Free Course : Data, Machine Learning, Deep Learning and AI Engineering, the long way round: the math, the code, the systems and the security. 173 lessons, 166 runnable labs, no shortcuts. Free under CC BY-NC 4.0.
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
Curated list of the best truly open-source AI projects, models, tools, and infrastructure. Daily updated.
Always know what to expect from your data.
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Community maintained hardware plugin for vLLM on Huawei Ascend
Workflow Engine for Kubernetes
The Open Source Feature Store for AI/ML
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
AI skills大全 mcp ai知识库 Agent 全维度 AI 资源百科,DSH插件 收录大模型、智能 Agent、RAG 检索增强、多模态、MLOps、AI 应用工具、AI面试集、Vibe coding 大全、零基础学习路线,持续更新前沿 AI 开源项目,开发者一站式 AI 导航库
🐢 Open-Source Evaluation & Testing library for LLM Agents
Machine Learning Pipelines for Kubeflow
A collection of scientific methods, processes, algorithms, and systems to build stories & models.
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务,VGPU虚拟化,云边端协同,边缘计算,自动化标注平台,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库llmops智能体,AI模型市场,支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等,支持ib/roce/RDMA,信创支持
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
An awesome & curated list of best LLMOps tools for developers
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Build, Manage and Deploy AI/ML Systems
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
Synapsa Commons: free, hands-on AI courses that run anywhere (Colab, Kaggle, Binder, Codespaces, Jupyter). EU AI Act conformity evidence, model validation, predictive maintenance, document extraction, retrieval and RAG, AI agents and MCP, a simulated humanoid. Every lesson autograded. From the team building Synapsa.
Distributed AI Model Training and LLM Fine-Tuning on Kubernetes
A curated collection of resources, tools, practices, case studies, and opportunities for Forward Deployed Engineers.
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
AI Infra / AI Orchestration / AI Control Plane
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
Welcome to the official repository for Batch18! 📚👩💻 Here, you'll find a organized collection of class notes, assignments, and code snippets generated during our sessions.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台,mlops算法链路全流程,算力租赁平台,notebook在线开发,拖拉拽任务流pipeline编排,多机多卡分布式训练,超参搜索,推理服务VGPU虚拟化,边缘计算,标注平台自动化标注,deepseek等大模型sft微调/奖励模型/强化学习训练,vllm/ollama/mindie大模型多机推理,私有知识库,AI模型市场,支持国产cpu/gpu/npu 昇腾生态,支持RDMA,支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式
LightlyStudio - The Unified Data Platform for Multimodal ML
Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
Learn how to create, develop, and maintain a state-of-the-art MLOps code base
Deprecated historical repo. Superlinked now develops SIE, a self-hosted inference engine for embeddings, reranking, OCR, extraction, and document processing.
skops is a Python library helping you share your scikit-learn based models and put them in production
A free, self-paced 24-week AI engineering course: Python, machine learning, LLMs, RAG, fine-tuning, agents and MCP, Azure and Vertex and Bedrock, and Databricks. 43 runnable notebooks, one continuous case study. MIT licensed, no signup. By Zorost Intelligence AI Lab.