flyteorg / flyte

Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)

axem-solutions / shaide

Self-hosted, distributed, multi-model LLM inference