kserve / kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

agentjido / req_llm

Composable Elixir library for LLM interactions built on Req and Finch