BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.

ashhart / TensorFold

Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.