Drop-in CUDA replacement that runs unmodified CUDA applications on non-NVIDIA GPUs.
Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.
Drop-in CUDA replacement that runs unmodified CUDA applications on non-NVIDIA GPUs.
Serves language models from a Zig binary on Apple Silicon and NVIDIA GPUs using Metal and CUDA kernels.