T-Crypt / berth
Decides who gets your GPU. Chat, image and voice engines lease the card in turn instead of grabbing it, so two of them never load at once and crash each other. One Go binary, nothing else to install.
T-Crypt / berth
Project-HAMi / HAMi
Heterogeneous GPU Sharing on Kubernetes
NVIDIA / Personal-AI-Router
Router that virtually distributes inference across connected devices in the home.
NVIDIA / nvidia-container-toolkit
Build and run containers leveraging NVIDIA GPUs
ngthaihoc / CMP30HXmodtoGEN2
This project is inspired by CMP40HX-Unlock. If you find it useful, please consider giving a star to both the original author and this repository.
dsx-ai-factory / nvke
NVIDIA Kubernetes Engine (NVKE). A management plane for GPU Kubernetes on bare metal.
NVIDIA / gpu-operator
NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes
NVIDIA / aistore
AIStore: scalable storage for AI applications
utkuozdemir / nvidia_gpu_exporter
Nvidia GPU exporter for prometheus using nvidia-smi binary OR using NVML
parca-dev / parca-agent
eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!
kubernetes-sigs / dra-driver-nvidia-gpu
DRA Driver for NVIDIA GPUs
raids-lab / crater
Crater is a cloud-native AI training & inference platform.
kaito-project / aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
NVIDIA / cluster-readiness-engine
NVIDIA Cluster Readiness Engine
moezdil / siltide
Terminal fleet monitor for GPUs, NPUs, and 13 other accelerator kinds, from utilization down to which pod is using them.
NVIDIA / k8s-device-plugin
NVIDIA device plugin for Kubernetes