ovg-project / kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

nestrilabs / nestri

One GPU. Many sessions. All streamed remotely to anywhere.