triton-inference-server / server

git clone https://github.com/triton-inference-server/server.git

The Triton Inference Server provides an optimized cloud and edge inferencing solution.