triton-inference-server / server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

triton-inference-server / tensorrtllm_backend

The Triton TensorRT-LLM Backend

triton-inference-server / tutorials

This repository contains tutorials and examples for Triton Inference Server

triton-inference-server / client

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

triton-inference-server / python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

CoinCheung / BiSeNet

Add bisenetv2. My implementation of BiSeNet