google-ai-edge / LiteRT

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

InfiniTensor / InfiniTensor

InfiniTensor is a high-performance inference engine tailored for GPUs and AI accelerators. Its design focuses on effective deployment and swift academic validation.

a756598009-cmyk / DLSS5-6x-AMD-OptiScaler

AMD + OptiScaler DLSS 5/6X & XeFG 30X Multi-Frame Generation integration, configurations and deployment guides. AMD + OptiScaler 多帧生成方案，支持 DLSS 5/6X 与 XeFG 30X，附配置及部署教程。

xxnuo / MTranServer

Offline translation model server with low resource consumption, fast speed, and private deployment capability. 低资源占用速度快可私有部署的离线翻译模型服务器

tensorflow / tflite-micro

Infrastructure to enable deployment of ML models to low-power resource-constrained embedded targets (including microcontrollers and digital signal processors).

facebook / mcrouter

Mcrouter is a memcached protocol router for scaling memcached deployments.

QuasarApp / CQtDeployer

This project is used to deploy applications written using QML, qt or other С / С++ frameworks.

dollarwong / ninfer-v100

NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). Fork of Neroued/ninfer with sm70 vision-encoding speedup.

SZURPVision / 26_NNDeployment_Lib_and_Detection_Models

RoboMaster26赛季的部署库与模型开源仓库

zeroc-ice / ice

All-in-one solution for creating networked applications with RPC, pub/sub, server deployment, and more.

yzfzzz / depth-detect

mono / stereo depth estimation + yolo object detection with deployment on Jeston nano / TX2 / GeForce by TensorRT