LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization
InfiniTensor is a high-performance inference engine tailored for GPUs and AI accelerators. Its design focuses on effective deployment and swift academic validation.
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
AMD + OptiScaler DLSS 5/6X & XeFG 30X Multi-Frame Generation integration, configurations and deployment guides. AMD + OptiScaler 多帧生成方案,支持 DLSS 5/6X 与 XeFG 30X,附配置及部署教程。
Offline translation model server with low resource consumption, fast speed, and private deployment capability. 低资源占用速度快可私有部署的离线翻译模型服务器
Infrastructure to enable deployment of ML models to low-power resource-constrained embedded targets (including microcontrollers and digital signal processors).
Open Robotics Automation Virtual Environment: An environment for testing, developing, and deploying robotics motion planning algorithms.
An open harness to simulate and deploy PX4/ArduPilot/Betaflight perception-based drone swarms with ROS2, YOLO, NVIDIA Jetson
强化学习平衡步兵,单片机上部署的伪代码
RoboMaster26赛季的部署库与模型开源仓库
This project is used to deploy applications written using QML, qt or other С / С++ frameworks.
NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). Fork of Neroued/ninfer with sm70 vision-encoding speedup.
Mcrouter is a memcached protocol router for scaling memcached deployments.
Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
All-in-one solution for creating networked applications with RPC, pub/sub, server deployment, and more.
Freescale/NXP I.MX Chip image deploy tools.
🛰️ An approximate nearest-neighbor search library for Python and Java with a focus on ease of use, simplicity, and deployability.
mono / stereo depth estimation + yolo object detection with deployment on Jeston nano / TX2 / GeForce by TensorRT