Python sample codes and documents about Autonomous vehicle control algorithm. This project can be used as a technical guide book to study the algorithms and the software architectures for beginners.
Cross-platform, customizable ML solutions for live and streaming media.
Perceptive behavioral foundation models for terrain-adaptive humanoid control: motion tracking, goal reaching, reward inference and teleoperation.
PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".
Open-source ROS-based software stack for autonomous driving, covering perception, planning, and control for vehicles.
An open ecosystem of parametric human models and perception stacks, starting with GNM Head.
Open3D: A Modern Library for 3D Data Processing
GTSAM is a library of C++ classes that implement smoothing and mapping (SAM) in robotics and vision, using factor graphs and Bayes networks as the underlying computing paradigm rather than sparse matrices.
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
An embodied task agent that connects perception, action, verification, and learning in a continuous physical-world loop
β‘οΈThe spatial perception framework for rapidly building smart robots and spaces
Thermal Comfort sensor for HA (absolute humidity, heat index, dew point, thermal perception)
An open harness to simulate and deploy PX4/ArduPilot/Betaflight perception-based drone swarms with ROS2, YOLO, NVIDIA Jetson
[IROS 2025] OceanSim: A GPU-Accelerated Underwater Robot Perception Simulation Framework
Sonic is a method about ' Shifting Focus to Global Audio Perception in Portrait Animation',you can use it in comfyUI
This repository is a paper digest of recent advances in collaborative / cooperative / multi-agent perception for V2I / V2V / V2X autonomous driving scenario.
dddmr_navigation is the 3D navigation solution for mobile robots includes mapping/localization/perception/path planning/controller/navigation stack
A brain that learns from live experience. System 1 by default: perception, memory, plasticity and action. Optional System 2 for self-observation and slow corrections.
Real-time 3D digital twin of an autonomous warehouse β 20 AMRs, deterministic simulation, explainable fleet scheduling, failure injection, VLM camera perception, AI Ops Copilot and what-if scenarios. React Three Fiber + FastAPI.
An open-source, hands-on mobile robotics course covering Jetson, ROS 2, AI perception, SLAM, autonomous navigation, semantic understanding, and robotic manipulation.
Embodied Passive Aeroacoustic Perception Enables Relative Sensing and Pursuit Between Aerial Robots
Visual SLAM/odometry package based on NVIDIA-accelerated cuVSLAM
Image similarity comparison simulating human perception (multiscale SSIM in Rust)
An image processing pipeline for ROS.
Gibson Environments: Real-World Perception for Embodied Agents
Hierarchical perception library in Python for pose estimation, object detection, instance segmentation, keypoint estimation, face recognition, etc.
Converts a 3D Point Cloud into a 2D laser scan.
Platform for Situated Intelligence
OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction
PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models
UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
[CORL2026] Official implementation of the paper: "OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes"
β
CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising
β
Build world models from scratch β from perception and latent dynamics to planning, JEPA, VLA, and 3D/4D intelligence.
Official implementation of "DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception"
Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson
Modular perception, grasp planning, tracking, and sorting pipeline for ML robotics
Unified reproductions, benchmarking & evaluation for perception-aware RLVR and OPD in VLMs. 19 methods Β· 30+ benchmarks Β· Official code of CGPO (ACM MM 2026 Oral).
AI agents can generate code, but still struggle to understand what they build. Reticle brings Jev-style machine-native runtime perception to web & desktop applications.
Open-source end-to-end omni interaction agent for natural full-duplex voice collaboration, continuous audio-visual perception, and asynchronous long-horizon agentic execution.
Real-time YOLOv5s + UNet on RK3588 with OpenCL GPU-accelerated lens undistortion. Dual-camera AI perception system for autonomous driving assistance.
A VLM-powered robot agent harness for the Unitree G1, integrating natural-language planning, visual perception, semantic skills, and closed-loop execution.