Cross-platform, customizable ML solutions for live and streaming media.
Open3D: A Modern Library for 3D Data Processing
GTSAM is a library of C++ classes that implement smoothing and mapping (SAM) in robotics and vision, using factor graphs and Bayes networks as the underlying computing paradigm rather than sparse matrices.
DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
Python sample codes and documents about Autonomous vehicle control algorithm. This project can be used as a technical guide book to study the algorithms and the software architectures for beginners.
An open ecosystem of parametric human models and perception stacks, starting with GNM Head.
Visual SLAM/odometry package based on NVIDIA-accelerated cuVSLAM
AI agents can generate code, but still struggle to understand what they build. Reticle brings Jev-style machine-native runtime perception to web & desktop applications.
β‘οΈThe spatial perception framework for rapidly building smart robots and spaces
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
Image similarity comparison simulating human perception (multiscale SSIM in Rust)
Sonic is a method about ' Shifting Focus to Global Audio Perception in Portrait Animation',you can use it in comfyUI
An image processing pipeline for ROS.
Gibson Environments: Real-World Perception for Embodied Agents
Thermal Comfort sensor for HA (absolute humidity, heat index, dew point, thermal perception)
Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson
Hierarchical perception library in Python for pose estimation, object detection, instance segmentation, keypoint estimation, face recognition, etc.
An open harness to simulate and deploy PX4/ArduPilot/Betaflight perception-based drone swarms with ROS2, YOLO, NVIDIA Jetson
This repository is a paper digest of recent advances in collaborative / cooperative / multi-agent perception for V2I / V2V / V2X autonomous driving scenario.
Converts a 3D Point Cloud into a 2D laser scan.
dddmr_navigation is the 3D navigation solution for mobile robots includes mapping/localization/perception/path planning/controller/navigation stack
Platform for Situated Intelligence
Open-source end-to-end omni interaction agent for natural full-duplex voice collaboration, continuous audio-visual perception, and asynchronous long-horizon agentic execution.
[IROS 2025] OceanSim: A GPU-Accelerated Underwater Robot Perception Simulation Framework
A brain that learns from live experience. System 1 by default: perception, memory, plasticity and action. Optional System 2 for self-observation and slow corrections.
OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction
PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models
An embodied task agent that connects perception, action, verification, and learning in a continuous physical-world loop
Real-time 3D digital twin of an autonomous warehouse β 20 AMRs, deterministic simulation, explainable fleet scheduling, failure injection, VLM camera perception, AI Ops Copilot and what-if scenarios. React Three Fiber + FastAPI.
UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
Modular perception, grasp planning, tracking, and sorting pipeline for ML robotics
[CORL2026] Official implementation of the paper: "OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes"
Perceptive behavioral foundation models for terrain-adaptive humanoid control: motion tracking, goal reaching, reward inference and teleoperation.
An open-source, hands-on mobile robotics course covering Jetson, ROS 2, AI perception, SLAM, autonomous navigation, semantic understanding, and robotic manipulation.
Embodied Passive Aeroacoustic Perception Enables Relative Sensing and Pursuit Between Aerial Robots
β
CAP: Continuously Adaptive Perception-Blind Humanoid Locomotion via Learned Denoising
β
Unified reproductions, benchmarking & evaluation for perception-aware RLVR and OPD in VLMs. 19 methods Β· 30+ benchmarks Β· Official code of CGPO (ACM MM 2026 Oral).
A VLM-powered robot agent harness for the Unitree G1, integrating natural-language planning, visual perception, semantic skills, and closed-loop execution.
Real-time YOLOv5s + UNet on RK3588 with OpenCL GPU-accelerated lens undistortion. Dual-camera AI perception system for autonomous driving assistance.
Build world models from scratch β from perception and latent dynamics to planning, JEPA, VLA, and 3D/4D intelligence.
Official implementation of "DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception"