Isaac Sim Digital Twin Synchronization with Human Tracking and Weapon Detection | Unitree Go2 ROS2

In this video, we demonstrate a real-time digital twin synchronization system using a Unitree Go2 quadruped robot, ROS2, Zenoh, and NVIDIA Isaac Sim.

The system recognizes human positions and detects potential weapons from the robot-side perception module, then transmits selected ROS2 topic data from the robot’s Expansion Dock to a remote PC over Wi-Fi. The remote PC visualizes the results and synchronizes detected human targets inside an Isaac Sim digital twin environment.

This experiment focuses on connecting real-world perception data with a virtual simulation environment, enabling real-time monitoring, threat recognition, and digital twin-based situational awareness.

[ System Overview ]
- Robot Platform: Unitree Go2 EDU
- Expansion Dock: Jetson Orin NX
- Robot-side OS/ROS: Ubuntu 20.04 + ROS2 Foxy
- Remote PC: ROS2 Humble + Isaac Sim
- Communication: DDS, ROS2 topics, Zenoh Bridge, 5GHz Wi-Fi
- Perception: Human location recognition and weapon detection
- Digital Twin: Isaac Sim avatar/object synchronization

[ Main Features ]
- Real-time human location tracking
- Weapon detection and danger-state recognition
- ROS2 topic-based data transmission
- Zenoh-based remote communication between robot and PC
- Isaac Sim digital twin synchronization
- Visualization of real-world perception results in a virtual environment

This project is part of a robotics digital twin and security monitoring system designed to connect mobile robot perception with remote simulation and situational awareness.

#UnitreeGo2 #IsaacSim #DigitalTwin #ROS2 #Zenoh #Robotics #WeaponDetection #HumanTracking #JetsonOrinNX #RobotSimulation

Видео Isaac Sim Digital Twin Synchronization with Human Tracking and Weapon Detection | Unitree Go2 ROS2 канала Gorilla79