AI News Hub Logo

AI News Hub

Vision-Based Human Awareness Estimation for Enhanced Safety and Efficiency of AMRs in Industrial Warehouses

cs.CV updates on arXiv.org
Maximilian Haug (Fraunhofer Austria Research GmbH, Vienna, Austria), Christian Stippel (Computer Vision Lab, TU Wien, Vienna, Austria), Lukas Pscherer (Digital Factory Vorarlberg GmbH, Dornbirn, Austria), Benjamin Schwendinger (Fraunhofer Austria Research GmbH, Vienna, Austria), Ralph Hoch (Digital Factory Vorarlberg GmbH, Dornbirn, Austria, Institute of Computer Technology, TU Wien, Vienna, Austria), Angel Gaydarov (Fraunhofer Austria Research GmbH, Vienna, Austria), Sebastian Schlund (Fraunhofer Austria Research GmbH, Vienna, Austria), Thilo Sauter (Institute of Computer Technology, TU Wien, Vienna, Austria)

arXiv:2604.18627v1 Announce Type: new Abstract: Ensuring human safety is of paramount importance in warehouse environments that feature mixed traffic of human workers and autonomous mobile robots (AMRs). Current approaches often treat humans as generic dynamic obstacles, leading to conservative AMR behaviors like slowing down or detouring, even when workers are fully aware and capable of safely sharing space. This paper presents a real-time vision-based method to estimate human awareness of an AMR using a single RGB camera. We integrate state-of-the-art 3D human pose lifting with head orientation estimation to ascertain a human's position relative to the AMR and their viewing cone, thereby determining if the human is aware of the AMR. The entire pipeline is validated using synthetically generated data within NVIDIA Isaac Sim, a robust physics-accurate robotics simulation environment. Experimental results confirm that our system reliably detects human positions and their attention in real time, enabling AMRs to safely adapt their motion based on human awareness. This enhancement is crucial for improving both safety and operational efficiency in industrial and factory automation settings.