A pipeline for estimating human attention toward objects with on-board cameras on the iCub humanoid robot.

ABSTRACT: This research report introduces a learning system designed to detect the object that humans are gazing at, using solely visual feedback. By incorporating face detection, human attention prediction, and online object detection, the system enables the robot to perceive and interpret human gaze accurately, thereby facilitating the establishment of joint attention with human partners. Additionally, a novel dataset collected with the humanoid robot iCub is introduced, comprising more than 22,000 images from ten participants gazing at different annotated objects. This dataset serves as a benchmark for human gaze estimation in table-top human-robot interaction (HRI) contexts. In this work, we use it to assess the proposed pipeline's performance and examine each component's effectiveness. Furtherm

SUBMITTER: Hanifi S 

PROVIDER: S-EPMC11524796 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature