Cognitive load classification of mixed reality human computer interaction tasks based on multimodal sensor signals.

ABSTRACT: Evaluating cognitive load in mixed reality (MR) has become a significant challenge in human-computer interaction (HCI). To address this, we established an MR multimodal experimental platform with three distinct environments to induce varying levels of cognitive load. Participants engaged in MR-based CNC machine tool interaction tasks within these environments. Using the built-in sensors of the HoloLens 2 mixed reality head-mounted display (MR-HMD) and wearable heart rate sensors, we collected device and physiological data from participants wearing the MR-HMD while performing these tasks. The cognitive load of participants was assessed by using the NASA-TLX questionnaire. Experimental results indicated that the operation time required in the MR environment increased by 49% under high cognit

SUBMITTER: Hou Y 

PROVIDER: S-EPMC12012078 | biostudies-literature | 2025 Apr

REPOSITORIES: biostudies-literature