Adaptive user interface design and analysis using emotion recognition through facial expressions and body posture from an RGB-D sensor.

ABSTRACT: This work presents the design and analysis of an Adaptive User Interface (AUI) for a desktop application that uses a novel solution for the recognition of the emotional state of a user through both facial expressions and body posture from an RGB-D sensor. Six basic emotions are recognized through facial expressions in addition to the physiological state, which is recognized through the body posture. The facial expressions and body posture are acquired in real-time from a Kinect sensor. A scoring system is used to improve recognition by minimizing the confusion between the different emotions. The implemented solution achieves an accuracy rate of above 90%. The recognized emotion is then used to derive an Automatic AUI where the user can use speech commands to modify the User Interface (UI)

SUBMITTER: Medjden S 

PROVIDER: S-EPMC7365406 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature