Using Gaze for Behavioural Biometrics.
Ontology highlight
ABSTRACT:
SUBMITTER: D'Amelio A
PROVIDER: S-EPMC9920149 | biostudies-literature | 2023 Jan
REPOSITORIES: biostudies-literature
Publications
Using Gaze for Behavioural Biometrics.
D'Amelio Alessandro A Patania Sabrina S Bursic Sathya S Cuculo Vittorio V Boccignone Giuseppe G
Sensors (Basel, Switzerland) 20230122 3
A principled approach to the analysis of eye movements for behavioural biometrics is laid down. The approach grounds in foraging theory, which provides a sound basis to capture the uniqueness of individual eye movement behaviour. We propose a composite Ornstein-Uhlenbeck process for quantifying the exploration/exploitation signature characterising the foraging eye behaviour. The relevant parameters of the composite model, inferred from eye-tracking data via Bayesian analysis, are shown to yield ...[more]
Similar Datasets
Project description:Rest-activity patterns are important aspects of healthy sleep and may be disturbed in conditions like circadian rhythm disorders, insomnia, insufficient sleep syndrome, and neurological disorders. Long-term monitoring of rest-activity patterns is typically performed with diaries or actigraphy. Here, we propose an unobtrusive method to obtain rest-activity patterns using smartphone keyboard activity. The present study investigated whether this proposed method reliably estimates rest and activity timing compared to daily self-reports within healthy participants. First-year students (n = 51) used a custom smartphone keyboard to passively and objectively measure smartphone use behaviours and completed the Consensus Sleep Diary for 1 week. The time of the last keyboard activity before a nightly absence of keystrokes, and the time of the first keyboard activity following this period were used as markers. Results revealed high correlations between these markers and user-reported onset and offset of resting period (r ranged from 0.74 to 0.80). Linear mixed models could estimate onset and offset of resting periods with reasonable accuracy (R2 ranged from 0.60 to 0.66). This indicates that smartphone keyboard activity can be used to estimate rest-activity patterns. In addition, effects of chronotype and type of day were investigated. Implementing this method in longitudinal studies would allow for long-term monitoring of (disturbances to) rest-activity patterns, without user burden or additional costly devices. It could be particularly interesting to replicate these findings in studies amongst clinical populations with sleep-related problems, or in populations for whom disturbances in rest-activity patterns are secondary complaints, such as neurological disorders.
| S-EPMC8519005 | biostudies-literature
Project description:Evidence has shown that older adults have lower accuracy in Theory of Mind (ToM) tasks compared with young adults, but we are still unclear whether the difficulty in decoding mental states in older adults stems from not looking at the critical areas, and more so from the ageing Asian population. Most ToM studies use static images or short vignettes to measure ToM but these stimuli are dissimilar to everyday social interactions. We investigated this question using a dynamic task that measured both accuracy and error types, and examined the links between accuracy and error types to eye gaze fixation at critical areas (e.g., eyes, mouth, body). A total of 82 participants (38 older, 44 young adults) completed the Movie for the Assessment of Social Cognition (MASC) task on the eye tracker. Results showed that older adults had a lower overall accuracy with more errors in the ipo-ToM (under-mentalising) and no-ToM (lack of mentalisation) conditions compared with young adults. We analysed the eye gaze data using principal components analysis and found that increasing age and looking less at the face were related to lower MASC accuracy in our participants. Our findings suggest that ageing deficits in ToM are linked to a visual attention deficit specific to the perception of socially relevant nonverbal cues.
| S-EPMC11607846 | biostudies-literature
Project description:Mental state monitoring is a critical component of current and future human-machine interfaces, including semi-autonomous driving and flying, air traffic control, decision aids, training systems, and will soon be integrated into ubiquitous products like cell phones and laptops. Current mental state assessment approaches supply quantitative measures, but their only frame of reference is generic population-level ranges. What is needed are physiological biometrics that are validated in the context of task performance of individuals. Using curated intake experiments, we are able to generate personalized models of three key biometrics as useful indicators of mental state; namely, mental fatigue, stress, and attention. We demonstrate improvements to existing approaches through the introduction of new features. Furthermore, addressing the current limitations in assessing the efficacy of biometrics for individual subjects, we propose and employ a multi-level validation scheme for the biometric models by means of k-fold cross-validation for discrete classification and regression testing for continuous prediction. The paper not only provides a unified pipeline for extracting a comprehensive mental state evaluation from a parsimonious set of sensors (only EEG and ECG), but also demonstrates the use of validation techniques in the absence of empirical data. Furthermore, as an example of the application of these models to novel situations, we evaluate the significance of correlations of personalized biometrics to the dynamic fluctuations of accuracy and reaction time on an unrelated threat detection task using a permutation test. Our results provide a path toward integrating biometrics into augmented human-machine interfaces in a judicious way that can help to maximize task performance.
| S-EPMC5992431 | biostudies-literature
Project description:With the rapid growth of mobile network, tablets and smart phones have become sorts of keys to access personal secured services in our daily life. People use these devices to manage personal finances, shop on the Internet, and even pay at vending machines. Besides, it also helps us get connected with friends and business partners through social network applications, which were widely used as personal identifications in both real and virtual societies. However, these devices use inherently weak authentication mechanism, based upon passwords and PINs that is not changed all the time. Although forcing users to change password periodically can enhance the security level, it may also be considered annoyances for users. Biometric technologies are straightforward because of the simple authentication process. However, most of the traditional biometrics methodologies require diverse equipment to acquire biometric information, which may be expensive and not portable. This paper proposes a multibiometric user authentication scheme with both physiological and behavioral biometrics. Only simple rotations with fingers on multitouch devices are required to enhance the security level without annoyances for users. In addition, the user credential is replaceable to prevent from the privacy leakage.
| S-EPMC4131464 | biostudies-other
Project description:Social exclusion is a painful experience that is felt as a threat to the human need to belong and can lead to increased aggressive and anti-social behaviours, and results in emotional and cognitive numbness. Excluded individuals also seem to show an automatic tuning to positivity: they tend to increase their selective attention towards social acceptance signals. Despite these effects known in the literature, the consequences of social exclusion on social information processing still need to be explored in depth. The aim of this study was to investigate the effects of social exclusion on processing two features that are strictly bound in the appraisal of the meaning of facial expressions: gaze direction and emotional expression. In two experiments (N = 60, N = 45), participants were asked to identify gaze direction or emotional expressions from facial stimuli, in which both these features were manipulated. They performed these tasks in a four-block crossed design after being socially included or excluded using the Cyberball game. Participants' empathy and self-reported emotions were recorded using the Empathy Quotient (EQ) and PANAS questionnaires. The Need Threat Scale and three additional questions were also used as manipulation checks in the second experiment. In both experiments, excluded participants showed to be less accurate than included participants in gaze direction discrimination. Modulatory effects of direct gaze (Experiment 1) and sad expression (Experiment 2) on the effects of social exclusion were found on response times (RTs) in the emotion recognition task. Specific differences in the reaction to social exclusion between males and females were also found in Experiment 2: excluded male participants tended to be less accurate and faster than included male participants, while excluded females showed a more accurate and slower performance than included female participants. No influence of social exclusion on PANAS or EQ scores was found. Results are discussed in the context of the importance of identifying gaze direction in appraisal theories.
| S-EPMC5884539 | biostudies-literature
Project description:We introduce a novel paradigm to unobtrusively and optically measure blood pressure (BP) without calibration. The algorithm combines photoplethysmography (PPG) waveform analysis and biometrics to estimate BP, and was evaluated in subjects with various age, height, weight and BP levels (n = 1249). In the young population (<50 years old) with low, medium and high systolic blood pressures (SBP, <120 mmHg; 120-139 mmHg; ≥140 mmHg), the fitting errors are 6.3 ± 7.2, -3.9 ± 7.2 and -20.2 ± 14.2 mmHg for SBP respectively; In the older population (>50 years old) with the same categories, the fitting errors are 12.8 ± 9.0, 0.5 ± 8.2 and -14.6 ± 11.5 mmHg for SBP respectively. A simple personalized calibration reduces fitting errors significantly (n = 147), and good peripheral perfusion helps to improve the fitting accuracy. In conclusion, PPG may be used to calculate BP without calibration in certain populations. When calibrated, it shows great potential to serially monitor BP fluctuation, which can bring tremendous economic and health benefits.
| S-EPMC6565722 | biostudies-literature
Project description:The Cattle Biometrics Dataset is the result of a rigorous process of data collecting, encompassing a wide range of cattle photographs obtained from publicly accessible cattle markets and farms. The dataset provided contains a comprehensive collection of more than 8,000 annotated samples derived from several cow breeds. This dataset represents a valuable asset for conducting research in the field of biometric recognition. The diversity of cattle in this context includes a range of ages, genders, breeds, and environmental conditions. Every photograph is taken from different quality cameras is thoroughly annotated, with special attention given to the muzzle of the cattle, which is considered an excellent biometric characteristic. In addition to its obvious practical benefits, this dataset possesses significant potential for extensive reuse. Within the domain of computer vision, it serves as a catalyst for algorithmic advancements, whereas in the agricultural sector, it augments practises related to cattle management. Machine learning aficionados highly value the use of machine learning for the construction and experimentation of models, especially in the context of transfer learning. Interdisciplinary collaboration is actively encouraged, facilitating the advancement of knowledge at the intersections of agriculture, computer science, and data science. The Cattle Biometrics Dataset represents a valuable resource that has the potential to stimulate significant advancements in various academic disciplines, fostering ground breaking research and innovation.
| S-EPMC10869238 | biostudies-literature
Project description:The signature has long been in use for the user verification. These signatures have user specific features that differentiate the individual for authentication. The signature verification can be offline or online. The offline verification considers only the static features of the signatures through the signature image, while the online verification considers various dynamic features associated with the signature such as pen pressure, pen tilt angle, velocity, acceleration, pen up and pen down, etc at various time stamps which are recorded using special digitizing tablets such as Wacom devices (STU-500, STU-530 and DTU-1031) [1,14] etc. In todays scenario, smartphones are widely used world-wide, and come equipped with various sensors e.g. accelerometer, gyroscope, magnetometer, GPS, etc. able to capture sensor logs and have been used widely in the literature to capture the dynamics of users' behaviour while a signer signs on his smartphone. However, there is scarcity of publicly available databases for the online signatures collected using smartphone. In the present work, we describe biometric signature dataset iSignDB captured using smartphone. The iSignDB [6,10] consists of the genuine signature samples of a user as well as the skilled forgery samples where imposter was given multiple attempts to mimic the mannerisms of the original signer before giving skilled forgery samples. A total of 30 samples towards the genuine signature over 3 sessions with 10 samples per session while 15 samples of the skilled forgery with 5 samples per session were collected. Each of the session were at least 15 days apart. The iOS and Android based smartphones (namely iPhone7 and Redmi Note 7) were used for the data collection. The sensors used to collect this data, present in the smartphone are the gyroscope, magnetometer, GPS, and accelerometer. Smartphones having sensors any one lesser than these four, were not used for data collection, in order to have consistent number of features under each sample. They generate the following sensor readings: angular velocity, acceleration, orientation, geomagnetic field in the x, y, and z directions, position, which is collected using the MATLAB Mobile App installed in the smartphone, that sends the data to a licensed MathWorks cloud account in the form of a multitude of sensor logs. Each sample has image of the signature along with sensor readings. Some of the publicly available smartphone biometric signature databases are DooDB [2], MOBISIG [3], eBioSign DS 2 [7], etc. in which at least acceleration sensor reading is present but the iSignDB ensures these five of the sensor readings (acceleration, angular velocity, magnetic field, orientation, position) under each sample. This dataset can be successfully used to design smartphone biometric signature authentication system which is robust against a number of spoof attacks [11], [12], [13], [14]. As every user has a unique way of handling his/her smartphone which varies over different level of emotional intelligence of the user over a time period, this dataset can also be used for behavioural analysis of the users.
| S-EPMC7725742 | biostudies-literature
Project description:Particularities in the individuals' style of walking have been explored for at least three decades as a biometric trait, empowering the automatic gait recognition field. Whereas gait recognition works usually focus on improving end-to-end performance measures, this work aims at understanding which individuals' traces are more relevant to improve subjects' separability. For such, a manifold projection technique and a multi-sensor gait dataset were adopted to investigate the impact of each data source characteristics on this separability. Assessments have shown it is hard to distinguish individuals based only on their walking patterns in a subject-based identification scenario. In this setup, the subjects' separability is more related to their physical characteristics than their movements related to gait cycles and biomechanical events. However, this study's results also points to the feasibility of learning identity characteristics from individuals' walking patterns learned from similarities and differences between subjects in a verification setup. The explorations concluded that periodic components occurring in frequencies between 6 and 10 Hz are more significant for learning these patterns than events and other biomechanical movements related to the gait cycle, as usually explored in the literature.
| S-EPMC9120026 | biostudies-literature
Project description:The existing electrocardiogram (ECG) biometrics do not perform well when ECG changes after the enrollment phase because the feature extraction is not able to relate ECG collected during enrollment and ECG collected during classification. In this research, we propose the sequence pair feature extractor, inspired by Bidirectional Encoder Representations from Transformers (BERT)'s sentence pair task, to obtain a dynamic representation of a pair of ECGs. We also propose using the self-attention mechanism of the transformer to draw an inter-identity relationship when performing ECG identification tasks. The model was trained once with datasets built from 10 ECG databases, and then, it was applied to six other ECG databases without retraining. We emphasize the significance of the time separation between enrollment and classification when presenting the results. The model scored 96.20%, 100.0%, 99.91%, 96.09%, 96.35%, and 98.10% identification accuracy on MIT-BIH Atrial Fibrillation Database (AFDB), Combined measurement of ECG, Breathing and Seismocardiograms (CEBSDB), MIT-BIH Normal Sinus Rhythm Database (NSRDB), MIT-BIH ST Change Database (STDB), ECG-ID Database (ECGIDDB), and PTB Diagnostic ECG Database (PTBDB), respectively, over a short time separation. The model scored 92.70% and 64.16% identification accuracy on ECGIDDB and PTBDB, respectively, over a long time separation, which is a significant improvement compared to state-of-the-art methods.
| S-EPMC9100332 | biostudies-literature