Crossmodal benefits to vocal emotion perception in cochlear implant users.
Ontology highlight
ABSTRACT:
SUBMITTER: von Eiff CI
PROVIDER: S-EPMC9791346 | biostudies-literature | 2022 Dec
REPOSITORIES: biostudies-literature
Publications
Crossmodal benefits to vocal emotion perception in cochlear implant users.
von Eiff Celina Isabelle CI Frühholz Sascha S Korth Daniela D Guntinas-Lichius Orlando O Schweinberger Stefan Robert SR
iScience 20221202 12
Speech comprehension counts as a benchmark outcome of cochlear implants (CIs)-disregarding the communicative importance of efficient integration of audiovisual (AV) socio-emotional information. We investigated effects of time-synchronized facial information on vocal emotion recognition (VER). In Experiment 1, 26 CI users and normal-hearing (NH) individuals classified emotions for auditory-only, AV congruent, or AV incongruent utterances. In Experiment 2, we compared crossmodal effects between gr ...[more]
Similar Datasets
Project description:For the perception of timbre of a musical instrument, the attack time is known to hold crucial information. The first 50 to 150 ms of sound onset reflect the excitation mechanism, which generates the sound. Since auditory processing and music perception in particular are known to be hampered in cochlear implant (CI) users, we conducted an electroencephalography (EEG) study with an oddball paradigm to evaluate the processing of small differences in musical sound onset. The first 60 ms of a cornet sound were manipulated in order to examine whether these differences are detected by CI users and normal-hearing controls (NH controls), as revealed by auditory evoked potentials (AEPs). Our analysis focused on the N1 as an exogenous component known to reflect physical stimuli properties as well as on the P2 and the Mismatch Negativity (MMN). Our results revealed different N1 latencies as well as P2 amplitudes and latencies for the onset manipulations in both groups. An MMN could be elicited only in the NH control group. Together with additional findings that suggest an impact of musical training on CI users' AEPs, our findings support the view that impaired timbre perception in CI users is at partly due to altered sound onset feature detection.
| S-EPMC3448664 | biostudies-literature
Project description:ObjectivesResearch on cochlear implants (CIs) has focused on speech comprehension, with little research on perception of vocal emotions. We compared emotion perception in CI users and normal-hearing (NH) individuals, using parameter-specific voice morphing.DesignTwenty-five CI users and 25 NH individuals (matched for age and gender) performed fearful-angry discriminations on bisyllabic pseudoword stimuli from morph continua across all acoustic parameters (Full), or across selected parameters (F0, Timbre, or Time information), with other parameters set to a noninformative intermediate level.ResultsUnsurprisingly, CI users as a group showed lower performance in vocal emotion perception overall. Importantly, while NH individuals used timbre and fundamental frequency (F0) information to equivalent degrees, CI users were far more efficient in using timbre (compared to F0) information for this task. Thus, under the conditions of this task, CIs were inefficient in conveying emotion based on F0 alone. There was enormous variability between CI users, with low performers responding close to guessing level. Echoing previous research, we found that better vocal emotion perception was associated with better quality of life ratings.ConclusionsSome CI users can utilize timbre cues remarkably well when perceiving vocal emotions.
| S-EPMC9197138 | biostudies-literature
Project description:Prelingually deaf children listening through cochlear implants (CIs) face severe limitations on their experience of music, since the hearing device degrades relevant details of the acoustic input. An important parameter of music is harmony, which conveys emotional as well as syntactic information. The present study addresses musical harmony in three psychoacoustic experiments in young, prelingually deaf CI listeners and normal-hearing (NH) peers. The discrimination and preference of typical musical chords were studied, as well as cadence sequences conveying musical syntax. The ability to discriminate chords depended on the hearing age of the CI listeners, and was less accurate than for the NH peers. The groups did not differ with respect to the preference of certain chord types. NH listeners were able to categorize cadences, and performance improved with age at testing. In contrast, CI listeners were largely unable to categorize cadences. This dissociation is in accordance with data found in postlingually deafened adults. Consequently, while musical harmony is available to a limited degree to CI listeners, they are unable to use harmony to interpret musical syntax.
| S-EPMC6518352 | biostudies-literature
Project description:Spectrotemporal modulation (STM) detection performance was examined for cochlear implant (CI) users. The test involved discriminating between an unmodulated steady noise and a modulated stimulus. The modulated stimulus presents frequency modulation patterns that change in frequency over time. In order to examine STM detection performance for different modulation conditions, two different temporal modulation rates (5 and 10 Hz) and three different spectral modulation densities (0.5, 1.0, and 2.0 cycles/octave) were employed, producing a total 6 different STM stimulus conditions. In order to explore how electric hearing constrains STM sensitivity for CI users differently from acoustic hearing, normal-hearing (NH) and hearing-impaired (HI) listeners were also tested on the same tasks. STM detection performance was best in NH subjects, followed by HI subjects. On average, CI subjects showed poorest performance, but some CI subjects showed high levels of STM detection performance that was comparable to acoustic hearing. Significant correlations were found between STM detection performance and speech identification performance in quiet and in noise. In order to understand the relative contribution of spectral and temporal modulation cues to speech perception abilities for CI users, spectral and temporal modulation detection was performed separately and related to STM detection and speech perception performance. The results suggest that that slow spectral modulation rather than slow temporal modulation may be important for determining speech perception capabilities for CI users. Lastly, test-retest reliability for STM detection was good with no learning. The present study demonstrates that STM detection may be a useful tool to evaluate the ability of CI sound processing strategies to deliver clinically pertinent acoustic modulation information.
| S-EPMC4617902 | biostudies-literature
Project description:Objectives: Improved perception of environmental sounds (PES) is one of the primary benefits of cochlear implantation (CI). However, past research contains mixed findings on PES ability in contemporary CI users, which at times contrast with anecdotal clinical reports. The present review examined extant PES research to provide an evidence basis for clinical counseling, identify knowledge gaps, and suggest directions for future work in this area of CI outcome assessment. Methods: Six electronic databases were searched using medical subject headings (MeSH) and keywords broadly identified to reference CI and environmental sounds. Records published between 2000 and 2021 were screened by two independent reviewers in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement to identify studies that met the inclusion criteria. Data were subsequently extracted and evaluated according to synthesis without-meta-analysis (SWiM) guidelines. Results: Nineteen studies met the inclusion criteria. Most examined PES in post-lingually implanted adults, with one study focused on pre/perilingual adults. Environmental sound identification (ESI) in quiet using open- or closed-set response format was most commonly used in PES assessment, included in all selected studies. ESI accuracy in CI children (3 studies) and adults (16 studies), was highly variable but generally mediocre (means range: 31-87%). Only two studies evaluated ESI performance prospectively before and after CI, while most studies were cross-sectional. Overall, CI performance was consistently lower than that of normal-hearing peers. No significant differences in identification accuracy were reported between CI candidates and CI users. Environmental sound identification correlated in CI users with measures of speech perception, music and spectro-temporal processing. Conclusion: The findings of this systematic review indicate considerable limitations in the current knowledge of PES in contemporary CI users, especially in pre/perilingual late-implanted adults and children. Although no overall improvement in PES following implantation was found, large individual variability and existing methodological limitations in PES assessment may potentially obscure potential CI benefits for PES. Further research in this ecologically relevant area of assessment is needed to establish a stronger evidence basis, identify CI users with significant deficits, and improve CI users' safety and satisfaction through targeted PES rehabilitation.
| S-EPMC8785216 | biostudies-literature
Project description:Speech-perception testing is essential for monitoring outcomes with a hearing aid or cochlear implant (CI). However, clinical care is time-consuming and often challenging with an increasing number of clients. A potential approach to alleviating some clinical care and possibly making room for other outcome measures is to employ technologies that assess performance in the home environment. In this study, we investigate 3 different speech perception indices in the same 40 CI users: phoneme identification (vowels and consonants), digits in noise (DiN) and sentence recognition in noise (SiN). The first two tasks were implemented on a tablet and performed multiple times by each client in their home environment, while the sentence task was administered at the clinic. Speech perception outcomes in the same forty CI users showed that DiN assessed at home can serve as an alternative to SiN assessed at the clinic. DiN scores are in line with the SiN ones by 3-4 dB improvement and are useful to monitor performance at regular intervals and to detect changes in auditory performance. Phoneme identification in quiet also explains a significant part of speech perception in noise, and provides additional information on the detectability and discriminability of speech cues. The added benefit of the phoneme identification task, which also proved to be easy to administer at home, is the information transmission analysis in addition to the summary score. Performance changes for the different indices can be interpreted by comparing against measurement error and help to target personalized rehabilitation. Altogether, home-based speech testing is reliable and proves powerful to complement care in the clinic for CI users.
| S-EPMC8669965 | biostudies-literature
Project description:The objectives were to evaluate the relationships among music perception, appraisal, and experience in cochlear implant users in multiple clinical settings and to examine the viability of two assessments designed for clinical use.Background questionnaires (IMBQ) were administered by audiologists in 14 clinics in the United States and Canada. The CAMP included tests of pitch-direction discrimination, and melody and timbre recognition. The IMBQ queried users on prior musical involvement, music listening habits pre and post implant, and music appraisals.One-hundred forty-five users of Advanced Bionics and Cochlear Ltd cochlear implants.Performance on pitch direction discrimination, melody recognition, and timbre recognition tests were consistent with previous studies with smaller cohorts, as well as with more extensive protocols conducted in other centers. Relationships between perceptual accuracy and music enjoyment were weak, suggesting that perception and appraisal are relatively independent for CI users.Perceptual abilities as measured by the CAMP had little to no relationship with music appraisals and little relationship with musical experience. The CAMP and IMBQ are feasible for routine clinical use, providing results consistent with previous thorough laboratory-based investigations.
| S-EPMC4297259 | biostudies-literature
Project description:ObjectivesThe study objective was to characterize cochlear implant (CI) pitch perception for pure, complex, and modulated tones for frequencies and fundamental frequencies in the ecologically essential range between 110 and 440 Hz. Stimulus manipulations were used to examine CI users' reliance on stimulation place and rate cues for pitch discrimination.DesignThe study was a within-subjects design with 21 CI users completing pitch discrimination measures using pure, complex, and modulated tones. Stimulus manipulations were used to test whether CI users have better pitch discrimination for low-pass compared with high-pass filtered harmonic complexes, and to test whether they have better pitch discrimination when provided a covarying place cue when listening to amplitude-modulated tones.ResultsAveraged across conditions, participants had better pitch discrimination for pure tones compared with either complex or amplitude-modulated tones. Participants had better pitch discrimination for low-pass compared with high-pass harmonic complexes and better pitch discrimination for amplitude-modulated tones when provided a covarying place cue.ConclusionsCI users integrate place and rate cues across the ecologically essential pitch range between 110 and 440 Hz. We interpret the observed better pitch discrimination for low-pass compared with high-pass filtered harmonics complexes, and for amplitude-modulated tones when provided a covarying place cue, as evidence for the importance of providing place-of-excitation cues for fundamental frequencies below 440 Hz. Discussion considers how such encoding could be implemented with existing devices.
| S-EPMC10593103 | biostudies-literature
Project description:ObjectiveCochlear implant (CI) recipient's speech perception performance is highly variable and is influenced by temporal processing abilities. Temporal processing is commonly assessed using a behavioral task that requires the participant to detect a silent gap with the pre- and post-gap stimuli of the same frequency (within-frequency gap detection) or of different frequencies (across-frequency gap detection). The purpose of the study was to evaluate behavioral and electrophysiological measures of within- and across-frequency temporal processing and their correlations with speech perception performance in CI users.DesignParticipants included 11 post-lingually deafened adult CI users (n = 15 ears; Mean Age = 50.2 yrs) and 11 age- and gender-matched normal hearing (NH) individuals (n = 15 ears; Mean Age = 49.0 yrs). Speech perception was assessed with Consonant-Nucleus-Consonant Word Recognition (CNC), Arizona Biomedical Sentence Recognition (AzBio), and Bamford-Kowal-Bench Speech-in-Noise Test (BKB-SIN) tests. Within- and across-frequency behavioral gap detection thresholds (referred to as the GDTwithin and GDTacross) were measured using an adaptive, two-alternative, forced-choice procedure. Cortical auditory evoked potentials (CAEPs) were elicited using within- and across-frequency gap stimuli under four gap duration conditions (no gap, GDT, sub-threshold GDT, and supra-threshold GDT). Correlations among speech perception, GDTs, and CAEPs were examined.ResultsCI users had poorer speech perception scores compared to NH listeners (p < 0.05), but the GDTs were not different between groups (p > 0.05). Compared to NH peers, CI users showed increased N1 latency in the CAEPs evoked by the across-frequency gap stimuli (p < 0.05). No group difference was observed for the CAEPs evoked by the within-frequency gap (p > 0.05). Three CI ears showing the longest GDTwithin also showed the poorest performance in speech in noise. The within-frequency CAEP increased in amplitude with the increase of gap duration; while the across-frequency CAEP displayed a similar amplitude for all gap durations. There was a significant correlation between speech scores and within-frequency CAEP measures for the supra-threshold GDT condition, with CI users with poorer speech performance having a smaller N1-P2 amplitude and longer N1 latency. No correlations were found among GDTacross, speech perception, and across-frequency CAEP measures.ConclusionsWithin- and across-frequency gap detection may involve different neural mechanisms. The within-frequency gap detection task can help identify CI users with poor speech performance for rehabilitation. The within-frequency CAEP is a better predictor for speech perception performance than the across-frequency CAEP.
| S-EPMC9560480 | biostudies-literature
Project description:ObjectivesPrevious studies investigating speech perception in noise have typically been conducted with static masker positions. The aim of this study was to investigate the effect of spatial separation of source and masker (spatial release from masking, SRM) in a moving masker setup and to evaluate the impact of adaptive beamforming in comparison with fixed directional microphones in cochlear implant (CI) users.DesignSpeech reception thresholds (SRT) were measured in S0N0 and in a moving masker setup (S0Nmove) in 12 normal hearing participants and 14 CI users (7 subjects bilateral, 7 bimodal with a hearing aid in the contralateral ear). Speech processor settings were a moderately directional microphone, a fixed beamformer, or an adaptive beamformer. The moving noise source was generated by means of wave field synthesis and was smoothly moved in a shape of a half-circle from one ear to the contralateral ear. Noise was presented in either of two conditions: continuous or modulated.ResultsSRTs in the S0Nmove setup were significantly improved compared to the S0N0 setup for both the normal hearing control group and the bilateral group in continuous noise, and for the control group in modulated noise. There was no effect of subject group. A significant effect of directional sensitivity was found in the S0Nmove setup. In the bilateral group, the adaptive beamformer achieved lower SRTs than the fixed beamformer setting. Adaptive beamforming improved SRT in both CI user groups substantially by about 3 dB (bimodal group) and 8 dB (bilateral group) depending on masker type.ConclusionsCI users showed SRM that was comparable to normal hearing subjects. In listening situations of everyday life with spatial separation of source and masker, directional microphones significantly improved speech perception with individual improvements of up to 15 dB SNR. Users of bilateral speech processors with both directional microphones obtained the highest benefit.
| S-EPMC4430230 | biostudies-literature