Dataset Information

Doppler Frequency-Shift Information Processing in WO_x -Based Memristive Synapse for Auditory Motion Perception.

ABSTRACT: Auditory motion perception is one crucial capability to decode and discriminate the spatiotemporal information for neuromorphic auditory systems. Doppler frequency-shift feature and interaural time difference (ITD) are two fundamental cues of auditory information processing. In this work, the functions of azimuth detection and velocity detection, as the typical auditory motion perception, are demonstrated in a WO_x -based memristive synapse. The WO_x memristor presents both the volatile mode (M1) and semi-nonvolatile mode (M2), which are capable of implementing the high-pass filtering and processing the spike trains with a relative timing and frequency shift. In particular, the Doppler frequency-shift information processing for velocity detection is emulated in the WO_x memristor based auditory system for the first time, which relies on a scheme of triplet spike-timing-dependent-plasticity in the memristor. These results provide new opportunities for the mimicry of auditory motion perception and enable the auditory sensory system to be applied in future neuromorphic sensing.

SUBMITTER: Zeng T

PROVIDER: S-EPMC10161103 | biostudies-literature | 2023 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Doppler Frequency-Shift Information Processing in WOx -Based Memristive Synapse for Auditory Motion Perception.

Zeng Tao T Wang Zhongqiang Z Lin Ya Y Cheng YanKun Y Shan Xuanyu X Tao Ye Y Zhao Xiaoning X Xu Haiyang H Liu Yichun Y

Advanced science (Weinheim, Baden-Wurttemberg, Germany) 20230302 13

Auditory motion perception is one crucial capability to decode and discriminate the spatiotemporal information for neuromorphic auditory systems. Doppler frequency-shift feature and interaural time difference (ITD) are two fundamental cues of auditory information processing. In this work, the functions of azimuth detection and velocity detection, as the typical auditory motion perception, are demonstrated in a WOx -based memristive synapse. The WOx memristor presents both t ...[more]

PMID: 36862024

Similar Datasets

Project description:Previous literature suggests a relationship between individual characteristics of motion perception and the peak frequency of motion sickness sensitivity. Here, we used well-established paradigms to relate motion perception and motion sickness on an individual level. We recruited 23 participants to complete a two-part experiment. In the first part, we determined individual velocity storage time constants from perceived rotation in response to Earth Vertical Axis Rotation (EVAR) and subjective vertical time constants from perceived tilt in response to centrifugation. The cross-over frequency for resolution of the gravito-inertial ambiguity was derived from our data using the Multi Sensory Observer Model (MSOM). In the second part of the experiment, we determined individual motion sickness frequency responses. Participants were exposed to 30-minute sinusoidal fore-aft motions at frequencies of 0.15, 0.2, 0.3, 0.4 and 0.5 Hz, with a peak amplitude of 2 m/s2 in five separate sessions, approximately 1 week apart. Sickness responses were recorded using both the MIsery SCale (MISC) with 30 s intervals, and the Motion Sickness Assessment Questionnaire (MSAQ) at the end of the motion exposure. The average velocity storage and subjective vertical time constants were 17.2 s (STD = 6.8 s) and 9.2 s (STD = 7.17 s). The average cross-over frequency was 0.21 Hz (STD = 0.10 Hz). At the group level, there was no significant effect of frequency on motion sickness. However, considerable individual variability was observed in frequency sensitivities, with some participants being particularly sensitive to the lowest frequencies, whereas others were most sensitive to intermediate or higher frequencies. The frequency of peak sensitivity did not correlate with the velocity storage time constant (r = 0.32, p = 0.26) or the subjective vertical time constant (r = - 0.37, p = 0.29). Our prediction of a significant correlation between cross-over frequency and frequency sensitivity was not confirmed (r = 0.26, p = 0.44). However, we did observe a strong positive correlation between the subjective vertical time constant and general motion sickness sensitivity (r = 0.74, p = 0.0006). We conclude that frequency sensitivity is best considered a property unique to the individual. This has important consequences for existing models of motion sickness, which were fitted to group averaged sensitivities. The correlation between the subjective vertical time constant and motion sickness sensitivity supports the importance of verticality perception during exposure to translational sickness stimuli.

Project description:Changes in the frequency content of sounds over time are arguably the most basic form of information about the behavior of sound-emitting objects. In perceptual studies, such changes have mostly been investigated separately, as aspects of either pitch or timbre. Here, we propose a unitary account of "up" and "down" subjective judgments of frequency change, based on a model combining auditory correlates of acoustic cues in a sound-specific and listener-specific manner. To do so, we introduce a generalized version of so-called Shepard tones, allowing symmetric manipulations of spectral information on a fine scale, usually associated to pitch (spectral fine structure, SFS), and on a coarse scale, usually associated timbre (spectral envelope, SE). In a series of behavioral experiments, listeners reported "up" or "down" shifts across pairs of generalized Shepard tones that differed in SFS, in SE, or in both. We observed the classic properties of Shepard tones for either SFS or SE shifts: subjective judgements followed the smallest log-frequency change direction, with cases of ambiguity and circularity. Interestingly, when both SFS and SE changes were applied concurrently (synergistically or antagonistically), we observed a trade-off between cues. Listeners were encouraged to report when they perceived "both" directions of change concurrently, but this rarely happened, suggesting a unitary percept. A computational model could accurately fit the behavioral data by combining different cues reflecting frequency changes after auditory filtering. The model revealed that cue weighting depended on the nature of the sound. When presented with harmonic sounds, listeners put more weight on SFS-related cues, whereas inharmonic sounds led to more weight on SE-related cues. Moreover, these stimulus-based factors were modulated by inter-individual differences, revealing variability across listeners in the detailed recipe for "up" and "down" judgments. We argue that frequency changes are tracked perceptually via the adaptive combination of a diverse set of cues, in a manner that is in fact similar to the derivation of other basic auditory dimensions such as spatial location.

Dataset Information

Doppler Frequency-Shift Information Processing in WO_x -Based Memristive Synapse for Auditory Motion Perception.

Publications

Doppler Frequency-Shift Information Processing in WO<sub>x</sub> -Based Memristive Synapse for Auditory Motion Perception.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets