Toward learning robust contrastive embeddings for binaural sound source localization.

ABSTRACT: Recent deep neural network based methods provide accurate binaural source localization performance. These data-driven models map measured binaural cues directly to source locations hence their performance highly depend on the training data distribution. In this paper, we propose a parametric embedding that maps the binaural cues to a low-dimensional space where localization can be done with a nearest-neighbor regression. We implement the embedding using a neural network, optimized to map points that are close to each other in the latent space (the space of source azimuths or elevations) to nearby points in the embedding space, thus the Euclidean distances between the embeddings reflect their source proximities, and the structure of the embeddings forms a manifold, which provides interpreta

SUBMITTER: Tang D 

PROVIDER: S-EPMC9709308 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature