Reconstructing faces from fMRI patterns using deep generative neural networks.
Ontology highlight
ABSTRACT: Although distinct categories are reliably decoded from fMRI brain responses, it has proved more difficult to distinguish visually similar inputs, such as different faces. Here, we apply a recently developed deep learning system to reconstruct face images from human fMRI. We trained a variational auto-encoder (VAE) neural network using a GAN (Generative Adversarial Network) unsupervised procedure over a large data set of celebrity faces. The auto-encoder latent space provides a meaningful, topologically organized 1024-dimensional description of each image. We then presented several thousand faces to human subjects, and learned a simple linear mapping between the multi-voxel fMRI activation patterns and the 1024 latent dimensions. Finally, we applied this mapping to novel test images, transl
SUBMITTER: VanRullen R
PROVIDER: S-EPMC6529435 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
ACCESS DATA