Factorized visual representations in the primate visual system and deep neural networks.

ABSTRACT: Object classification has been proposed as a principal objective of the primate ventral visual stream and has been used as an optimization target for deep neural network models (DNNs) of the visual system. However, visual brain areas represent many different types of information, and optimizing for classification of object identity alone does not constrain how other information may be encoded in visual representations. Information about different scene parameters may be discarded altogether ('invariance'), represented in non-interfering subspaces of population activity ('factorization') or encoded in an entangled fashion. In this work, we provide evidence that factorization is a normative principle of biological visual representations. In the monkey ventral visual hierarchy, we found that

SUBMITTER: Lindsey JW 

PROVIDER: S-EPMC11226229 | biostudies-literature | 2024 Jul

REPOSITORIES: biostudies-literature