A novel feature-scrambling approach reveals the capacity of convolutional neural networks to learn spatial relations.

ABSTRACT: Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet it remains poorly understood how CNNs actually make their decisions, what the nature of their internal representations is, and how their recognition strategies differ from humans. Specifically, there is a major debate about the question of whether CNNs primarily rely on surface regularities of objects, or whether they are capable of exploiting the spatial arrangement of features, similar to humans. Here, we develop a novel feature-scrambling approach to explicitly test whether CNNs use the spatial arrangement of features (i.e. object parts) to classify

SUBMITTER: Farahat A 

PROVIDER: S-EPMC7616855 | biostudies-literature | 2023 Oct

REPOSITORIES: biostudies-literature