Probing the Link Between Vision and Language in Material Perception Using Psychophysics and Unsupervised Learning.

ABSTRACT: We can visually discriminate and recognize a wide range of materials. Meanwhile, we use language to express our subjective understanding of visual input and communicate relevant information about the materials. Here, we investigate the relationship between visual judgment and language expression in material perception to understand how visual features relate to semantic representations. We use deep generative networks to construct an expandable image space to systematically create materials of well-defined and ambiguous categories. From such a space, we sampled diverse stimuli and compared the representations of materials from two behavioral tasks: visual material similarity judgments and free-form verbal descriptions. Our findings reveal a moderate but significant correlation between visi

SUBMITTER: Liao C 

PROVIDER: S-EPMC10849714 | biostudies-literature | 2024 May

REPOSITORIES: biostudies-literature