A spatiotemporal style transfer algorithm for dynamic visual stimulus generation.

ABSTRACT: Understanding how visual information is encoded in biological and artificial systems often requires the generation of appropriate stimuli to test specific hypotheses, but available methods for video generation are scarce. Here we introduce the spatiotemporal style transfer (STST) algorithm, a dynamic visual stimulus generation framework that allows the manipulation and synthesis of video stimuli for vision research. We show how stimuli can be generated that match the low-level spatiotemporal features of their natural counterparts, but lack their high-level semantic features, providing a useful tool to study object recognition. We used these stimuli to probe PredNet, a predictive coding deep network, and found that its next-frame predictions were not disrupted by the omission of high-level

SUBMITTER: Greco A 

PROVIDER: S-EPMC11860245 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature