Semantic Pooling for Complex Event Analysis in Untrimmed Videos.

ABSTRACT: Pooling plays an important role in generating a discriminative video representation. In this paper, we propose a new semantic pooling approach for challenging event analysis tasks (e.g., event detection, recognition, and recounting) in long untrimmed Internet videos, especially when only a few shots/segments are relevant to the event of interest while many other shots are irrelevant or even misleading. The commonly adopted pooling strategies aggregate the shots indifferently in one way or another, resulting in a great loss of information. Instead, in this work we first define a novel notion of semantic saliency that assesses the relevance of each shot with the event of interest. We then prioritize the shots according to their saliency scores since shots that are semantically more salient a

SUBMITTER: Xiaojun Chang 

PROVIDER: S-EPMC5570670 | biostudies-literature | 2017 Aug

REPOSITORIES: biostudies-literature