Analyzing animal behavior via classifying each video frame using convolutional neural networks.

ABSTRACT: High-throughput analysis of animal behavior requires software to analyze videos. Such software analyzes each frame individually, detecting animals' body parts. But the image analysis rarely attempts to recognize "behavioral states"-e.g., actions or facial expressions-directly from the image instead of using the detected body parts. Here, we show that convolutional neural networks (CNNs)-a machine learning approach that recently became the leading technique for object recognition, human pose estimation, and human action recognition-were able to recognize directly from images whether Drosophila were "on" (standing or walking) or "off" (not in physical contact with) egg-laying substrates for each frame of our videos. We used multiple nets and image transformations to optimize accuracy for our

SUBMITTER: Stern U 

PROVIDER: S-EPMC4585819 | biostudies-literature | 2015 Sep

REPOSITORIES: biostudies-literature