Back to articles
Articles
Volume: 28 | Article ID: art00015
Image
Deep network for analyzing gait patterns in low resolution video towards threat identification.
  DOI :  10.2352/ISSN.2470-1173.2016.11.IMAWM-471  Published OnlineFebruary 2016
Abstract

We propose a deep regression-based neural network to analyze gait of individuals in low resolution video for real-time detection of abnormal activity/threats in surveillance applications. In todays commercial setting, extracting such gait patterns require motion capture devices such as Kinect or VICON, and is restricted to indoor and controlled scenarios such as in gaming applications or clinical studies. The network is trained by incorporating an inverse kinematic Groebner-based model to estimate the body joint angles from the pose. These angle trajectories of the upper and lower extremities of the body serve as gait signatures for identifying threat patterns. The first few layers model the relationship between motion and image features of the individual using a deep belief network. The next few layers model the relationship between the latent features generated from deep belief nets and the inverse kinematic model using a regression-based deep network. This network characterizes the relationship between the low-level image/motion features and the kinematics associated with the movement of an individual. The estimated joint angle trajectories are then classified as threats (person wearing a loaded vest) and non-threats (person without any load on body) using a K-Nearest Neighbor classifier. Experimental results on the INSPIRE dataset released by Air force institute of technology and its analysis show the effectiveness of deep learning concepts for gait analysis.

Subject Areas :
Views 30
Downloads 3
 articleview.views 30
 articleview.downloads 3
  Cite this article 

Binu M Nair, Kimberly D Kendricks, "Deep network for analyzing gait patterns in low resolution video towards threat identification.in Proc. IS&T Int’l. Symp. on Electronic Imaging: Imaging and Multimedia Analytics in a Web and Mobile World,  2016,  https://doi.org/10.2352/ISSN.2470-1173.2016.11.IMAWM-471

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2016
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA