Back to articles
Volume: 28 | Article ID: art00005
A Real-Time System for Shoppers’ Action Recognition
  DOI :  10.2352/ISSN.2470-1173.2016.3.VSTIA-514  Published OnlineFebruary 2016

The paper proposes a pose-based real-time system for inferring the engagement of a shopper with a retail shelf by recognizing some atomic actions of shelf-interaction. These actions include examining the shelf, reaching for an object, taking an object, reading a product’s label and placing it on a cart for check-out. A novel pose-representation that is robust to large intra-class variations while performing these retail actions, is proposed in this work. The paper also extends the framework to do real-time action segmentation, abnormal action detection and configurable privacy protection of shoppers. The abnormality detection also offers a scope for learning new un-modelled actions through crowdsourcing. Though the system currently relies on a Kinect sensor (RGBD) for computing the joints of the human body, the system can work with a combination of RGB surveillance camera and any 2D video-based pose-tracking algorithm. The system has an accuracy of 90% in recognizing the 5 actions considered in this work and exhibits a latency of about 1 sec w.r.t. real world action. This can have a huge potential in optimizing store resources and in improving the shopping experience of the customer.

Subject Areas :
Views 14
Downloads 4
 articleview.views 14
 articleview.downloads 4
  Cite this article 

Srenivas Varadarajan, Shahrokh Shahidzadeh, "A Real-Time System for Shoppers’ Action Recognitionin Proc. IS&T Int’l. Symp. on Electronic Imaging: Video Surveillance and Transportation Imaging Applications,  2016,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2016
Electronic Imaging
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA