Back to articles
Articles
Volume: 28 | Article ID: art00005
Image
A Real-Time System for Shoppers’ Action Recognition
  DOI :  10.2352/ISSN.2470-1173.2016.3.VSTIA-514  Published OnlineFebruary 2016
Abstract

The paper proposes a pose-based real-time system for inferring the engagement of a shopper with a retail shelf by recognizing some atomic actions of shelf-interaction. These actions include examining the shelf, reaching for an object, taking an object, reading a product’s label and placing it on a cart for check-out. A novel pose-representation that is robust to large intra-class variations while performing these retail actions, is proposed in this work. The paper also extends the framework to do real-time action segmentation, abnormal action detection and configurable privacy protection of shoppers. The abnormality detection also offers a scope for learning new un-modelled actions through crowdsourcing. Though the system currently relies on a Kinect sensor (RGBD) for computing the joints of the human body, the system can work with a combination of RGB surveillance camera and any 2D video-based pose-tracking algorithm. The system has an accuracy of 90% in recognizing the 5 actions considered in this work and exhibits a latency of about 1 sec w.r.t. real world action. This can have a huge potential in optimizing store resources and in improving the shopping experience of the customer.

Subject Areas :
Views 8
Downloads 3
 articleview.views 8
 articleview.downloads 3
  Cite this article 

Srenivas Varadarajan, Shahrokh Shahidzadeh, "A Real-Time System for Shoppers’ Action Recognitionin Proc. IS&T Int’l. Symp. on Electronic Imaging: Video Surveillance and Transportation Imaging Applications,  2016,  https://doi.org/10.2352/ISSN.2470-1173.2016.3.VSTIA-514

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2016
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA