Back to articles
Articles
Volume: 31 | Article ID: art00004
Image
Dense prediction for micro-expression spotting based on deep sequence model
  DOI :  10.2352/ISSN.2470-1173.2019.8.IMAWM-401  Published OnlineJanuary 2019
Abstract

Micro-expression (ME) analysis has been becoming an attractive topic recently. Nevertheless, the studies of ME mostly focus on the recognition task while spotting task is rarely touched. While micro-expression recognition methods have obtained the promising results by applying deep learning techniques, the performance of the ME spotting task still needs to be largely improved. Most of the approaches still rely upon traditional techniques such as distance measurement between handcrafted features of frames which are not robust enough in detecting ME locations correctly. In this paper, we propose a novel method for ME spotting based on a deep sequence model. Our framework consists of two main steps: 1) From each position of video, we extract a spatial-temporal feature that can discriminate MEs among extrinsic movements. 2) We propose to use a LSTM network that can utilize both local and global correlation of the extracted feature to predict the score of the ME apex frame. The experiments on two publicly databases of ME spotting demonstrate the effectiveness of our proposed method.

Subject Areas :
Views 42
Downloads 9
 articleview.views 42
 articleview.downloads 9
  Cite this article 

Thuong-Khanh Tran, Quang-Nhat Vo, Xiaopeng Hong, Guoying Zhao, "Dense prediction for micro-expression spotting based on deep sequence modelin Proc. IS&T Int’l. Symp. on Electronic Imaging: Imaging and Multimedia Analytics in a Web and Mobile World,  2019,  pp 401-1 - 401-6,  https://doi.org/10.2352/ISSN.2470-1173.2019.8.IMAWM-401

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA