Back to articles
Articles
Volume: 31 | Article ID: art00002
Image
Object-based and multi-frame motion information predict human eye movement patterns during video viewing
  DOI :  10.2352/ISSN.2470-1173.2019.12.HVEI-205  Published OnlineJanuary 2019
Abstract

Compared to low-level saliency, higher-level information better predicts human eye movement in static images. In the current study, we tested how both types of information predict eye movements while observers view videos. We generated multiple eye movement prediction maps based on low-level saliency features, as well as higher-level information that requires cognition, and therefore cannot be interpreted with only bottom-up processes. We investigated eye movement patterns to both static and dynamic features that contained either lowor higher-level information. We found that higher-level object-based and multi-frame motion information better predict human eye movement patterns than static saliency and two-frame motion information, and higher-level static and dynamic features provide equally good predictions. The results suggest that object-based processes and temporal integration of multiple video frames are essential to guide human eye movements during video viewing.

Subject Areas :
Views 19
Downloads 1
 articleview.views 19
 articleview.downloads 1
  Cite this article 

Zheng Ma, Jiaxin Wu, Sheng-hua Zhong, Stephen J Heinen, "Object-based and multi-frame motion information predict human eye movement patterns during video viewingin Proc. IS&T Int’l. Symp. on Electronic Imaging: Human Vision and Electronic Imaging,  2019,  pp 205-1 - 205-6,  https://doi.org/10.2352/ISSN.2470-1173.2019.12.HVEI-205

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2019
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
7003 Kilworth Lane, Springfield, VA 22151 USA