Back to articles
Articles
Volume: 33 | Article ID: art00010
Image
Practical Automatic Thumbnail Generation for Short Videos
  DOI :  10.2352/ISSN.2470-1173.2021.8.IMAWM-283  Published OnlineJanuary 2021
Abstract

With the availability of fast internet and convenient imaging devices such as smart phones, videos are becoming increasingly popular and important content on social media platforms recently. They are widely adopted for various purposes including, but not limited to, advertisement, education and entertainment. One important problem in understanding videos is thumbnail generation, which involves selecting one or a few images, typically frames, which are representative of the given video. These thumbnails can then be used not only as a summary display for videos, but also for representing them in downstream content models. Thus, thumbnail selection plays an important role in a user’s experience when exploring and consuming videos. Due to the large scale of data, automatic thumbnail generation methods are desired since it is impossible to manually select thumbnails for all videos. In this paper, we propose a practical thumbnail generation method. Our method is designed in a way that will select representative and high-quality frames as thumbnails. Specifically, to capture semantic information of video frames, we leverage the embeddings of video frames generated by a state of the art con-volutional neural network pretrained in a supervised manner on external image data, using them to find representative frames in a semantic space. To efficiently evaluate the quality of each frame, we train a linear model on top of the embeddings to predict quality instead of computing it from raw pixels. We conduct experiments on real videos and show the proposed algorithm is able to generate relevant and engaging thumbnails.

Subject Areas :
Views 18
Downloads 5
 articleview.views 18
 articleview.downloads 5
  Cite this article 

Bin Shen, Nikil Pancha, Andrew Zhai, Charles Rosenberg, "Practical Automatic Thumbnail Generation for Short Videosin Proc. IS&T Int’l. Symp. on Electronic Imaging: Imaging and Multimedia Analytics in a Web and Mobile World,  2021,  pp 283-1 - 283-7,  https://doi.org/10.2352/ISSN.2470-1173.2021.8.IMAWM-283

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2021
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane Springfield, VA 22151 USA