Back to articles
Article
Volume: 34 | Article ID: CVAA-169
Image
Improving semantic segmentation of fine art images using photographs rendered in a style learned from artworks
  DOI :  10.2352/EI.2022.34.13.CVAA-169  Published OnlineJanuary 2022
Abstract
Abstract

Our central goal was to create automatic methods for semantic segmentation of human figures in images of fine art paintings. This is a difficult problem because the visual properties and statistics of artwork differ markedly from the natural photographs widely used in research in automatic segmentation. We used a deep neural network to transfer artistic style from paintings across several centuries to modern natural photographs in order to create a large data set of surrogate art images. We then used this data set to train a separate deep network for semantic image segmentation of genuine art images. Such data augmentation led to great improvement in the segmentation of difficult genuine artworks, revealed both qualitatively and quantitatively. Our unique technique of creating surrogate artworks should find wide use in many tasks in the growing field of computational analysis of fine art.

Subject Areas :
Views 82
Downloads 28
 articleview.views 82
 articleview.downloads 28
  Cite this article 

Thomas Heitzinger, David G. Stork, "Improving semantic segmentation of fine art images using photographs rendered in a style learned from artworksin Proc. IS&T Int’l. Symp. on Electronic Imaging: Computer Vision and Image Analysis of Art,  2022,  pp 169-1 - 169-5,  https://doi.org/10.2352/EI.2022.34.13.CVAA-169

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2022
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA