Back to articles
Article
Volume: 35 | Article ID: MWSF-380
Image
Detecting GAN-generated synthetic images using semantic inconsistencies
  DOI :  10.2352/EI.2023.35.4.MWSF-380  Published OnlineJanuary 2023
Abstract
Abstract

In the past several years, generative adversarial networks have emerged that are capable of creating realistic synthetic images of human faces. Because these images can be used for malicious purposes, researchers have begun to develop techniques to synthetic images. Currently, the majority of existing techniques operate by searching for statistical traces introduced when an image is synthesized by a GAN. An alternative approach that has received comparatively less research involves using semantic inconsistencies detect synthetic images. While GAN-generated synthetic images appear visually realistic at first glance, they often contain subtle semantic inconsistencies such as inconsistent eye highlights, misaligned teeth, unrealistic hair textures, etc. In this paper, we propose a new approach to detect GAN-generated images of human faces by searching for semantic inconsistencies in multiple different facial features such as the eyes, mouth, and hair. Synthetic image detection decisions are made by fusing the outputs of these facial-feature-level detectors. Through a series of experiments, we demonstrate that this approach can yield strong synthetic image detection performance. Furthermore, we experimentally demonstrate that our approach is less susceptible to performance degradations caused by post-processing than CNN-based detectors utilize statistical traces.

Subject Areas :
Views 93
Downloads 37
 articleview.views 93
 articleview.downloads 37
  Cite this article 

Danial Samadi Vahdati, Matthew C. Stamm, "Detecting GAN-generated synthetic images using semantic inconsistenciesin Electronic Imaging,  2023,  pp 380-1 - 380-6,  https://doi.org/10.2352/EI.2023.35.4.MWSF-380

 Copy citation
  Copyright statement 
Copyright © 2023, Society for Imaging Science and Technology 2023
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA