Back to articles
Article
Volume: 35 | Article ID: MWSF-378
Image
Pros and cons of comparing and combining hand-crafted and neural network based DeepFake detection based on eye blinking behavior
  DOI :  10.2352/EI.2023.35.4.MWSF-378  Published OnlineJanuary 2023
Abstract
Abstract

DeepFakes are a recent trend in computer vision, posing a thread to authenticity of digital media. For the detection of DeepFakes most prominently neural network based approaches are used. Those detectors often lack explanatory power on why the given decision was made, due to their black-box nature. Furthermore, taking the social, ethical and legal perspective (e.g. the upcoming European Commission in the Artificial Intelligence Act) into account, black-box decision methods should be avoided and Human Oversight should be guaranteed. In terms of explainability of AI systems, many approaches work based on post-hoc visualization methods (e.g. by back-propagation) or the reduction of complexity. In our paper a different approach is used, combining hand-crafted as well as neural network based components analyzing the same phenomenon to aim for explainability. The exemplary chosen semantic phenomenon analyzed here is the eye blinking behavior in a genuine or DeepFake video. Furthermore, the impact of video duration on the classification result is evaluated empirically, so that a minimum duration threshold can be set to reasonably detect DeepFakes.

Subject Areas :
Views 131
Downloads 48
 articleview.views 131
 articleview.downloads 48
  Cite this article 

Dennis Siegel, Stefan Seidlitz, Christian Krätzer, Jana Dittmann, "Pros and cons of comparing and combining hand-crafted and neural network based DeepFake detection based on eye blinking behaviorin Electronic Imaging,  2023,  pp 378-1 - 378-6,  https://doi.org/10.2352/EI.2023.35.4.MWSF-378

 Copy citation
  Copyright statement 
Copyright This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. 2023
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA