Back to articles
Articles
Volume: 29 | Article ID: art00008
Image
Pre-training via fitting deep neural network to rich-model features extraction procedure and its effect on deep learning for steganalysis
  DOI :  10.2352/ISSN.2470-1173.2017.7.MWSF-324  Published OnlineJanuary 2017
Abstract

Recent studies have shown that the steganalytic approaches based on deep learning frameworks cannot surpass their rich?model features based companions in peiformance. According to our analysis, one of the main causes of the unsatisfactory performance of deep learning frameworks is that training procedure tends to get stuck at local plateaus or even diverge when starting from a non-ideal initial state. In this paper we will try to investi?gate how to fit deep neural network to a rich-model features set. We regard it as a pre-training procedure and study its 4fect on deep learning for steganalysis. The state-of-the-art JPEG steganalytic features set DCTR is selected as the target and its features extraction procedure is divided into multiple sub-models. A deep learning framework with similar sub-networks is proposed. In the pre-training procedure we train theframeworkfrom bottom to up, fitting the output of each sub-network to the actual output of the corresponding sub-module of DCTR. The motivation behind the scenario is that we reinforce the proposed framework learn to fit the nonlinear mapping implicit in DCTR and expect when it is trainedfrom an initial state which represents an approximate so?lution of DCTR, we can get better peiformance compared to what DCTR has achieved.

Subject Areas :
Views 58
Downloads 33
 articleview.views 58
 articleview.downloads 33
  Cite this article 

Jishen Zeng, Shunquan Tan, Bin Li, Jiwu Huang, "Pre-training via fitting deep neural network to rich-model features extraction procedure and its effect on deep learning for steganalysisin Proc. IS&T Int’l. Symp. on Electronic Imaging: Media Watermarking, Security, and Forensics,  2017,  pp 44 - 49,  https://doi.org/10.2352/ISSN.2470-1173.2017.7.MWSF-324

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
72010604
Electronic Imaging
2470-1173
Society for Imaging Science and Technology