Back to articles
Article
Volume: 35 | Article ID: IPAS-296
Image
ILIAC: Efficient classification of degraded images using knowledge distillation with cutout data augmentation
  DOI :  10.2352/EI.2023.35.9.IPAS-296  Published OnlineJanuary 2023
Abstract
Abstract

Image classification is extensively used in various applications such as satellite imagery, autonomous driving, smartphones, and healthcare. Most of the images used to train classification models can be considered ideal, i.e., without any degradation either due to corruption of pixels in the camera sensors, sudden shake blur, or the compression of images in a specific format. In this paper, we have proposed a novel CNN-based architecture for image classification of degraded images based on intermediate layer knowledge distillation and data augmentation approach cutout named ILIAC. Our approach achieves 1.1%, and 0.4% mean accuracy improvements for all the degradation levels of JPEG and AWGN, respectively, compared to the current state-of-the-art approach. Furthermore, ILIAC method is efficient in computational capacity, i.e., about half the size of the previous state-of-the-art approach in terms of model parameters and GFlops count. Additionally, we demonstrate that we do not necessarily need a larger teacher network in knowledge distillation to improve the model performance and generalization of a smaller student network for the classification of degraded images.

Subject Areas :
Views 206
Downloads 52
 articleview.views 206
 articleview.downloads 52
  Cite this article 

Dinesh Daultani, Masayuki Tanaka, Masatoshi Okutomi, Kazuki Endo, "ILIAC: Efficient classification of degraded images using knowledge distillation with cutout data augmentationin Electronic Imaging,  2023,  pp 296-1 - 296-6,  https://doi.org/10.2352/EI.2023.35.9.IPAS-296

 Copy citation
  Copyright statement 
Copyright © 2023, Society for Imaging Science and Technology 2023
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA