Back to articles
Proceedings
Volume: 36 | Article ID: IQSP-259
Image
Benchmarking Motion Blur of Video Frame Interpolation Using Hybrid EVS+CIS Against CIS
  DOI :  10.2352/EI.2024.36.9.IQSP-259  Published OnlineJanuary 2024
Abstract
Abstract

Event-based vision Sensors (EVS) utilize smart pixels capable of detecting whether relative illumination changes exceed a predefined temporal contrast threshold on a pixel level. As EVS asynchronously read these events, they provide low-latency and high-temporal resolution suitable for complementing conventional CMOS Image Sensors (CIS). Emerging hybrid CIS+EVS sensors fuse the high spatial resolution intensity frames with low latency event information to enhance applications such as deblur or video-frame interpolation (VFI) for slow-motion video capture. This paper employs an edge sharpness-based metric-Blurred Edge Width (BEW) to benchmark EVS-assisted slow-motion capture against CIS-only solutions. The EVS-assisted VFI interpolates a CIS video steam with a framerate of 120 fps by 64x, yielding an interpolated framerate of 7680 fps. We observed that the added information from EVS dramatically outperforms a 120 fps CIS-only VFI solution. Furthermore, the hybrid EVS+CIS-based VFI achieves comparable performance as high-speed CIS-only solutions that capture frames directly at 480 fps or 1920 fps and incorporate additional CIS-only VFI. These, however, do so at significantly lower data rates. In our study, factors 2.6 and 10.5 were observed.

Subject Areas :
Views 154
Downloads 28
 articleview.views 154
 articleview.downloads 28
  Cite this article 

Kamal Rana, Sean Fausz, Zhiyao Yang, Fangwen Tu, Qinyi Wang, Boyd Fowler, Andreas Suess, Bo Mu, "Benchmarking Motion Blur of Video Frame Interpolation Using Hybrid EVS+CIS Against CISin Electronic Imaging,  2024,  pp 259-1 - 259-5,  https://doi.org/10.2352/EI.2024.36.9.IQSP-259

 Copy citation
  Copyright statement 
Copyright © 2024, Society for Imaging Science and Technology 2024
ei
Electronic Imaging
2470-1173
2470-1173
Society for Imaging Science and Technology
IS&T 7003 Kilworth Lane, Springfield, VA 22151 USA