<!DOCTYPE article PUBLIC '-//NLM//DTD Journal Publishing DTD v2.1 20050630//EN' 'http://uploads.ingentaconnect.com/docs/dtd/ingenta-journalpublishing.dtd'>
<article article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="aggregator">72010604</journal-id>
      <journal-title>Electronic Imaging</journal-title>
      <issn pub-type="ppub">2470-1173</issn><issn pub-type="epub"></issn>
      <publisher>
        <publisher-name>Society for Imaging Science and Technology</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.2352/ISSN.2470-1173.2017.15.DPMI-063</article-id>
      <article-id pub-id-type="sici">2470-1173(20170129)2017:15L.7;1-</article-id>
      <article-id pub-id-type="publisher-id">s2.phd</article-id>
      <article-id pub-id-type="other">/ist/ei/2017/00002017/00000015/art00002</article-id>
      <article-categories>
        <subj-group>
          <subject>Articles</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Stabilized High-Speed Video from Camera Arrays</article-title>
      </title-group>
      <contrib-group>
        <contrib>
          <name>
            <surname>El Choubassi</surname>
            <given-names>Maha</given-names>
          </name>
        </contrib>
        <contrib>
          <name>
            <surname>Nestares</surname>
            <given-names>Oscar</given-names>
          </name>
        </contrib>
      </contrib-group>
      <pub-date>
        <day>29</day>
        <month>01</month>
        <year>2017</year>
      </pub-date>
      <volume>2017</volume>
      <issue>15</issue>
      <fpage>7</fpage>
      <lpage>13</lpage>
      <permissions>
        <copyright-year>2017</copyright-year>
      </permissions>
      <abstract>
        <p>We present an algorithm to get high-speed video using camera array with good perceptual quality in realistic scenes that may have clutter and complex background. We synchronize the cameras such that each captures an image at a different time offset. The algorithm processes the jittery
 interleaved frames and produces a stabilized video. Our method consists of: synthesis of views from a virtual camera to correct for differences in cameras perspectives, and video compositing to remove remaining artifacts especially around disocclusions. More explicitly, we process the optical
 flow of the raw video to estimate, for each raw frame, the disparity to the target virtual frame. We input these disparities to content-aware warping to synthesize the virtual views, significantly alleviating the jitter. Yet, while the warping fills the disocclusion holes, the filling may
 not be coherent temporally, leading to small jitter still visible in static/slow regions around large disocclusions. However, these regions don't benefit from high rate in high-speed video. Therefore, we extract low frame rate regions from only one camera and video composite them with the
 remaining highly moving regions taken by all cameras. The final video is smooth and efficiently has high frame rate in high motion regions.</p>
      </abstract>
      <kwd-group>
        <kwd>HIGH-SPEED VIDEO</kwd>
        <kwd>CAMERA ARRAYS</kwd>
        <kwd>VIEW SYNTHESIS</kwd>
        <kwd>DISOCCLUSION ARTIFACTS</kwd>
        <kwd>VIDEO COMPOSITING</kwd>
        <kwd>HIGH FRAME RATE</kwd>
        <kwd>ADAPTIVE FRAME RATE</kwd>
        <kwd>DISPARITY ESTIMATION</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
