<!DOCTYPE article PUBLIC '-//NLM//DTD Journal Publishing DTD v2.1 20050630//EN' 'http://uploads.ingentaconnect.com/docs/dtd/ingenta-journalpublishing.dtd'>
<article article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="aggregator">72010604</journal-id>
      <journal-title>Electronic Imaging</journal-title>
      <issn pub-type="ppub">2470-1173</issn><issn pub-type="epub"></issn>
      <publisher>
        <publisher-name>Society for Imaging Science and Technology</publisher-name>
        <publisher-loc>7003 Kilworth Lane, Springfield, VA 22151 USA</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.2352/ISSN.2470-1173.2019.4.PMII-577</article-id>
      <article-id pub-id-type="sici">2470-1173(20190113)2019:4L.5771;1-</article-id>
      <article-id pub-id-type="publisher-id">ei_24701173_v2019n4_input/s2.xml</article-id>
      <article-id pub-id-type="other">/ist/ei/2019/00002019/00000004/art00003</article-id>
      <article-categories>
        <subj-group>
          <subject>Articles</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Autofocus by deep reinforcement learning</article-title>
      </title-group>
      <contrib-group>
        <contrib>
          <name>
            <surname>Chan</surname>
            <given-names>Chin-Cheng</given-names>
          </name>
        </contrib>
        <contrib>
          <name>
            <surname>Chen</surname>
            <given-names>Homer H</given-names>
          </name>
        </contrib>
      </contrib-group>
      <pub-date>
        <day>13</day>
        <month>01</month>
        <year>2019</year>
      </pub-date>
      <volume>2019</volume>
      <issue>4</issue>
      <fpage>577-1</fpage>
      <lpage>577-6</lpage>
      <permissions>
        <copyright-year>2019</copyright-year>
      </permissions>
      <abstract>
        <p>In recent years, smartphones have become the primary device for day-to-day photography. Therefore, it is critical for mobile imaging to capture sharp images automatically without human intervention. In this paper, we formulate autofocus as a decisionmaking process, in which the travel
 distance of a lens is determined from the phase data obtained from the phase sensors of a smartphone, and the decision-making policy is based on reinforcement learning, a popular technique in the field of deep learning. We propose to use a noise-tolerant reward function to combat the noise
 of the phase data. In addition, instead of using only the current phase data, each lens movement is determined using the phase data acquired along the journey of an autofocus process. As a result, the proposed machine-learning approach is able to expedite the autofocus process as well. Experimental
 results show that the method indeed improves the autofocus speed.</p>
      </abstract>
      <kwd-group>
        <kwd>Phase detection autofocus</kwd>
        <kwd>Reinforcement learning</kwd>
        <kwd>Deep learning</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
