<!DOCTYPE article PUBLIC '-//NLM//DTD Journal Publishing DTD v2.1 20050630//EN' 'http://uploads.ingentaconnect.com/docs/dtd/ingenta-journalpublishing.dtd'>
<article article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="aggregator">72010604</journal-id>
      <journal-title>Electronic Imaging</journal-title>
      <issn pub-type="ppub">2470-1173</issn><issn pub-type="epub"></issn>
      <publisher>
        <publisher-name>Society for Imaging Science and Technology</publisher-name>
        <publisher-loc>7003 Kilworth Lane, Springfield, VA 22151 USA</publisher-loc>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.2352/ISSN.2470-1173.2020.16.AVM-149</article-id>
      <article-id pub-id-type="sici">2470-1173(20200126)2020:16L.1491;1-</article-id>
      <article-id pub-id-type="publisher-id">ei_24701173_v2020n16_input/s16.xml</article-id>
      <article-id pub-id-type="other">/ist/ei/2020/00002020/00000016/art00015</article-id>
      <article-categories>
        <subj-group>
          <subject>Articles</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Simulating tests to test simulation</article-title>
      </title-group>
      <contrib-group>
        <contrib>
          <name>
            <surname>Mueller</surname>
            <given-names>Patrick</given-names>
          </name>
        </contrib>
        <contrib>
          <name>
            <surname>Lehmann</surname>
            <given-names>Matthias</given-names>
          </name>
        </contrib>
        <contrib>
          <name>
            <surname>Braun</surname>
            <given-names>Alexander</given-names>
          </name>
        </contrib>
      </contrib-group>
      <pub-date>
        <day>26</day>
        <month>01</month>
        <year>2020</year>
      </pub-date>
      <volume>2020</volume>
      <issue>16</issue>
      <fpage>149-1</fpage>
      <lpage>149-8</lpage>
      <permissions>
        <copyright-year>2020</copyright-year>
      </permissions>
      <abstract>
        <p>
          <italic>Simulation is an established tool to develop and validate camera systems. The goal of autonomous driving is pushing simulation into a more important and fundamental role for safety, validation and coverage of billions of miles. Realistic camera models are moving more and more into
 focus, as simulations need to be more then photo-realistic, they need to be physical-realistic, representing the actual camera system onboard the self-driving vehicle in all relevant physical aspects – and this is not only true for cameras, but also for radar and lidar. But when the
 camera simulations are becoming more and more realistic, how is this realism tested? Actual, physical camera samples are tested in laboratories following norms like ISO12233, EMVA1288 or the developing P2020, with test charts like dead leaves, slanted edge or OECF-charts. In this article we
 propose to validate the realism of camera simulations by simulating the physical test bench setup, and then comparing the synthetical simulation result with physical results from the real-world test bench using the established normative metrics and KPIs. While this procedure is used sporadically
 in industrial settings we are not aware of a rigorous presentation of these ideas in the context of realistic camera models for autonomous driving. After the description of the process we give concrete examples for several different measurement setups using MTF and SFR, and show how these
 can be used to characterize the quality of different camera models.</italic>
        </p>
      </abstract>
      <kwd-group>
        <kwd>Sensor Simulation</kwd>
        <kwd>Validation</kwd>
        <kwd>Image Quality</kwd>
        <kwd>MTF</kwd>
        <kwd>SFR</kwd>
        <kwd>Slanted Edge</kwd>
        <kwd>Dead Leaves</kwd>
        <kwd>SSIM</kwd>
      </kwd-group>
    </article-meta>
  </front>
</article>
