Deep Neural Networks (DNNs) are critical for real-time imaging applications including autonomous vehicles. DNNs are often trained and validated with images that originate from a limited number of cameras, each of which has its own hardware and image signal processing (ISP) characteristics. However, in most real-time embedded systems, the input images come from a variety of cameras with different ISP pipelines, and often include perturbations due to a variety of scene conditions. Data augmentation methods are commonly exploited to enhance the robustness of such systems. Alternatively, methods are employed to detect input images that are unfamiliar to the trained networks, including out of distribution detection. Despite these efforts DNNs remain widely systems with operational boundaries that cannot be easily defined. One reason is that, while training and benchmark image datasets include samples with a variety of perturbations, there is a lack of research in the areas of metrification of input image quality suitable to DNNs and a universal method to relate quality to DNN performance using meaningful quality metrics. This paper addresses this lack of metrification specific to DNNs systems and introduces a framework that uses systematic modification of image quality attributes and relate input image quality to DNN performance.
SARS-CoV-2 is a highly contagious, airborne-transmission, virus that can be spread by people who do not have obvious symptoms. In 2020, that combination of features forced much of the world to impose a wide variety of forms of social distancing, ranging from simple recommendations restricting how shared spaces can be used to rigidly enforced quarantines. It is unclear how much distancing is enough, but it is clear that the economic and emotional costs of distancing are high. Fortunately, consistent use of simple face masks dramatically reduces the probability of others becoming infected. The catch is that a significant fraction of the US population either is refusing to wear masks or is wearing masks in ways that render them ineffective. For example, it is problematic for a shop owner to prevent potential customers who are not properly masked from entering their store. Thus, we have created the Covered Safe Entry Scanner–an open source system that uses image processing methods to automatically check for proper use of masks and potentially deny entry to those who do not comply. This paper describes the design, algorithms, and performance of the mask recognition system.