We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.
Qian Huang, Minghao Hu, David J. Brady, "Array Camera Image Fusion using Physics-Aware Transformers" in Journal of Imaging Science and Technology, 2022, pp 060401-1 - 060401-14, https://doi.org/10.2352/J.ImagingSci.Technol.2022.66.6.060401