1. Automated simulation-generated EO/IR image library for artificial intelligence applications
- Author
-
David C. Bell, Corey D. Packard, Mark D. Klein, Peter L. Rynes, and Timothy S. Viola
- Subjects
Pixel ,Computer science ,business.industry ,Deep learning ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Process (computing) ,Image processing ,Field (computer science) ,Code (cryptography) ,Computer vision ,Applications of artificial intelligence ,Artificial intelligence ,State (computer science) ,business - Abstract
The emergence of machine learning into scientific fields has created opportunities for novel and powerful image processing techniques. Algorithms that can perform complex tasks without a “man-in-the-loop” or explicit instructions are invaluable artificial intelligence tools. These algorithms typically require a large set of training data on which to base statistical predictions. In the case of electro-optical infrared (EO/IR) remote sensing, algorithm designers often seek a substantial library of images comprising many weather conditions, times of day, sensor resolutions, etc. These images may be synthetic (predicted) or measured, but should encompass a large variety of targets imaged from a variety of vantage points against numerous backgrounds. Acquiring such a large set of measured imagery with sufficient variation can be difficult, requiring numerous field campaigns. Alternatively, accurate prediction of target signatures in cluttered outdoor scenes may be a viable option. In this work, sensor imagery is generated using CoTherm, a co-simulation tool which operates MuSES (an EO/IR simulation code) in an automated fashion to create a large library of synthetic images. The relevant MuSES inputs – which might include environmental factors, global location, date and time, vehicle engine state, human clothing and activity level, or sensor waveband – can be manipulated by a CoTherm workflow process. The output of this process is a large library of MuSES-generated EO/IR sensor radiance images suitable for algorithm development. If desired, synthetic target pixels can be inserted into measured background images for added realism.
- Published
- 2020
- Full Text
- View/download PDF