1. Passive Inter-Photon Imaging
- Author
-
Alberto Tosi, Atul Ingle, Mauro Buttafava, Trevor Seets, Mohit Gupta, Andreas Velten, and Shantanu Gupta
- Subjects
FOS: Computer and information sciences ,Brightness ,business.product_category ,Computer science ,Computer Vision and Pattern Recognition (cs.CV) ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer Science - Computer Vision and Pattern Recognition ,Optics ,FOS: Electrical engineering, electronic engineering, information engineering ,Medical imaging ,sezele, SPAD ,Digital camera ,ComputingMethodologies_COMPUTERGRAPHICS ,sezele ,Pixel ,business.industry ,Dynamic range ,Image and Video Processing (eess.IV) ,Photography ,Electrical Engineering and Systems Science - Image and Video Processing ,Ray ,SPAD ,Computer Science::Computer Vision and Pattern Recognition ,Artificial intelligence ,business ,Energy (signal processing) - Abstract
Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination -- electronic noise dominates under low illumination, and pixel full-well capacity results in saturation under bright illumination. We propose a novel intensity cue based on measuring inter-photon timing, defined as the time delay between detection of successive photons. Based on the statistics of inter-photon times measured by a time-resolved single-photon sensor, we develop theory and algorithms for a scene brightness estimator which works over extreme dynamic range; we experimentally demonstrate imaging scenes with a dynamic range of over ten million to one. The proposed techniques, aided by the emergence of single-photon sensors such as single-photon avalanche diodes (SPADs) with picosecond timing resolution, will have implications for a wide range of imaging applications: robotics, consumer photography, astronomy, microscopy and biomedical imaging., Accepted to CVPR 2021 as an oral presentation
- Published
- 2021