Search

Non-Line of Sight (NLOS) imaging has gained attention for its ability to detect and reconstruct objects beyond the direct line of sight, using scattered light, with applications in surveillance and autonomous navigation. This paper presents a versatile framework for modeling the temporal distribution of photon detections in direct Time of Flight (dToF) Lidar NLOS systems. Our approach accurately accounts for key factors such as material reflectivity, object distance, and occlusion by utilizing a proof-of-principle simulation realized with the Unreal Engine. By generating likelihood distributions for photon detections over time, we propose a mechanism for the simulation of NLOS imaging data, facilitating the optimization of NLOS systems and the development of novel reconstruction algorithms. The framework allows for the analysis of individual components of photon return distributions, yielding results consistent with prior experimental data and providing insights into the effects of extended surfaces and multi-path scattering. We introduce an optimized secondary scattering approach that captures critical multi-path information with reduced computational cost. This work provides a robust tool for the design and improvement of dToF SPAD Lidar-based NLOS imaging systems. [ABSTRACT FROM AUTHOR]

Single-photon avalanche diodes (SPADs) are novel image sensors that record photons at extremely high sensitivity. To reduce both the required sensor area for readout circuits and the data throughput for SPAD array, in this paper, we propose a snapshot compressive sensing single-photon avalanche diode (CS-SPAD) sensor which can realize on-chip snapshot-type spatial compressive imaging in a compact form. Taking advantage of the digital counting nature of SPAD sensing, we propose to design the circuit connection between the sensing unit and the readout electronics for compressive sensing. To process the compressively sensed data, we propose a convolution neural-network-based algorithm dubbed CSSPAD-Net which could realize both high-fidelity scene reconstruction and classification. To demonstrate our method, we design and fabricate a CS-SPAD sensor chip, build a prototype imaging system, and demonstrate the proposed on-chip snapshot compressive sensing method on the MINIST dataset and real handwritten digital images, with both qualitative and quantitative results. [ABSTRACT FROM AUTHOR]

The paper presents a camera comprising 512 × 128 pixels capable of single-photon detection and gating with a maximum frame rate of 156 kfps. The photon capture is performed through a gated single-photon avalanche diode that generates a digital pulse upon photon detection and through a digital one-bit counter. Gray levels are obtained through multiple counting and accumulation, while time-resolved imaging is achieved through a 4-ns gating window controlled with subnanosecond accuracy by a field-programmable gate array. The sensor, which is equipped with microlenses to enhance its effective fill factor, was electro-optically characterized in terms of sensitivity and uniformity. Several examples of capture of fast events are shown to demonstrate the suitability of the approach. [ABSTRACT FROM AUTHOR]

This paper reviews the state of the art of single-photon avalanche diode (SPAD) image sensors for time-resolved imaging. The focus of the paper is on pixel architectures featuring small pixel size (<25 μm) and high fill factor (>20%) as a key enabling technology for the successful implementation of high spatial resolution SPAD-based image sensors. A summary of the main CMOS SPAD implementations, their characteristics and integration challenges, is provided from the perspective of targeting large pixel arrays, where one of the key drivers is the spatial uniformity. The main analog techniques aimed at time-gated photon counting and photon timestamping suitable for compact and low-power pixels are critically discussed. The main features of these solutions are the adoption of analog counting techniques and time-to-analog conversion, in NMOS-only pixels. Reliable quantum-limited single-photon counting, self-referenced analog-to-digital conversion, time gating down to 0.75 ns and timestamping with 368 ps jitter are achieved. [ABSTRACT FROM AUTHOR]

Per-pixel time-to-digital converter (TDC) architectures have been exploited by single-photon avalanche diode (SPAD) sensors to achieve high photon throughput, but at the expense of fill factor, pixel pitch and readout efficiency. In contrast, TDC sharing architecture usually features high fill factor at small pixel pitch and energy efficient event-driven readout. While the photon throughput is not necessarily lower than that of per-pixel TDC architectures, since the throughput is not only decided by the TDC number but also the readout bandwidth. In this paper, a SPAD sensor with 32 × 32 pixels fabricated with a 180 nm CMOS image sensor technology is presented, where dynamically reallocating TDCs were implemented to achieve the same photon throughput as that of per-pixel TDCs. Each 4 TDCs are shared by 32 pixels via a collision detection bus, which enables a fill factor of 28% with a pixel pitch of 28.5 μm. The TDCs were characterized, obtaining the peak-to-peak differential and integral non-linearity of −0.07/+0.08 LSB and −0.38/+0.75 LSB, respectively. The sensor was demonstrated in a scanning light-detection-and-ranging (LiDAR) system equipped with an ultra-low power laser, achieving depth imaging up to 10 m at 6 frames/s with a resolution of 64 × 64 with 50 lux background light. [ABSTRACT FROM AUTHOR]

The radiation hardness of 180 nm complementary metal–oxide–semiconductor (CMOS) and 55 nm bipolar–CMOS–double-diffused MOS single-photon avalanche diodes (SPADs) is studied using 10 MeV and 100 MeV protons up to a displacement damage dose of 1 PeV/g. It is found that the dark count rate (DCR) levels are dependent on the number and the type of defects created. A new stepwise increase in the DCR is presented. Afterpulsing was found to be a significant contributor to the observed DCR increase. A new model for DCR increase prediction is proposed considering afterpulsing. Most of the samples under test retain reasonable DCR levels after irradiation, showing high tolerance to ionizing and displacement damage caused by protons. Following irradiation, self-healing was observed at room temperature. Furthermore, high-temperature annealing shows potential for accelerating recovery. Overall, the results show the suitability of SPADs as optical detectors for long-term space missions or as detectors for high-energy particles. [ABSTRACT FROM AUTHOR]

Quanta Imager Sensors provide photon detections at high frame rates, with negligible read-out noise, making them ideal for high-speed optical tracking. At the basic level of bit-planes or binary maps of photon detections, objects may present limited detail. However, through motion estimation and spatial reassignment of photon detections, the objects can be reconstructed with minimal motion artefacts. We here present the first demonstration of high-speed two-dimensional (2D) tracking and reconstruction of rigid, planar objects with a Quanta Image Sensor, including a demonstration of depth-resolved tracking. [ABSTRACT FROM AUTHOR]

We present our third prototype sensor and a localization method for Automated Guided Vehicles (AGVs), for which small imaging LIght Detection and Ranging (LIDAR) and fusion-based localization are fundamentally important. Our small imaging LIDAR, named the Single-Photon Avalanche Diode (SPAD) LIDAR, uses a time-of-flight method and SPAD arrays. A SPAD is a highly sensitive photodetector capable of detecting at the single-photon level, and the SPAD LIDAR has two SPAD arrays on the same chip for detection of laser light and environmental light. Therefore, the SPAD LIDAR simultaneously outputs range image data and monocular image data with the same coordinate system and does not require external calibration among outputs. As AGVs travel both indoors and outdoors with vibration, this calibration-less structure is particularly useful for AGV applications. We also introduce a fusion-based localization method, named SPAD DCNN, which uses the SPAD LIDAR and employs a Deep Convolutional Neural Network (DCNN). SPAD DCNN can fuse the outputs of the SPAD LIDAR: range image data, monocular image data and peak intensity image data. The SPAD DCNN has two outputs: the regression result of the position of the SPAD LIDAR and the classification result of the existence of a target to be approached. Our third prototype sensor and the localization method are evaluated in an indoor environment by assuming various AGV trajectories. The results show that the sensor and localization method improve the localization accuracy. [ABSTRACT FROM AUTHOR]

We have successfully demonstrated video-rate CMOS single-photon avalanche diode (SPAD)-based cameras for fluorescence lifetime imaging microscopy (FLIM) by applying innovative FLIM algorithms. We also review and compare several time-domain techniques and solid-state FLIM systems, and adapt the proposed algorithms for massive CMOS SPAD-based arrays and hardware implementations. The theoretical error equations are derived and their performances are demonstrated on the data obtained from 0.13 μm CMOS SPAD arrays and the multiple-decay data obtained from scanning PMT systems. In vivo two photon fluorescence lifetime imaging data of FITC-albumin labeled vasculature of a P22 rat carcinosarcoma (BD9 rat window chamber) are used to test how different algorithms perform on bi-decay data. The proposed techniques are capable of producing lifetime images with enough contrast [ABSTRACT FROM AUTHOR]

The growing demands on compact and high-definition single-photon avalanche diode (SPAD) arrays have motivated researchers to explore pixel miniaturization techniques to achieve sub-10 μm pixels. The scaling of the SPAD pixel size has an impact on key performance metrics, and it is, thereby, critical to conduct a systematic analysis of the underlying tradeoffs in miniaturized SPADs. On the basis of the general assumptions and constraints for layout geometry, we performed an analytical formulation of the scaling laws for the key metrics, such as the fill factor (FF), photon detection probability (PDP), dark count rate (DCR), correlated noise, and power consumption. Numerical calculations for various parameter sets indicated that some of the metrics, such as the DCR and power consumption, were improved by pixel miniaturization, whereas other metrics, such as the FF and PDP, were degraded. Comparison of the theoretically estimated scaling trends with previously published experimental results suggests that the scaling law analysis is in good agreement with practical SPAD devices. Our scaling law analysis could provide a useful tool to conduct a detailed performance comparison between various process, device, and layout configurations, which is essential for pushing the limit of SPAD pixel miniaturization toward sub-2 μm-pitch SPADs. [ABSTRACT FROM AUTHOR]

Analog and digital SiPMs have revolutionized the field of radiation instrumentation by replacing both avalanche photodiodes and photomultiplier tubes in many applications. However, multiple applications require greater performance than the current SiPMs are capable of, for example timing resolution for time-of-flight positron emission tomography and time-of-flight computed tomography, and mitigation of the large output capacitance of SiPM array for large-scale time projection chambers for liquid argon and liquid xenon experiments. In this contribution, the case will be made that 3D photon-to-digital converters, also known as 3D digital SiPMs, have a potentially superior performance over analog and 2D digital SiPMs. A review of 3D photon-to-digital converters is presented along with various applications where they can make a difference, such as time-of-flight medical imaging systems and low-background experiments in noble liquids. Finally, a review of the key design choices that must be made to obtain an optimized 3D photon-to-digital converter for radiation instrumentation, more specifically the single-photon avalanche diode array, the CMOS technology, the quenching circuit, the time-to-digital converter, the digital signal processing and the system level integration, are discussed in detail. [ABSTRACT FROM AUTHOR]

We describe the integration of techniques and technologies to develop a Point-of-Care for molecular diagnosis PoC-MD, based on a fluorescence lifetime measurement. Our PoC-MD is a low-cost, simple, fast, and easy-to-use general-purpose platform, aimed at carrying out fast diagnostics test through label detection of a variety of biomarkers. It is based on a 1-D array of 10 ultra-sensitive Single-Photon Avalanche Diode (SPAD) detectors made in a 0.18 μm High-Voltage Complementary Metal Oxide Semiconductor (HV-CMOS) technology. A custom microfluidic polydimethylsiloxane cartridge to insert the sample is straightforwardly positioned on top of the SPAD array without any alignment procedure with the SPAD array. Moreover, the proximity between the sample and the gate-operated SPAD sensor makes unnecessary any lens or optical filters to detect the fluorescence for long lifetime fluorescent dyes, such as quantum dots. Additionally, the use of a low-cost laser diode as pulsed excitation source and a Field-Programmable Gate Array (FPGA) to implement the control and processing electronics, makes the device flexible and easy to adapt to the target label molecule by only changing the laser diode. Using this device, reliable and sensitive real-time proof-of-concept fluorescence lifetime measurement of quantum dot QdotTM 605 streptavidin conjugate is demonstrated. [ABSTRACT FROM AUTHOR]

Time-resolved diffuse optical spectroscopy (TR-DOS) is an increasingly used method to determine the optical properties of diffusive media, particularly for medical applications including functional brain, breast and muscle measurements. For medical imaging applications, important features of new generation TR-DOS systems are low-cost, small size and efficient inverse modeling. To address the issues of low-cost, compact size and high integration capabilities, we have developed free-running (FR) single-photon avalanche diodes (SPADs) using 130 nm silicon complementary metal-oxide-semiconductor (CMOS) technology and used it in a TR-DOS prototype. This prototype was validated using assessments from two known protocols for evaluating TR-DOS systems for tissue optics applications. Following the basic instrumental performance protocol, our prototype had sub-nanosecond total instrument response function and low differential non-linearity of a few percent. Also, using light with optical power lower than the maximum permissible exposure for human skin, this prototype can acquire raw data in reflectance geometry for phantoms with optical properties similar to human tissues. Following the MEDPHOT protocol, the absolute values of the optical properties for several homogeneous phantoms were retrieved with good accuracy and linearity using a best-fitting model based on the Levenberg-Marquardt method. Overall, the results of this study show that our silicon CMOS-based SPAD detectors can be used to build a multichannel TR-DOS prototype. Also, real-time functional monitoring of human tissue such as muscles, breasts and newborn heads will be possible by integrating this detector with a time-to-digital converter (TDC). [ABSTRACT FROM AUTHOR]