Search

In-line lensless digital holography has great potential in multiple applications; however, reconstructing high-quality images from a single recorded hologram is challenging due to the loss of phase information. Typical reconstruction methods are based on solving a regularized inverse problem and work well under suitable image priors, but they are extremely sensitive to mismatches between the forward model and the actual imaging system. This paper aims to improve the robustness of such algorithms by introducing the adaptive sparse reconstruction method, ASR, which learns a properly constrained point spread function (PSF) directly from data, as opposed to solely relying on physics-based approximations of it. ASR jointly performs holographic reconstruction, PSF estimation, and phase retrieval in an unsupervised way by maximizing the sparsity of the reconstructed images. Like traditional methods, ASR uses the image formation model along with a sparsity prior, which, unlike recent deep learning approaches, allows for unsupervised reconstruction with as little as one sample. Experimental results in synthetic and real data show the advantages of ASR over traditional reconstruction methods, especially in cases where the theoretical PSF does not match that of the actual system.

International audience

Chemotherapy‐induced radiation recall reactions are rare, commonly affecting skin but can affect internal organs. Treatments include antihistamines and topical steroids and discontinuation of therapy if severe. Rechallenge may not cause recurrence.

Oblique plane microscopy (OPM) enables high speed, volumetric fluorescence imaging through a single-objective geometry. While these advantages have positioned OPM as a valuable tool to probe biological questions in animal models, its potential for

An 80 year old man with metastatic castrate-resistant prostate cancer was treated with multiple systemic agents but after carboplatin/paclitaxel, developed a morbilliform rash conforming precisely to a skin site of previous palliative radiotherapy, a so-called radiation recall reaction.

We demonstrate a low-cost diffuser-based computational funduscope that can recover pathological features of the model eye fundus. Our device achieves over 33° FOV and is robust to 4D refractive error using a single-shot point-spread-function.

Quantification of optical absorption gaps in nailfold capillaries has recently shown promise as a non-invasive technique for neutropenia screening. Here we demonstrate a low-cost, portable attachment to a mobile phone that can resolve optical absorption gaps in nailfold capillaries using a reverse lens technique and oblique 520nm illumination. Resolution μm within a 1mm2 on-axis region is demonstrated, and wide field of view (3.5mm × 4.8mm) imaging is achieved with resolution μm in the periphery. Optical absorption gaps (OAGs) are visible in superficial capillary loops of a healthy human participant by an ∼8-fold difference in contrast-to-noise ratio with respect to red blood cell absorption contrast. High speed video capillaroscopy up to 240 frames per second (fps) is possible, though 60fps is sufficient to resolve an average frequency of 37 OAGs/minute passing through nailfold capillaries. The simplicity and portability of this technique may enable the development of an effective non-invasive tool for white blood cell screening in point-of-care and global health settings.

PURPOSE: To evaluate vision and corneal surface regularity after each step of a three-step surgical treatment of keratoconus and post–laser in situ keratomileusis (LASIK) ectasia (implantation of intracorneal ring segments [ICRS], corneal cross-linking [CXL], and implantation of toric intraocular contact lenses [ICLs]). METHODS: Thirty-one eyes of 24 patients with moderate to severe keratoconus and post-LASIK ectasia (stages II and III of Amsler–Krumeich classification) were included. All eyes underwent all three steps. The time interval between ICRS implantation and CXL was 4 to 6 weeks, and ICL implantation was performed 6 to 8 months after CXL. Visual acuity, refraction, and corneal topometric indices were evaluated with the Pentacam system (index of surface variance [ISV], index of vertical asymmetry [IVA], keratoconus index [KI], central keratoconus index [CKI], index of height asymmetry [IHA], index of height decentration [IHD], and corneal wavefront parameters [eg, higher order aberrations, spherical aberration, and coma]). RESULTS: Decimal uncorrected distance visual acuity (UDVA) improved from 0.13 ± 0.17 preoperatively to 0.69 ± 0.18 at 1 year, whereas corrected distance visual acuity (CDVA) improved from 0.56 ± 0.24 to 0.80 ± 0.18, respectively. The topometric indices ISV, IVA, KI, and IHD also improved significantly, whereas CKI and IHA showed no significant improvement. Higher order aberrations, spherical aberration, and coma improved significantly compared to baseline. CONCLUSIONS: The combined use of ICRS, CXL, and ICL implantation significantly improves visual acuity, higher order aberrations, and corneal shape in moderate and severe keratoconus and post-LASIK ectasia. [ J Refract Surg . 2020;36(2):104–109.]

Nuclei segmentation is a fundamental task that is critical for various computational pathology applications including nuclei morphology analysis, cell type classification, and cancer grading. Conventional vision-based methods for nuclei segmentation struggle in challenging cases and deep learning approaches have proven to be more robust and generalizable. However, CNNs require large amounts of labeled histopathology data. Moreover, conventional CNN-based approaches lack structured prediction capabilities which are required to distinguish overlapping and clumped nuclei. Here, we present an approach to nuclei segmentation that overcomes these challenges by utilizing a conditional generative adversarial network (cGAN) trained with synthetic and real data. We generate a large dataset of H&E training images with perfect nuclei segmentation labels using an unpaired GAN framework. This synthetic data along with real histopathology data from six different organs are used to train a conditional GAN with spectral normalization and gradient penalty for nuclei segmentation. This adversarial regression framework enforces higher order consistency when compared to conventional CNN models. We demonstrate that this nuclei segmentation approach generalizes across different organs, sites, patients and disease states, and outperforms conventional approaches, especially in isolating individual and overlapping nuclei.

Oblique plane microscopy (OPM) enables high speed, volumetric fluorescence imaging through a single-objective geometry. While these advantages have positioned OPM as a valuable tool to probe biological questions in animal models, its potential for in vivo human imaging is largely unexplored due to its typical use with exogenous fluorescent dyes. Here we introduce a scattering-contrast oblique plane microscope (sOPM) and demonstrate label-free imaging of blood cells flowing through human capillaries in vivo. The sOPM illuminates a capillary bed in the ventral tongue with an oblique light sheet, and images side- and back- scattered signal from blood cells. By synchronizing sOPM with a conventional capillaroscope, we acquire paired widefield and axial images of blood cells flowing through a capillary loop. The widefield capillaroscope image provides absorption contrast and confirms the presence of red blood cells (RBCs), while the sOPM image may aid in determining whether optical absorption gaps (OAGs) between RBCs have cellular or acellular composition. Further, we demonstrate consequential differences between fluorescence and scattering versions of OPM by imaging the same polystyrene beads sequentially with each technique. Lastly, we substantiate in vivo observations by imaging isolated red blood cells, white blood cells, and platelets in vitro using 3D agar phantoms. These results demonstrate a promising new avenue towards in vivo blood analysis., 12 pages, 6 figures

Febrile neutropenia (FN) is a common cause of hospitalization for cancer patients undergoing chemotherapy treatment. To screen for FN, patients require invasive blood draws and complete blood cell counts, which increases risk of nosocomial infection while in an immunocompromised state. There is a pressing clinical need for non-invasive, point-of-care technology to frequently screen for FN, which, if detected early, can be prophylactically managed. A promising approach to address this need is capillaroscopy, through which blood cells are imaged in capillaries non-invasively. Visualization of shadows caused by absorption of individual red blood cells is currently achievable, and correlation between the absence of optical absorption gaps and severe neutropenia has been observed. However, a completely accurate identification of the physical origin of these optical absorption gaps for conclusive neutropenia diagnosis remains an elusive task. Here we present scattering oblique plane microscopy as a means of imaging moving scattering particles within a turbid medium with the goal of eventually imaging and characterizing blood cells in vivo flowing in superficial capillaries. Our imaging system illuminates an oblique light sheet through a capillary bed and collects back-scatter using a single objective at frame rates of >200 Hz. To validate this system, we develop phantoms mimicking capillaries with 200 μm diameter lumens embedded deep in silicone doped with TiO2 and India ink. Single 3 μm diameter polystyrene beads flowing through the capillaries are resolved with a signal to noise ratio of approximately 5:1 at a depth of 1 mean free path.

Wavefront sensing is typically accomplished with a Shack-Hartmann wavefront sensor (SHWS), where a CCD or CMOS is placed at the focal plane of a periodic, microfabricated lenslet array. Tracking the displacement of the resulting spots in the presence of an aberrated wavefront yields measurement of the relative wavefront introduced. A SHWS has a fundamental tradeoff between sensitivity and range, determined by the pitch and focal length of its lenslet array, such that the number of resolvable tilts is a constant. Recently, diffuser wavefront sensing (DWS) has been demonstrated by measuring the lateral shift of a coherent speckle pattern using the concept of the diffuser memory effect. Here we demonstrate that tracking distortions of the non-periodic caustic pattern produced by a holographic diffuser allows accurate autorefraction of a model eye with a number of resolvable tilts that extends beyond the fundamental limit of a SHWS. Using a multi-level Demon’s image registration algorithm, we are able to demonstrate that a DWS demonstrates a 2.5x increase in number of resolvable prescriptions as compared to a conventional SHWS while maintaining acceptable accuracy and repeatability for eyeglass prescriptions. We evaluate the performance of a DWS and SHWS in parallel with a coherent laser diode without (LD) and with a laser speckle reducer (LD+LSR), and an incoherent light-emitting diode (LED), demonstrating caustic-tracking is compatible with coherent and incoherent sources. Additionally, the DWS diffuser costs 40x less than a SHWS lenslet array, enabling affordable large-dynamic range autorefraction without moving parts.

Multidecadal surface temperature changes may be forced by natural as well as anthropogenic factors, or arise unforced from the climate system. Distinguishing these factors is essential for estimating sensitivity to multiple climatic forcings and the amplitude of the unforced variability. Here we present 2,000-year-long global mean temperature reconstructions using seven different statistical methods that draw from a global collection of temperature-sensitive palaeoclimate records. Our reconstructions display synchronous multidecadal temperature fluctuations that are coherent with one another and with fully forced millennial model simulations from the Coupled Model Intercomparison Project Phase 5 across the Common Era. A substantial portion of pre-industrial (1300–1800 CE) variability at multidecadal timescales is attributed to volcanic aerosol forcing. Reconstructions and simulations qualitatively agree on the amplitude of the unforced global mean multidecadal temperature variability, thereby increasing confidence in future projections of climate change on these timescales. The largest warming trends at timescales of 20 years and longer occur during the second half of the twentieth century, highlighting the unusual character of the warming in recent decades.

We present a non-invasive, label-free method of imaging blood cells flowing through human capillaries in vivo using oblique back-illumination capillaroscopy (OBC). Green light illumination allows simultaneous phase and absorption contrast, enhancing the ability to distinguish red and white blood cells. Single-sided illumination through the objective lens enables 200 Hz imaging with close illumination-detection separation and a simplified setup. Phase contrast is optimized when the illumination axis is offset from the detection axis by approximately 225 um when imaging 80 um deep in phantoms and human ventral tongue. We demonstrate high-speed imaging of individual red blood cells, white blood cells with sub-cellular detail, and platelets flowing through capillaries and vessels in human tongue. A custom pneumatic cap placed over the objective lens stabilizes the field of view, enabling longitudinal imaging of a single capillary for up to seven minutes. We present high-quality images of blood cells in individuals with Fitzpatrick skin phototypes II, IV, and VI, showing that the technique is robust to high peripheral melanin concentration. The signal quality, speed, simplicity, and robustness of this approach underscores its potential for non-invasive blood cell counting., Comment: 10 pages, 7 Figures

Wavefront sensing with a thin diffuser has emerged as a potential low-cost alternative to a lenslet array for aberrometry. Diffuser wavefront sensors (DWS) have previously relied on tracking speckle displacement and consequently require coherent illumination. Here we show that displacement of caustic patterns can be tracked for estimating wavefront gradient, enabling the use of incoherent light sources and large dynamic-range wavefront measurements. We compare the precision of a DWS to a Shack-Hartmann wavefront sensor (SHWS) when using coherent, partially coherent, and incoherent illumination, in the application of autorefraction. We induce spherical and cylindrical errors in a model eye and use a multi-level Demon's non-rigid registration algorithm to estimate caustic displacements relative to an emmetropic model eye. When compared to spherical error measurements with the SHWS using partially coherent illumination, the DWS demonstrates a $\sim$5-fold improvement in dynamic range (-4.0 to +4.5 D vs. -22.0 to +19.5 D) with less than half the reduction in resolution (0.072 vs. 0.116 D), enabling a $\sim$3-fold increase in the number of resolvable prescriptions (118 vs. 358). In addition to being 40x lower-cost, the unique, non-periodic nature of the caustic pattern formed by a diffuser enables a larger dynamic range of aberration measurements compared to a lenslet array., 18 pages, 11 figures

Engineering is the discipline of applying scientific and mathematical tools to solve practical problems for society. At the core of a person’s problem-solving abilities is their creativity. This is a preliminary and exploratory theory-based paper summarizing the two most prevalent componential theories of creativity as applied to a case study. These theories outline a set of processes which contribute to a person’s ability to be creative in a domain. The components differ slightly between models, but include: motivation; domain-specific knowledge, skills, and abilities; and cognitive process of creativity including problem finding, ideation, and evaluation.To demonstrate the practical application of these theories to engineering pedagogy, they will be applied to a case study of a 2-day academic hackathon called “Tron Days”. Tron Days guides students through a multi-step modelling and verification process and concludes with teams of students designing and constructing a robotic arm. At the end of the second day, students demonstrated their functioning robotic prototypes. This event has now been run twice for first semester Mechatronics Engineering students, and similar implementations with different problems have been run in seven other engineering programs at the same institution. Each section of this paper will demonstrate the application of componential theories of creativity by drawing connections to the Tron Days event.