1. Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments
- Author
-
Elena Loli Piccolomini, Maria Carla Parrini, Maria Colomba Comes, Pasquale Cascarano, Arianna Mencattini, Eugenio Martinelli, Cascarano P., Comes M.C., Mencattini A., Parrini M.C., Piccolomini E.L., and Martinelli E.
- Subjects
FOS: Computer and information sciences ,Living cell videos ,Computer science ,Computer Vision and Pattern Recognition (cs.CV) ,Computer Science - Computer Vision and Pattern Recognition ,Convolutional neural network ,Health Informatics ,Settore ING-INF/07 ,Time-Lapse Imaging ,030218 nuclear medicine & medical imaging ,Image (mathematics) ,I.4.4 ,I.4.9 ,I.2.1 ,03 medical and health sciences ,0302 clinical medicine ,FOS: Electrical engineering, electronic engineering, information engineering ,Image Processing, Computer-Assisted ,Radiology, Nuclear Medicine and imaging ,97P80, 68U10, 92C55 ,Image resolution ,Microscopy ,Network architecture ,Early stopping ,Radiological and Ultrasound Technology ,business.industry ,Deep learning ,Image and Video Processing (eess.IV) ,Function (mathematics) ,Electrical Engineering and Systems Science - Image and Video Processing ,Deep image prior ,Computer Graphics and Computer-Aided Design ,Signature (logic) ,Super resolution ,Algorithm ,Living cell video ,Convolutional neural networks ,Neural Networks, Computer ,Computer Vision and Pattern Recognition ,Artificial intelligence ,Light time-lapse microscopy ,business ,Algorithms ,030217 neurology & neurosurgery - Abstract
Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well known Deep Image Prior (DIP) to TLM Video Super Resolution (SR) without requiring any training. The proposed Recursive Deep Prior Video (RDPV) method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation (TV) based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. Achieved results are compared with several state-of-the-art trained deep learning SR algorithms showing outstanding performances., Paper submitted to a peer-reviewed journal
- Published
- 2021
- Full Text
- View/download PDF