Back to Search
Start Over
Optical flow estimation in ocular endoscopy videos using flownet on simulated endoscopy data
- Source :
- Proceedings ISBI 2018 : IEEE International Symposium on Biomedical Imaging, ISBI 2018 : IEEE International Symposium on Biomedical Imaging, ISBI 2018 : IEEE International Symposium on Biomedical Imaging, Apr 2018, Washington, United States. pp.1463-1466, ⟨10.1109/ISBI.2018.8363848⟩, ISBI
- Publication Year :
- 2018
- Publisher :
- HAL CCSD, 2018.
-
Abstract
- International audience; In recent years, endoscopy has been increasingly used for ocular surgeries whenever viewing with a microscope is altered by occlusion or opacity. However, ocular endoscopy suffers from several limitations, including reduced field of view and limited resolution, which may compromise its usability. Hopefully, image processing techniques such as mosaicking and super-resolution could help in alleviating these problems, by artificially enlarging the field and increasing resolution. All these techniques rely on the ability to estimate the optical flow between consecutive frames, which is particularly challenging for those images. This paper investigates the use of the state-of-the-art FlowNet algorithm for motion estimation in ocular endoscopy videos. Because FlowNet is strongly supervised, an artificial dataset of consecutive image pairs with ground truth optical flow is generated using eye fundus photographs from Kaggle's Diabetic Retinopathy Detection dataset. A FlowNet model, initialized on the public Flying Chairs dataset, is fine-tuned on these images. Initial experiments show that, unlike any other optical flow estimation method, this model can successfully capture motion between ocular endoscopy image pairs.
- Subjects :
- Flownet
Microscope
genetic structures
Computer science
0206 medical engineering
Optical flow
Image processing
02 engineering and technology
Fundus (eye)
Convolutional neural network
Retina
030218 nuclear medicine & medical imaging
law.invention
03 medical and health sciences
0302 clinical medicine
law
Motion estimation
medicine
Computer vision
Convolution neural network
Ground truth
business.industry
Diabetic retinopathy
medicine.disease
020601 biomedical engineering
Endoscopic surgery
eye diseases
Transfer learning
Optical flow estimation
medicine.anatomical_structure
Artificial intelligence
sense organs
business
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
Subjects
Details
- Language :
- English
- Database :
- OpenAIRE
- Journal :
- Proceedings ISBI 2018 : IEEE International Symposium on Biomedical Imaging, ISBI 2018 : IEEE International Symposium on Biomedical Imaging, ISBI 2018 : IEEE International Symposium on Biomedical Imaging, Apr 2018, Washington, United States. pp.1463-1466, ⟨10.1109/ISBI.2018.8363848⟩, ISBI
- Accession number :
- edsair.doi.dedup.....af1997bd890dc93e4c3ab0090704819d