1. 3D Conditional Adversarial Learning for Synthesizing Microscopic Neuron Image Using Skeleton-to-Neuron Translation
- Author
-
Weidong Cai, Yang Song, Heng Wang, Chaoyi Zhang, Siqi Liu, Donghao Zhang, Dongnan Liu, Zihao Tang, and Hanchuan Peng
- Subjects
Computer science ,Neuron morphology ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Pattern recognition ,Skeleton (category theory) ,Translation (geometry) ,030218 nuclear medicine & medical imaging ,Image (mathematics) ,03 medical and health sciences ,0302 clinical medicine ,medicine.anatomical_structure ,medicine ,Neuron ,Artificial intelligence ,business ,030217 neurology & neurosurgery ,Generator (mathematics) - Abstract
The automatic reconstruction of single neuron cells from microscopic images is essential to establishing the research on neuron morphology. However, the performance of single neuron reconstruction algorithms is constrained by both the quantity and the quality of the annotated 3D microscopic images since annotating large-scale single neuron models is highly labour intensive. We propose a framework for synthesizing microscopy-realistic 3D neuron images from simulated single neuron skeletons using conditional Generative Adversarial Networks (cGAN). We build the generator network with multi-resolution sub-modules to improve the output fidelity. We evaluate our framework on Janelia-Fly dataset from the BigNeuron project. With both qualitative and quantitative analysis, we show that the proposed framework outperforms the other state-of-the-art methods regarding the quality of the synthetic neuron images. We also show that combining the real neuron images and the synthetic images generated from our framework can improve the performance of neuron segmentation.
- Published
- 2020
- Full Text
- View/download PDF