1. Convolutional neural network for classification of two-dimensional array images generated from clinical information may support diagnosis of rheumatoid arthritis
- Author
-
Kazuhide Tanimura, Tatsuya Atsumi, Jun Fukae, Akihiro Narita, Megumi Matsuhashi, Toshiyuki Hattori, Nobuya Abe, Mihoko Henmi, Michihiro Kono, Akio Mitsuzaki, Takeya Ito, Yuichiro Fujieda, Kenneth Sutherland, Akemi Kitano, Tamotsu Kamishima, Fumihiko Sakamoto, Masato Isobe, Masato Shimizu, Takao Koike, and Yuko Aoki
- Subjects
0301 basic medicine ,Male ,Computer science ,Arthritis ,lcsh:Medicine ,Convolutional neural network ,Article ,Arthritis, Rheumatoid ,03 medical and health sciences ,0302 clinical medicine ,Deep Learning ,Clinical information ,Machine learning ,medicine ,Humans ,Rheumatoid arthritis ,lcsh:Science ,Multidisciplinary ,Artificial neural network ,business.industry ,Deep learning ,lcsh:R ,Pattern recognition ,Diagnostic markers ,medicine.disease ,030104 developmental biology ,lcsh:Q ,Female ,Artificial intelligence ,Neural Networks, Computer ,business ,Transfer of learning ,030217 neurology & neurosurgery - Abstract
This research aimed to study the application of deep learning to the diagnosis of rheumatoid arthritis (RA). Definite criteria or direct markers for diagnosing RA are lacking. Rheumatologists diagnose RA according to an integrated assessment based on scientific evidence and clinical experience. Our novel idea was to convert various clinical information from patients into simple two-dimensional images and then use them to fine-tune a convolutional neural network (CNN) to classify RA or nonRA. We semi-quantitatively converted each type of clinical information to four coloured square images and arranged them as one image for each patient. One rheumatologist modified each patient’s clinical information to increase learning data. In total, 1037 images (252 RA, 785 nonRA) were used to fine-tune a pretrained CNN with transfer learning. For clinical data (10 RA, 40 nonRA), which were independent of the learning data and were used as testing data, we compared the classification ability of the fine-tuned CNN with that of three expert rheumatologists. Our simple system could potentially support RA diagnosis and therefore might be useful for screening RA in both specialised hospitals and general clinics. This study paves the way to enabling deep learning in the diagnosis of RA.
- Published
- 2020