1. Bimodal artificial intelligence using TabNet for differentiating spinal cord tumors—Integration of patient background information and images
- Author
-
Kosuke Kita, Takahito Fujimori, Yuki Suzuki, Yuya Kanie, Shota Takenaka, Takashi Kaito, Takuyu Taki, Yuichiro Ukon, Masayuki Furuya, Hirokazu Saiwai, Nozomu Nakajima, Tsuyoshi Sugiura, Hiroyuki Ishiguro, Takashi Kamatani, Hiroyuki Tsukazaki, Yusuke Sakai, Haruna Takami, Daisuke Tateiwa, Kunihiko Hashimoto, Tomohiro Wataya, Daiki Nishigaki, Junya Sato, Masaki Hoshiyama, Noriyuki Tomiyama, Seiji Okada, and Shoji Kido
- Subjects
Image-guided intervention ,Cancer ,Artificial intelligence ,Science - Abstract
Summary: We proposed a bimodal artificial intelligence that integrates patient information with images to diagnose spinal cord tumors. Our model combines TabNet, a state-of-the-art deep learning model for tabular data for patient information, and a convolutional neural network for images. As training data, we collected 259 spinal tumor patients (158 for schwannoma and 101 for meningioma). We compared the performance of the image-only unimodal model, table-only unimodal model, bimodal model using a gradient-boosting decision tree, and bimodal model using TabNet. Our proposed bimodal model using TabNet performed best (area under the receiver-operating characteristic curve [AUROC]: 0.91) in the training data and significantly outperformed the physicians' performance. In the external validation using 62 cases from the other two facilities, our bimodal model showed an AUROC of 0.92, proving the robustness of the model. The bimodal analysis using TabNet was effective for differentiating spinal tumors.
- Published
- 2023
- Full Text
- View/download PDF