1. Can a Novel Natural Language Processing Model and Artificial Intelligence Automatically Generate Billing Codes From Spine Surgical Operative Notes?
- Author
-
Zaidat, Bashar, Tang, Justin, Arvind, Varun, Geng, Eric A., Cho, Brian, Duey, Akiro H., Dominy, Calista, Riew, Kiehyun D., Cho, Samuel K., and Kim, Jun S.
- Subjects
NATURAL language processing ,MACHINE learning ,ARTIFICIAL intelligence ,INTERVERTEBRAL disk ,ORTHOPEDISTS - Abstract
Study Design: Retrospective cohort. Objective: Billing and coding-related administrative tasks are a major source of healthcare expenditure in the United States. We aim to show that a second-iteration Natural Language Processing (NLP) machine learning algorithm, XLNet, can automate the generation of CPT codes from operative notes in ACDF, PCDF, and CDA procedures. Methods: We collected 922 operative notes from patients who underwent ACDF, PCDF, or CDA from 2015 to 2020 and included CPT codes generated by the billing code department. We trained XLNet, a generalized autoregressive pretraining method, on this dataset and tested its performance by calculating AUROC and AUPRC. Results: The performance of the model approached human accuracy. Trial 1 (ACDF) achieved an AUROC of.82 (range:.48-.93), an AUPRC of.81 (range:.45-.97), and class-by-class accuracy of 77% (range: 34%-91%); trial 2 (PCDF) achieved an AUROC of.83 (.44-.94), an AUPRC of.70 (.45-.96), and class-by-class accuracy of 71% (42%-93%); trial 3 (ACDF and CDA) achieved an AUROC of.95 (.68-.99), an AUPRC of.91 (.56-.98), and class-by-class accuracy of 87% (63%-99%); trial 4 (ACDF, PCDF, CDA) achieved an AUROC of.95 (.76-.99), an AUPRC of.84 (.49-.99), and class-by-class accuracy of 88% (70%-99%). Conclusions: We show that the XLNet model can be successfully applied to orthopedic surgeon's operative notes to generate CPT billing codes. As NLP models as a whole continue to improve, billing can be greatly augmented with artificial intelligence assisted generation of CPT billing codes which will help minimize error and promote standardization in the process. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF