1. Language models for data extraction and risk of bias assessment in complementary medicine.
- Author
-
Lai, Honghao, Liu, Jiayi, Bai, Chunyang, Liu, Hui, Pan, Bei, Luo, Xufei, Hou, Liangying, Zhao, Weilong, Xia, Danni, Tian, Jinhui, Chen, Yaolong, Zhang, Lu, Estill, Janne, Liu, Jie, Liao, Xing, Shi, Nannan, Sun, Xin, Shang, Hongcai, Bian, Zhaoxiang, and Yang, Kehu
- Subjects
COMPUTER software ,RESEARCH funding ,STATISTICAL sampling ,NATURAL language processing ,RANDOMIZED controlled trials ,DESCRIPTIVE statistics ,RESEARCH bias ,AUTOMATIC data collection systems ,RESEARCH in alternative medicine ,INFORMATION retrieval ,STATISTICS ,DATA analysis software ,CONFIDENCE intervals ,COMPARATIVE studies ,SENSITIVITY & specificity (Statistics) ,TIME ,EVALUATION - Abstract
Large language models (LLMs) have the potential to enhance evidence synthesis efficiency and accuracy. This study assessed LLM-only and LLM-assisted methods in data extraction and risk of bias assessment for 107 trials on complementary medicine. Moonshot-v1-128k and Claude-3.5-sonnet achieved high accuracy (≥95%), with LLM-assisted methods performing better (≥97%). LLM-assisted methods significantly reduced processing time (14.7 and 5.9 min vs. 86.9 and 10.4 min for conventional methods). These findings highlight LLMs' potential when integrated with human expertise. [ABSTRACT FROM AUTHOR]
- Published
- 2025
- Full Text
- View/download PDF