Back to Search Start Over

Language models for data extraction and risk of bias assessment in complementary medicine.

Authors :
Lai H
Liu J
Bai C
Liu H
Pan B
Luo X
Hou L
Zhao W
Xia D
Tian J
Chen Y
Zhang L
Estill J
Liu J
Liao X
Shi N
Sun X
Shang H
Bian Z
Yang K
Huang L
Ge L
Source :
NPJ digital medicine [NPJ Digit Med] 2025 Jan 31; Vol. 8 (1), pp. 74. Date of Electronic Publication: 2025 Jan 31.
Publication Year :
2025

Abstract

Large language models (LLMs) have the potential to enhance evidence synthesis efficiency and accuracy. This study assessed LLM-only and LLM-assisted methods in data extraction and risk of bias assessment for 107 trials on complementary medicine. Moonshot-v1-128k and Claude-3.5-sonnet achieved high accuracy (≥95%), with LLM-assisted methods performing better (≥97%). LLM-assisted methods significantly reduced processing time (14.7 and 5.9 min vs. 86.9 and 10.4 min for conventional methods). These findings highlight LLMs' potential when integrated with human expertise.<br />Competing Interests: Competing interests: The authors declare no competing interests.<br /> (© 2025. The Author(s).)

Details

Language :
English
ISSN :
2398-6352
Volume :
8
Issue :
1
Database :
MEDLINE
Journal :
NPJ digital medicine
Publication Type :
Academic Journal
Accession number :
39890970
Full Text :
https://doi.org/10.1038/s41746-025-01457-w