Variability in clinical assessment of clade IIb mpox lesions

Objectives: The ongoing global outbreak of mpox, caused by clade IIb mpox virus, poses significant challenges in accurately categorizing and assessing the diversity of lesions. With lesion resolution being a key endpoint in clinical trials and observational studies, it is essential to evaluate the inter-rater reliability and agreement of clade IIb mpox lesion assessment among clinicians. Methods: Clinicians experienced in clade IIb mpox disease were surveyed online with 20 lesion images. They categorized lesions into active, crusted, resolved, or unclassifiable groups. Reliability was assessed with Fleiss' kappa and agreement with proportion of exact agreement. Results: Fifty-three clinicians completed the survey, with a median self-reported confidence rating of 7 (on a scale of 1 to 10) in assessing mpox lesions. The inter-rater reliability was found to be moderate, with a Fleiss' kappa coefficient of 0.417 (P