Search

Background: In 2007, the AASM Manual for the Scoring of Sleep and Associated Events was published by the American Academy of Sleep Medicine (AASM). Concerning the visual classification of sleep stages, these new rules are intended to replace the rules by Rechtschaffen and Kales (R&K)., Methods: We adapted the automatic R&K sleep scoring system Somnolyzer 24 × 7 to comply with the AASM rules and subsequently performed a validation study based on 72 polysomnographies from the Siesta database (56 healthy subjects, 16 patients, 38 females, 34 males, aged 21-86 years). Scorings according to the AASM rules were performed manually by experienced sleep scorers and semi-automatically by the AASM version of the Somnolyzer. Manual scorings and Somnolyzer reviews were performed independently by at least 2 out of 8 experts from 4 sleep centers., Results: In the quality control process, sleep experts corrected 4.8 and 3.7% of the automatically assigned epochs, resulting in a reliability between 2 Somnolyzer-assisted scorings of 99% (Cohen's kappa: 0.99). In contrast, the reliability between the 2 manual scorings was 82% (kappa: 0.76). The agreement between the 2 Somnolyzer-assisted and the 2 visual scorings was between 81% (kappa: 0.75) and 82% (kappa: 0.76)., Conclusion: The AASM version of the Somnolyzer revealed an agreement between semi-automated and human expert scoring comparable to that published for the R&K version with a validity comparable to that of human experts, but with a reliability close to 1, thereby reducing interrater variability as well as scoring time to a minimum., (Copyright © 2010 S. Karger AG, Basel.)

Interrater variability of sleep stage scorings has an essential impact not only on the reading of polysomnographic sleep studies (PSGs) for clinical trials but also on the evaluation of patients' sleep. With the introduction of a new standard for sleep stage scorings (AASM standard) there is a need for studies on interrater reliability (IRR). The SIESTA database resulting from an EU-funded project provides a large number of studies (n = 72; 56 healthy controls and 16 subjects with different sleep disorders, mean age +/- SD: 57.7 +/- 18.7, 34 females) for which scorings according to both standards (AASM and R&K) were done. Differences in IRR were analysed at two levels: (1) based on quantitative sleep parameter by means of intraclass correlations; and (2) based on an epoch-by-epoch comparison by means of Cohen's kappa and Fleiss' kappa. The overall agreement was for the AASM standard 82.0% (Cohen's kappa = 0.76) and for the R&K standard 80.6% (Cohen's kappa = 0.68). Agreements increased from R&K to AASM for all sleep stages, except N2. The results of this study underline that the modification of the scoring rules improve IRR as a result of the integration of occipital, central and frontal leads on the one hand, but decline IRR on the other hand specifically for N2, due to the new rule that cortical arousals with or without concurrent increase in submental electromyogram are critical events for the end of N2.