Search

BACKGROUND: The World Health Organization (WHO) and the International Labour Organization (ILO) have produced the WHO/ILO Joint Estimates of the Work-related Burden of Disease and Injury (WHO/ILO Joint Estimates). For these, systematic reviews of studies estimating the prevalence of exposure to selected occupational risk factors have been conducted to provide input data for estimations of the number of exposed workers. A critical part of systematic review methodology is to assess the quality of evidence across studies. In this article, we present the approach applied in these WHO/ILO systematic reviews for performing such assessments on studies of prevalence of exposure. It is called the Quality of Evidence in Studies estimating Prevalence of Exposure to Occupational risk factors (QoE-SPEO) approach. We describe QoE-SPEO's development to date, demonstrate its feasibility reporting results from pilot testing and case studies, note its strengths and limitations, and suggest how QoE-SPEO should be tested and developed further. METHODS: Following a comprehensive literature review, and using expert opinion, selected existing quality of evidence assessment approaches used in environmental and occupational health were reviewed and analysed for their relevance to prevalence studies. Relevant steps and components from the existing approaches were adopted or adapted for QoE-SPEO. New steps and components were developed. We elicited feedback from other systematic review methodologists and exposure scientists and reached consensus on the QoE-SPEO approach. Ten individual experts pilot-tested QoE-SPEO. To assess inter-rater agreement, we counted ratings of expected (actual and non-spurious) heterogeneity and quality of evidence and calculated a raw measure of agreement (Pi) between individual raters and rater teams for the downgrade domains. Pi ranged between 0.00 (no two pilot testers selected the same rating) and 1.00 (all pilot testers selected the same rating). Case studies were conducted of experiences of QoE-SPEO's use in two WHO/ILO systematic reviews. RESULTS: We found no existing quality of evidence assessment approach for occupational exposure prevalence studies. We identified three relevant, existing approaches for environmental and occupational health studies of the effect of exposures. Assessments using QoE-SPEO comprise three steps: (1) judge the level of expected heterogeneity (defined as non-spurious variability that can be expected in exposure prevalence, within or between individual persons, because exposure may change over space and/or time), (2) assess downgrade domains, and (3) reach a final rating on the quality of evidence. Assessments are conducted using the same five downgrade domains as the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach: (a) risk of bias, (b) indirectness, (c) inconsistency, (d) imprecision, and (e) publication bias. For downgrade domains (c) and (d), the assessment varies depending on the level of expected heterogeneity. There are no upgrade domains. The QoE-SPEO's ratings are "very low", "low", "moderate", and "high". To arrive at a final decision on the overall quality of evidence, the assessor starts at "high" quality of evidence and for each domain downgrades by one or two levels for serious concerns or very serious concerns, respectively. In pilot tests, there was reasonable agreement in ratings for expected heterogeneity; 70% of raters selected the same rating. Inter-rater agreement ranged considerably between downgrade domains, both for individual rater pairs (range Pi: 0.36-1.00) and rater teams (0.20-1.00). Sparse data prevented rigorous assessment of inter-rater agreement in quality of evidence ratings. CONCLUSIONS: We present QoE-SPEO as an approach for assessing quality of evidence in prevalence studies of exposure to occupational risk factors. It has been developed to its current version (as presented here), has undergone pilot testing, and was applied in the systematic reviews for the WHO/ILO Joint Estimates. While the approach requires further testing and development, it makes steps towards filling an identified gap, and progress made so far can be used to inform future work in this area. ispartof: ENVIRONMENT INTERNATIONAL vol:161 ispartof: location:Netherlands status: published

Highlights • WHO and ILO are developing joint estimates of the work-related burden of disease and injury. • This is a protocol for a systematic review & meta-analysis to inform the estimates. • The topic is occupational welding fumes exposure & trachea, bronchus & lung cancer., Background The World Health Organization (WHO) and the International Labour Organization (ILO) are developing joint estimates of the work-related burden of disease and injury (WHO/ILO Joint Estimates), with contributions from a large network of experts. Welding fumes have been classified as carcinogenic to humans (Group 1) by the International Agency for Research on Cancer (IARC); this assessment found sufficient evidence from studies in humans that welding fumes are a cause of lung cancer. In this article, we present the protocol for a systematic review of parameters for estimating the number of deaths and disability-adjusted life years from trachea, bronchus and lung cancer attributable to occupational exposure to welding fumes, to inform the development of the WHO/ILO Joint Estimates. Objectives We aim to systematically review and meta-analyse estimates of the effect of occupational exposure to welding fumes on trachea, bronchus and lung cancer, applying the Navigation Guide systematic review methodology as an organizing framework. Data sources We will search electronic bibliographic databases for potentially relevant records from published and unpublished studies, including Medline, EMBASE, Web of Science, and CISDOC. We will also search electronic grey literature databases, Internet search engines and organizational websites; hand search reference list of previous systematic reviews and included study records; and consult additional experts. Study eligibility and criteria We will include working-age (≥15 years) workers in the formal and informal economy in any Member State of WHO and/or ILO but exclude children (

Background: The World Health Organization (WHO) and the International Labour Organization (ILO) are developing a joint methodology for estimating the national and global work-related burden of disease and injury (WHO/ILO joint methodology), with contributions from a large network of experts. Here, we present the protocol for two systematic reviews of parameters for estimating the number of disability-adjusted life years of cataracts from occupational exposure to solar ultraviolet radiation, to inform the development of the WHO/ILO joint methodology. Objectives: We aim to systematically review studies on occupational exposure to solar ultraviolet radiation (Systematic Review 1) and systematically review and meta-analyse estimates of the effect of occupational exposure to solar ultraviolet radiation on the development of cataract (Systematic Review 2), applying the Navigation Guide systematic review methodology as an organizing framework and conducting both systematic reviews in tandem and in a harmonized way. Data sources: Separately for Systematic Reviews 1 and 2, we will search electronic academic databases for potentially relevant records from published and unpublished studies, including Ovid Medline, PubMed, EMBASE, and Web of Sciences. We will also search electronic grey literature databases, Internet search engines and organizational websites; hand search reference list of previous systematic reviews and included study records; and consult additional experts. Study eligibility and criteria: We will include working-age (≥15 years) workers in WHO and/or ILO Member States, but exclude children (