Search

BACKGROUND: There is a long tradition in environmental health of using frameworks for evidence synthesis, such as those of the U.S. Environmental Protection Agency for its Integrated Science Assessments and the International Agency for Research on Cancer Monographs. The framework, Grading of Recommendations Assessment, Development, and Evaluation (GRADE), was developed for evidence synthesis in clinical medicine. The U.S. Office of Health Assessment and Translation (OHAT) elaborated an approach for evidence synthesis in environmental health building on GRADE. METHODS: We applied a modified OHAT approach and a broader narrative assessment to assess the level of confidence in a large systematic review on traffic-related air pollution and health outcomes. DISCUSSION: We discuss several challenges with the OHAT approach and its implementation and suggest improvements for synthesizing evidence from observational studies in environmental health. We consider the determination of confidence using a formal rating scheme of up- and downgrading of certain factors, the treatment of every factor as equally important, and the lower initial confidence rating of observational studies to be fundamental issues in the OHAT approach. We argue that some observational studies can offer high-confidence evidence in environmental health. We note that heterogeneity in magnitude of effect estimates should generally not weaken the confidence in the evidence, and consistency of associations across study designs, populations, and exposure assessment methods may strengthen confidence in the evidence. We mention that publication bias should be explored beyond statistical methods and is likely limited when large and collaborative studies comprise most of the evidence and when accrued over several decades. We propose to identify possible key biases, their most likely direction, and their potential impacts on the results. We think that the OHAT approach and other GRADE-type frameworks require substantial modification to align better with features of environmental health questions and the studies that address them. We emphasize that a broader, narrative evidence assessment based on the systematic review may complement a formal GRADE-type evaluation. https://doi.org/10.1289/EHP11532.

Objectives: We report results of a systematic review on the health effects of long-term traffic-related air pollution (TRAP) and diabetes in the adult population. Methods: An expert Panel appointed by the Health Effects Institute conducted this systematic review. We searched the PubMed and LUDOK databases for epidemiological studies from 1980 to July 2019. TRAP was defined based on a comprehensive protocol. Random-effects meta-analyses were performed. Confidence assessments were based on a modified Office for Health Assessment and Translation (OHAT) approach, complemented with a broader narrative synthesis. We extended our interpretation to include evidence published up to May 2022. Results: We considered 21 studies on diabetes. All meta-analytic estimates indicated higher diabetes risks with higher exposure. Exposure to NO2 was associated with higher diabetes prevalence (RR 1.09; 95% CI: 1.02; 1.17 per 10 μg/m3), but less pronounced for diabetes incidence (RR 1.04; 95% CI: 0.96; 1.13 per 10 μg/m3). The overall confidence in the evidence was rated moderate, strengthened by the addition of 5 recently published studies. Conclusion: There was moderate evidence for an association of long-term TRAP exposure with diabetes.

We appreciate the emphasis on the flexibility of the OHAT approach, including a narrative assessment. We respectfully disagree that we incorrectly portrayed the OHAT approach, and we clarify below with [...]

BACKGROUND: Although from a societal point of view a modal shift from car to bicycle may have beneficial health effects due to decreased air pollution emissions, decreased greenhouse gas emissions, [...]

Abstract Background Exposure to fine ambient particulate matter (PM) has consistently been associated with increased morbidity and mortality. The relationship between exposure to ultrafine particles (UFP) and health effects is less firmly established. If UFP cause health effects independently from coarser fractions, this could affect health impact assessment of air pollution, which would possibly lead to alternative policy options to be considered to reduce the disease burden of PM. Therefore, we organized an expert elicitation workshop to assess the evidence for a causal relationship between exposure to UFP and health endpoints. Methods An expert elicitation on the health effects of ambient ultrafine particle exposure was carried out, focusing on: 1) the likelihood of causal relationships with key health endpoints, and 2) the likelihood of potential causal pathways for cardiac events. Based on a systematic peer-nomination procedure, fourteen European experts (epidemiologists, toxicologists and clinicians) were selected, of whom twelve attended. They were provided with a briefing book containing key literature. After a group discussion, individual expert judgments in the form of ratings of the likelihood of causal relationships and pathways were obtained using a confidence scheme adapted from the one used by the Intergovernmental Panel on Climate Change. Results The likelihood of an independent causal relationship between increased short-term UFP exposure and increased all-cause mortality, hospital admissions for cardiovascular and respiratory diseases, aggravation of asthma symptoms and lung function decrements was rated medium to high by most experts. The likelihood for long-term UFP exposure to be causally related to all cause mortality, cardiovascular and respiratory morbidity and lung cancer was rated slightly lower, mostly medium. The experts rated the likelihood of each of the six identified possible causal pathways separately. Out of these six, the highest likelihood was rated for the pathway involving respiratory inflammation and subsequent thrombotic effects. Conclusion The overall medium to high likelihood rating of causality of health effects of UFP exposure and the high likelihood rating of at least one of the proposed causal mechanisms explaining associations between UFP and cardiac events, stresses the importance of considering UFP in future health impact assessments of (transport-related) air pollution, and the need for further research on UFP exposure and health effects.

We thank Int Panis for his thoughtful comments on our article (de Hartog et al. 2010), and we broadly agree with his comments. In fact, we discussed most of the [...]