Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2022 Jan;2022(211):1-56.

Assessing Adverse Health Effects of Long-Term Exposure to Low Levels of Ambient Air Pollution: Implementation of Causal Inference Methods

Affiliations
Review

Assessing Adverse Health Effects of Long-Term Exposure to Low Levels of Ambient Air Pollution: Implementation of Causal Inference Methods

F Dominici et al. Res Rep Health Eff Inst. 2022 Jan.

Abstract

This report provides a final summary of the principal findings and key conclusions of a study supported by an HEI grant aimed at "Assessing Adverse Health Effects of Long-Term Exposure to Low Levels of Ambient Air Pollution." It is the second and final report on this topic. The study was designed to advance four critical areas of inquiry and methods development. First, it focused on predicting short- and long-term exposures to ambient fine particulate matter (PM2.5), nitrogen dioxide (NO2), and ozone (O3) at high spatial resolution (1 km × 1 km) for the continental United States over the period 2000-2016 and linking these predictions to health data. Second, it developed new causal inference methods for estimating exposure-response (ER) curves (ERCs) and adjusting for measured confounders. Third, it applied these methods to claims data from Medicare and Medicaid beneficiaries to estimate health effects associated with short- and long-term exposure to low levels of ambient air pollution. Finally, it developed pipelines for reproducible research, including approaches for data sharing, record linkage, and statistical software. Our HEI-funded work has supported an extensive portfolio of analyses and the development of statistical methods that can be used to robustly understand the health effects of short- and long-term exposure to low levels of ambient air pollution. Our Phase 1 report (Dominici et al. 2019) provided a high-level overview of our statistical methods, data analysis, and key findings, grouped into the following five areas: (1) exposure prediction, (2) epidemiological studies of ambient exposures to air pollution at low levels, (3) sensitivity analysis, (4) methodological contributions in causal inference, and (5) an open access research data platform. The current, final report includes a comprehensive overview of the entire research project.

Considering our (1) massive study population, (2) numerous sensitivity analyses, and (3) transparent assessment of covariate balance indicating the quality of causal inference for simulating randomized experiments, we conclude that conditionally on the required assumptions for causal inference, our results collectively indicate that long-term PM2.5 exposure is likely to be causally related to mortality. This conclusion assumes that the causal inference assumptions hold and, more specifically, that we accounted adequately for confounding bias. We explored various modeling approaches, conducted extensive sensitivity analyses, and found that our results were robust across approaches and models. This work relied on publicly available data, and we have provided code that allows for reproducibility of our analyses.

Our work provides comprehensive evidence of associations between exposures to PM2.5, NO2, and O3 and various health outcomes. In the current report, we report more specific results on the causal link between long-term exposure to PM2.5 and mortality, even at PM2.5 levels below or equal to 12 μg/m3, and mortality among Medicare beneficiaries (ages 65 and older). This work relies on newly developed causal inference methods for continuous exposure.

For the period 2000-2016, we found that all statistical approaches led to consistent results: a 10-μg/m3 decrease in PM2.5 led to a statistically significant decrease in mortality rate ranging between 6% and 7% (= 1 - 1/hazard ratio [HR]) (HR estimates 1.06 [95% CI, 1.05 to 1.08] to 1.08 [95% CI, 1.07 to 1.09]). The estimated HRs were larger when studying the cohort of Medicare beneficiaries that were always exposed to PM2.5 levels lower than 12 μg/m3 (1.23 [95% CI, 1.18 to 1.28] to 1.37 [95% CI, 1.34 to 1.40]).

Comparing the results from multiple and single pollutant models, we found that adjusting for the other two pollutants slightly attenuated the causal effects of PM2.5 and slightly elevated the causal effects of NO2 exposure on all-cause mortality. The results for O3 remained almost unchanged.

We found evidence of a harmful causal relationship between mortality and long-term PM2.5 exposures adjusted for NO2 and O3 across the range of annual averages between 2.77 and 17.16 μg/m3 (included >98% of observations) in the entire cohort of Medicare beneficiaries across the continental United States from 2000 to 2016. Our results are consistent with recent epidemiological studies reporting a strong association between long-term exposure to PM2.5 and adverse health outcomes at low exposure levels. Importantly, the curve was almost linear at exposure levels lower than the current national standards, indicating aggravated harmful effects at exposure levels even below these standards.

There is, in general, a harmful causal impact of long-term NO2 exposures to mortality adjusted for PM2.5 and O3 across the range of annual averages between 3.4 and 80 ppb (included >98% of observations). Yet within low levels (annual mean ≤53 ppb) below the current national standards, the causal impacts of NO2 exposures on all-cause mortality are nonlinear with statistical uncertainty.

The ERCs of long-term O3 exposures on all-cause mortality adjusted for PM2.5 and NO2 are almost flat below 45 ppb, which shows no statistically significant effect. Yet we observed an increased hazard when the O3 exposures were higher than 45 ppb, and the HR was approximately 1.10 when comparing Medicare beneficiaries with annual mean O3 exposures of 50 ppb versus those with 30 ppb.

institutions, including those that support the Health Effects Institute; therefore, it may not reflect the views or policies of these parties, and no endorsement by them should be inferred.

A list of abbreviations and other terms appears at the end of this volume.

PubMed Disclaimer

Figures

Statement Figure.
Statement Figure.
Associations between longer-term exposures to PM2.5 and all-cause mortality among enrollees in the full Medicare cohort (left side) and low-exposure cohort (right side). Hazard ratios (calculated per 10-μg/m3 increase in PM2.5 exposure) and 95% confidence intervals were estimated using three causal inference approaches with generalized propensity scores (matching, weighting, and adjustment) and two traditional approaches (Cox and Poisson regression). (Source: Investigators’ Report Figure 6).
Figure 1.
Figure 1.
Annual average PM2.5 concentrations in the continental United States for 2000 and 2016. The white dots are due to missing data.
Figure 2.
Figure 2.
Variance of the exposure error plotted against PM2.5 concentrations from monitors.
Figure 3.
Figure 3.
Annual average NO2 concentrations in the continental United States for 2000 and 2016. The white dots are due to missing data.
Figure 4.
Figure 4.
Annual average O3 concentrations in the continental United States for 2000 and 2016. The white dots are due to missing data.
Figure 5.
Figure 5.
Mean AC for unadjusted, weighted, and matched populations. Mean AC was smaller than 0.1 using causal inference GPS methods (matching and weighting). AC values of <0.1 indicate good covariate balance, strengthening the interpretability and validity of our analyses as providing evidence of causality. From Wu et al . © the Authors, some rights reserved; exclusive licensee AAAS. Distributed under a CC BY-NC 4.0 License, http://creativecommons.org/licenses/by-nc/4.0/.
Figure 6.
Figure 6.
HR and 95% CIs. The estimated HRs were obtained under five different statistical approaches (two traditional approaches and three causal inference approaches) and were adjusted by 10 potential confounders, four meteorological variables, geographic region, and year. From Wu et al . © the Authors, some rights reserved; exclusive licensee AAAS. Distributed under a CC BY-NC 4.0 License, http://creativecommons.org/licenses/by-nc/4.0/.
Figure 7.
Figure 7.
Estimated ERCs relating PM2.5, NO2, and O3 to all-cause mortality among Medicare beneficiaries (2000–2016) with associated 95% confidence bands. The left panel presents the ERCs in HRs associating long-term exposure to one pollutant with all-cause mortality adjusting for the other two pollutants as potential confounders. The right panel represents the ERCs of single-pollutant models without adjusting for the other two pollutants. We defined the baseline rate as the estimated hazard rate corresponding to an exposure level set at the 1st percentile of the distribution of each pollutant. The HRs were calculated as the ratio of the hazard rate at every exposed level to the baseline rate. To avoid potential unstable behavior at the support boundaries, we excluded the highest 1% and lowest 1% of pollutants exposures.
Figure 8.
Figure 8.
High-level overview of our data pipeline. The data pipeline involves three steps: (1) “Data Acquisition” (left panel), which involves identifying and acquiring publicly accessible data for the analysis; (2) “Data Joining and Harmonization” (middle panel), which involves developing and applying code for the processing of the data to ensure harmonization across data sources with regard to spatial and temporal resolutions; and (3) “Statistical Analyses” (right panel), which involves the development and application of novel statistical methodology to analyze the data. Code for all steps has been made publicly available on GitHub to ensure reproducibility (https://github.com/NSAPH/National-Casual-Analysis). (Statistical Analyses figures from Wu et al. , © the Authors, some rights reserved; exclusive licensee AAAS. Distributed under a CC BY-NC 4.0 License, http://creativecommons.org/licenses/by-nc/4.0/.)
Commentary Figure 1.
Commentary Figure 1.
Associations between longer-term exposures to PM2.5 and all-cause mortality among enrollees in the full Medicare cohort (left side) and in the low-exposure cohort (right side). Data shown are HRs and 95% CIs. The HRs were estimated under five statistical approaches: three causal inference approaches using generalized propensity scores (matching, weighting, and adjustment) and two traditional approaches (Cox and Poisson regression). The HRs were calculated per 10-μg/m3 increase in PM2.5 exposure. Results are presented for fully adjusted models. (Source: Adapted from Figure 6 in the Investigators’ Report.)
Commentary Figure 2.
Commentary Figure 2.
Estimated ER functions relating PM2.5, NO2, and O3 to all-cause mortality among Medicare enrollees (2000–2016) with and without adjustment for copollutants. Data shown are HRs with 95% CIs obtained using a generalized propensity score matching approach. The left panels show the ER functions associating long-term exposure to one pollutant with all-cause mortality, adjusted for the other two pollutants as potential confounders. The right panels show the ER functions for single-pollutant models without adjusting for the other two pollutants. To avoid potentially unstable behavior at the support boundaries, the highest 1% and lowest 1% of pollutants exposures were excluded. (Source: Figure 7 in the Investigators’ Report.)
None
None
None

Similar articles

Cited by

References

    1. Abatzoglou JT. 2013. Development of gridded surface meteorological data for ecological applications and modeling. Int J Climatol 33:121–131.
    1. Andersen PK, Gill RD. 1982. Cox’s regression model for counting processes: A large sample study. Ann Statist 10:1100–1120.
    1. Austin PC. 2019. Assessing covariate balance when using the generalized propensity score with quantitative or continuous exposures. Stat Methods Med Res 28:1365–1377. - PMC - PubMed
    1. Babanezhad M, Vansteelandt S, Goetghebeur E. 2010. Comparison of causal effect estimators under exposure misclassification. J Stat Plan Inference 140:1306–1319.
    1. Bang H, Robins JM. 2005. Doubly robust estimation in missing data and causal inference models. Biometrics 61:962–973. - PubMed

Publication types

LinkOut - more resources