Validation and development of models using clinical, biochemical and ultrasound markers for predicting pre-eclampsia: an individual participant data meta-analysis
- PMID: 33336645
- PMCID: PMC7780127
- DOI: 10.3310/hta24720
Validation and development of models using clinical, biochemical and ultrasound markers for predicting pre-eclampsia: an individual participant data meta-analysis
Abstract
Background: Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk is needed to plan management.
Objectives: To assess the performance of existing pre-eclampsia prediction models and to develop and validate models for pre-eclampsia using individual participant data meta-analysis. We also estimated the prognostic value of individual markers.
Design: This was an individual participant data meta-analysis of cohort studies.
Setting: Source data from secondary and tertiary care.
Predictors: We identified predictors from systematic reviews, and prioritised for importance in an international survey.
Primary outcomes: Early-onset (delivery at < 34 weeks' gestation), late-onset (delivery at ≥ 34 weeks' gestation) and any-onset pre-eclampsia.
Analysis: We externally validated existing prediction models in UK cohorts and reported their performance in terms of discrimination and calibration. We developed and validated 12 new models based on clinical characteristics, clinical characteristics and biochemical markers, and clinical characteristics and ultrasound markers in the first and second trimesters. We summarised the data set-specific performance of each model using a random-effects meta-analysis. Discrimination was considered promising for C-statistics of ≥ 0.7, and calibration was considered good if the slope was near 1 and calibration-in-the-large was near 0. Heterogeneity was quantified using I2 and τ2. A decision curve analysis was undertaken to determine the clinical utility (net benefit) of the models. We reported the unadjusted prognostic value of individual predictors for pre-eclampsia as odds ratios with 95% confidence and prediction intervals.
Results: The International Prediction of Pregnancy Complications network comprised 78 studies (3,570,993 singleton pregnancies) identified from systematic reviews of tests to predict pre-eclampsia. Twenty-four of the 131 published prediction models could be validated in 11 UK cohorts. Summary C-statistics were between 0.6 and 0.7 for most models, and calibration was generally poor owing to large between-study heterogeneity, suggesting model overfitting. The clinical utility of the models varied between showing net harm to showing minimal or no net benefit. The average discrimination for IPPIC models ranged between 0.68 and 0.83. This was highest for the second-trimester clinical characteristics and biochemical markers model to predict early-onset pre-eclampsia, and lowest for the first-trimester clinical characteristics models to predict any pre-eclampsia. Calibration performance was heterogeneous across studies. Net benefit was observed for International Prediction of Pregnancy Complications first and second-trimester clinical characteristics and clinical characteristics and biochemical markers models predicting any pre-eclampsia, when validated in singleton nulliparous women managed in the UK NHS. History of hypertension, parity, smoking, mode of conception, placental growth factor and uterine artery pulsatility index had the strongest unadjusted associations with pre-eclampsia.
Limitations: Variations in study population characteristics, type of predictors reported, too few events in some validation cohorts and the type of measurements contributed to heterogeneity in performance of the International Prediction of Pregnancy Complications models. Some published models were not validated because model predictors were unavailable in the individual participant data.
Conclusion: For models that could be validated, predictive performance was generally poor across data sets. Although the International Prediction of Pregnancy Complications models show good predictive performance on average, and in the singleton nulliparous population, heterogeneity in calibration performance is likely across settings.
Future work: Recalibration of model parameters within populations may improve calibration performance. Additional strong predictors need to be identified to improve model performance and consistency. Validation, including examination of calibration heterogeneity, is required for the models we could not validate.
Study registration: This study is registered as PROSPERO CRD42015029349.
Funding: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 72. See the NIHR Journals Library website for further project information.
Keywords: INDIVIDUAL PARTICIPANT DATA; IPD; PRE-ECLAMPSIA; PREDICTION MODEL; PROGNOSTIC MODEL; VALIDATION.
Plain language summary
What is the problem?: Pre-eclampsia, a condition in pregnancy that results in raised blood pressure and protein in the urine, is a major cause of complications for the mother and baby.
What is needed?: A way of accurately identifying women at high risk of pre-eclampsia to allow clinicians to start preventative interventions such as administering aspirin or frequently monitoring women during pregnancy.
Where are the research gaps?: Although over 100 tools (models) have been reported worldwide to predict pre-eclampsia, to date their performance in women managed in the UK NHS is unknown.
What did we plan to do?: We planned to comprehensively identify all published models that predict the risk of pre-eclampsia occurring at any time during pregnancy and to assess if this prediction is accurate in the UK population. If the existing models did not perform satisfactorily, we aimed to develop new prediction models.
What did we find?: We formed the International Prediction of Pregnancy Complications network, which provided data from a large number of studies (78 studies, 25 countries, 125 researchers, 3,570,993 singleton pregnancies). We were able to assess the performance of 24 out of the 131 models published to predict pre-eclampsia in 11 UK data sets. The models did not accurately predict the risk of pre-eclampsia across all UK data sets, and their performance varied within individual data sets. We developed new prediction models that showed promising performance on average across all data sets, but their ability to correctly identify women who develop pre-eclampsia varied between populations. The models were more clinically useful when used in the care of first-time mothers pregnant with one child, compared to a strategy of treating them all as if they were at high-risk of pre-eclampsia.
What does this mean?: Before using the International Prediction of Pregnancy Complications models in various populations, they need to be adjusted for characteristics of the particular population and the setting of application.
Similar articles
-
External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis.BMC Med. 2020 Nov 2;18(1):302. doi: 10.1186/s12916-020-01766-9. BMC Med. 2020. PMID: 33131506 Free PMC article.
-
A prognostic model to guide decision-making on timing of delivery in late preterm pre-eclampsia: the PEACOCK prospective cohort study.Health Technol Assess. 2021 May;25(30):1-32. doi: 10.3310/hta25300. Health Technol Assess. 2021. PMID: 34024312 Free PMC article.
-
The International Federation of Gynecology and Obstetrics (FIGO) initiative on pre-eclampsia: A pragmatic guide for first-trimester screening and prevention.Int J Gynaecol Obstet. 2019 May;145 Suppl 1(Suppl 1):1-33. doi: 10.1002/ijgo.12802. Int J Gynaecol Obstet. 2019. PMID: 31111484 Free PMC article.
-
Accuracy of placental growth factor alone or in combination with soluble fms-like tyrosine kinase-1 or maternal factors in detecting preeclampsia in asymptomatic women in the second and third trimesters: a systematic review and meta-analysis.Am J Obstet Gynecol. 2023 Sep;229(3):222-247. doi: 10.1016/j.ajog.2023.03.032. Epub 2023 Mar 28. Am J Obstet Gynecol. 2023. PMID: 36990308 Review.
-
Mini-combined test compared with NICE guidelines for early risk-assessment for pre-eclampsia: the SPREE diagnostic accuracy study.Southampton (UK): NIHR Journals Library; 2020 Nov. Southampton (UK): NIHR Journals Library; 2020 Nov. PMID: 33226739 Free Books & Documents. Review.
Cited by
-
Fibrinaloid Microclots and Atrial Fibrillation.Biomedicines. 2024 Apr 17;12(4):891. doi: 10.3390/biomedicines12040891. Biomedicines. 2024. PMID: 38672245 Free PMC article. Review.
-
Transparent reporting of multivariable prediction models developed or validated using clustered data: TRIPOD-Cluster checklist.BMJ. 2023 Feb 7;380:e071018. doi: 10.1136/bmj-2022-071018. BMJ. 2023. PMID: 36750242 Free PMC article.
-
Transparent reporting of multivariable prediction models developed or validated using clustered data (TRIPOD-Cluster): explanation and elaboration.BMJ. 2023 Feb 7;380:e071058. doi: 10.1136/bmj-2022-071058. BMJ. 2023. PMID: 36750236 Free PMC article.
-
Phenotype-Directed Management of Hypertension in Pregnancy.J Am Heart Assoc. 2022 Apr 5;11(7):e023694. doi: 10.1161/JAHA.121.023694. Epub 2022 Mar 14. J Am Heart Assoc. 2022. PMID: 35285667 Free PMC article. Review.
-
Prediction of Adverse Pregnancy Outcome Related to Placental Dysfunction Using the sFlt-1/PlGF Ratio: A Narrative Review.Geburtshilfe Frauenheilkd. 2021 Aug;81(8):948-954. doi: 10.1055/a-1403-2576. Epub 2021 Aug 9. Geburtshilfe Frauenheilkd. 2021. PMID: 34393258 Free PMC article.
References
-
- Brown MA, Hague WM, Higgins J, Lowe S, McCowan L, Oats J, et al. The detection, investigation and management of hypertension in pregnancy: executive summary. Aust N Z J Obstet Gynaecol 2000;40:133–8. https://doi.org/10.1111/j.1479-828x.2000.tb01136.x doi: 10.1111/j.1479-828x.2000.tb01136.x. - DOI - PubMed
-
- Sibai B, Dekker G, Kupferminc M. Pre-eclampsia. Lancet 2005;365:785–99. https://doi.org/10.1016/S0140-6736(05)17987-2 doi: 10.1016/S0140-6736(05)17987-2. - DOI - PubMed
-
- Sibai BM. Diagnosis and management of gestational hypertension and preeclampsia. Obstet Gynecol 2003;102:181–92. https://doi.org/10.1097/00006250-200307000-00033 doi: 10.1097/00006250-200307000-00033. - DOI - PubMed
-
- Tranquilli AL, Dekker G, Magee L, Roberts J, Sibai BM, Steyn W, et al. The classification, diagnosis and management of the hypertensive disorders of pregnancy: a revised statement from the ISSHP. Pregnancy Hypertens 2014;4:97–104. https://doi.org/10.1016/j.preghy.2014.02.001 doi: 10.1016/j.preghy.2014.02.001. - DOI - PubMed
-
- Staff AC, Benton SJ, von Dadelszen P, Roberts JM, Taylor RN, Powers RW, et al. Redefining preeclampsia using placenta-derived biomarkers. Hypertension 2013;61:932–42. https://doi.org/10.1161/HYPERTENSIONAHA.111.00250 doi: 10.1161/HYPERTENSIONAHA.111.00250. - DOI - PubMed