Comparative effectiveness of ML model and Fetal Medicine Foundation algorithm for preterm preeclampsia prediction: a validation study in Russian population
Ivshin A.A., Boldina Yu.S., Malyshev N.A.
Objective. To compare the performance of a machine-learning (ML) model based on logistic regression with Platt scaling and the Fetal Medicine Foundation (FMF) algorithm for predicting preterm pre-eclampsia in a Russian population.
Materials and methods. This retrospective cohort study included 14 950 singleton pregnancies (development cohort: n=7581; validation cohort: n=7369). Maternal characteristics, biophysical markers (systolic blood pressure and uterine artery pulsatility index), and biochemical markers (PlGF, PAPP-A, and sFlt-1) assessed at 11–13 weeks of gestation were analyzed. The primary outcome was pre-eclampsia requiring delivery before 37 weeks of gestation. Discrimination (AUC), calibration (observed-to-expected ratio [O:E] and Brier score), and clinical utility (decision curve analysis [DCA] ) were compared.
Results. On internal validation, the ML model outperformed the FMF algorithm (AUC 0.923 vs. 0.906; ΔAUC=+0.017; p=0.013). On external validation, the between-model difference was not statistically significant (AUC 0.900 vs. 0.889; p=0.229). The ML model demonstrated substantially better calibration (O:E 0.974 vs. 0.808). The intersection of the ROC curves was observed at a false-positive rate threshold of approximately 7–8%.
Conclusion. The ML model showed comparable discriminative performance and markedly superior calibration compared with the FMF algorithm. The observed complementarity of the models suggests the potential of hybrid approaches to optimize preeclampsia screening in the Russian population.
Authors' contributions. Ivshin A.A. – conception and supervision of the study, expert analysis of results, editing of the manuscript; Boldina Yu.S. – drafting of the manuscript; Malyshev N.A. – data analysis and mathematical modeling.
Conflicts of interest. The authors have no conflicts of interest to declare.
Funding. The study was supported by the Russian Science Foundation grant No. 24-25-00429,
https://rscf.ru/project/24-25-00429/
Ethical Approval. The study was reviewed and approved by the Research Ethics Committee of the Petrozavodsk State University (Ref. No: 17 of 20.03.2024).
Generative Artificial Intelligence. No artificial intelligence tools were used in the preparation of this manuscript. Statistical analysis was performed by the author using R 4.3 and Python 3.11. The author bears full responsibility for the content of the publication.
Patient Consent for Publication. Given the retrospective nature of the study and the use of de-identified data, informed consent was not required under applicable law.
Authors' Data Sharing Statement. The study data contain personal medical information and cannot be made publicly available in accordance with the requirements of Federal Law No. 152-FZ “On Personal Data.” Depersonalized aggregated data may be provided for justified research requests following approval by the local ethics committee. The Python code, including scripts for data preprocessing, model training, and validation, is available in a GitHub repository upon request from the corresponding author.
For citation: Ivshin A.A., Boldina Yu.S., Malyshev N.A. Comparative effectiveness of ML model and Fetal Medicine Foundation algorithm for preterm preeclampsia prediction: a validation study in Russian population.
Akusherstvo i Ginekologiya/Obstetrics and Gynecology. 2026; (6): 109-124 (in Russian)
https://dx.doi.org/10.18565/aig.2026.13
Keywords
References
- Brown M.A., Magee L.A., Kenny L.C., Karumanchi S.A., McCarthy F.P., Saito S. et al.; International Society for the Study of Hypertension in Pregnancy (ISSHP). The hypertensive disorders of pregnancy: ISSHP classification, diagnosis & management recommendations for international practice. Pregnancy Hypertens. 2018; 13: 291-310. https://dx.doi.org/10.1016/j.preghy.2018.05.004
- American College of Obstetricians and Gynecologists. Gestational hypertension and preeclampsia: ACOG Practice Bulletin № 222. Obstet. Gynecol. 2020; 135(6): e237-60. https://dx.doi.org/10.1097/AOG.0000000000003891
- Dimitriadis E., Rolnik D.L., Zhou W., Estrada-Gutierrez G., Koga K., Francisco R.P.V. et al. Pre-eclampsia. Nat. Rev. Dis. Primers. 2023; 9(1): 8. https://dx.doi.org/10.1038/s41572-023-00417-6
- Saleem S., McClure E.M., Goudar S.S., Patel A., Esamai F., Garces A. et al. A prospective study of maternal, fetal and neonatal deaths in low- and middle-income countries. Bull. World Health Organ. 2014; 92(8): 605-12. https://dx.doi.org/10.2471/BLT.13.127464
- Министерство здравоохранения Российской Федерации. Клинические рекомендации. Преэклампсия. Эклампсия. Отеки, протеинурия и гипертензивные расстройства во время беременности, в родах и послеродовом периоде. 2024. Доступно по: https://cr.minzdrav.gov.ru/view-cr/637_2 [Ministry of Health of the Russian Federation. Clinical guidelines. Preeclampsia. Eclampsia. Edema, proteinuria, and hypertensive disorders during pregnancy, childbirth, and the postpartum period. 2024. Available at: https://cr.minzdrav.gov.ru/view-cr/637_2 (in Russian)].
- Chappell L.C., Cluver C.A., Kingdom J., Tong S. Pre-eclampsia. Lancet. 2021; 398(10297): 341-54. https://dx.doi.org/10.1016/S0140-6736(20)32335-7
- Brosens I., Pijnenborg R., Vercruysse L., Romero R. The "Great Obstetrical Syndromes" are associated with disorders of deep placentation. Am. J. Obstet. Gynecol. 2011; 204(3): 193-201. https://dx.doi.org/10.1016/j.ajog.2010.08.009
- Zeisler H., Llurba E., Chantraine F., Vatish M., Cathrine A., Sennström S.M. et al. Predictive value of the sFlt-1:PlGF ratio in women with suspected preeclampsia. N. Engl. J. Med. 2016; 374(1): 13-22. https://dx.doi.org/10.1056/NEJMoa1414838
- Ходжаева З.С., Холин А.М., Вихляева Е.М. Ранняя и поздняя преэклампсия: парадигмы патобиологии и клиническая практика. Акушерство и гинекология. 2013; 10: 4-11 [Khodzhaeva Z.S., Kholin A.M., Vikhlyaeva E.M. Early and late preeclampsia: pathobiology paradigms and clinical practice. Obstetrics and Gynecology. 2013; 10: 4-11 (in Russian)].
- Воднева Д.Н., Романова В.В., Дубова Е.А., Павлов К.А., Шмаков Р.Г., Щеголев А.И. Клинико-морфологические особенности ранней и поздней преэклампсии. Акушерство и гинекология. 2014; 2: 35-40. [Vodneva D.N., Romanova V.V., Dubova E.A., Pavlov K.A., Shmakov R.G., Shchegolev A.I. Clinical and morphological features of early and late preeclampsia. Obstetrics and Gynecology. 2014; (2): 35-40 (in Russian)].
- Chaemsaithong P., Sahota D.S., Poon L.C. First trimester preeclampsia screening and prediction. Am. J. Obstet. Gynecol. 2022; 226(2S): S1071-S1097.e2. https://dx.doi.org/10.1016/j.ajog.2020.07.020
- Stepan H., Galindo A., Hund M., Schlembach D., Sillman J., Surbek D. et al. Clinical utility of sFlt-1 and PlGF in screening, prediction, diagnosis and monitoring of pre-eclampsia and fetal growth restriction. Ultrasound Obstet. Gynecol. 2023; 61(2): 168-80. https://dx.doi.org/10.1002/uog.26032
- Ходжаева З.С., Холин А.М., Шувалова М.П., Иванец Т.Ю., Демура С.А., Галичкина И.В. Российская модель оценки эффективности теста на преэклампсию sFlt-1/PlGF. Акушерство и гинекология. 2019; 2: 52-8. https://dx.doi.org/10.18565/aig.2019.2.52-58. [Khodzhaeva Z.S., Kholin A.M., Shuvalova M.P., Ivanets T.Yu., Demura S.A., Galichkina I.V. A Russian model for evaluating the efficiency of the sFlt-1/PlGF test for preeclampsia. Obstetrics and Gynecology. 2019; (2): 52-8 (in Russian). https://dx.doi.org/10.18565/aig.2019.2.52-58].
- Wright D., Syngelaki A., Akolekar R., Poon L.C., Nicolaides K.H. Competing risks model in screening for preeclampsia by maternal characteristics and medical history. Am. J. Obstet. Gynecol. 2015; 213(1): 62.e1-10. https://dx.doi.org/10.1016/j.ajog.2015.02.018
- Rolnik D.L., Wright D., Poon L.C., O’Gorman N., Syngelaki A., de Paco Matallana C. et al. Aspirin versus placebo in pregnancies at high risk for preterm preeclampsia. N. Engl. J. Med. 2017; 377(7): 613-22. https://dx.doi.org/10.1056/NEJMoa1704559
- Poon L.C., Shennan A., Hyett J.A., Kapur A., Hadar E., Divakar H. et al. The International federation of gynecology and obstetrics (FIGO) initiative on pre-eclampsia. Int. J. Gynaecol. Obstet. 2019; 145(Suppl 1): 1-33. https://dx.doi.org/10.1002/ijgo.12802
- O'Gorman N., Wright D., Poon L.C., Rolnik D.L., Syngelaki A., de Alvarado M. et al. Multicenter screening for pre-eclampsia by maternal factors and biomarkers at 11-13 weeks' gestation: comparison with NICE guidelines and ACOG recommendations. Ultrasound Obstet. Gynecol. 2017; 49: 756-60. https://dx.doi.org/10.1002/uog.17455
- Aljameel S.S., Alzahrani M., Almusharraf R., Altukhais M., Alshaia S., Sahlouli H. et al. Prediction of preeclampsia using machine learning and deep learning models: a review. Big Data Cogn. Comput. 2023; 7(1): 32. https://dx.doi.org/10.3390/bdcc7010032
- O’Gorman N., Wright D., Syngelaki A., Akolekar R., Wright A., Poon L.C. et al. Competing risks model in screening for preeclampsia by maternal factors and biomarkers at 11-13 weeks’ gestation. Am. J. Obstet. Gynecol. 2016; 214(1): 103.e1-12. https://dx.doi.org/10.1016/j.ajog.2015.08.034
- Roberge S., Bujold E., Nicolaides K.H. Aspirin for the prevention of preterm and term preeclampsia: systematic review and metaanalysis. Am. J. Obstet. Gynecol. 2018; 218(3): 287-93.e1. https://dx.doi.org/10.1016/j.ajog.2017.11.561
- Bujold E., Roberge S., Lacasse Y., Bureau M. Prevention of preeclampsia and intrauterine growth restriction with aspirin started in early pregnancy: a meta-analysis. Obstet. Gynecol. 2010; 116(2 Pt 1): 402-14. https://dx.doi.org/10.1097/AOG.0b013e3181e9322a
- Van Calster B., McLernon D.J., van Smeden M., Wynants L., Steyerberg E.W. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019; 17(1): 230. https://dx.doi.org/10.1186/s12916-019-1466-7
- Zwertbroek E.F., Groen H., Fontanella F., Maggio L., Caterina L.M., Bilardo M. Performance of the FMF first-trimester preeclampsia-screening algorithm in a high-risk population in the Netherlands. Fetal. Diagn. Ther. 2021; 48(2):103-11. https://dx.doi.org/10.1159/000512335
- Collins G.S., Reitsma J.B., Altman D.G., Moons K.G.M. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD). BMJ. 2015; 350: g7594. https://dx.doi.org/10.1136/bmj.g7594
- Poon L.C., Zymeri N.A., Zamprakou A., Syngelaki A., Nicolaides K.H. Protocol for measurement of mean arterial pressure at 11-13 weeks' gestation. Fetal. Diagn. Ther. 2012; 31(1): 42-8. https://dx.doi.org/10.1159/000335366
- Kovacheva V.P., Eberhard B.W., Cohen R.Y., Maher M., Saxena R., Gray K.J. Preeclampsia prediction using machine learning and polygenic risk scores. Hypertension. 2024; 81(2): 264-72. https://dx.doi.org/10.1161/HYPERTENSIONAHA.123.21053
- Li T., Xu M., Wang Y., Wang Y., Tang H., Duan H. et al. Prediction model of preeclampsia using machine learning based methods: a population based cohort study in China. Front. Endocrinol. (Lausanne). 2024; 15: 1345573. https://dx.doi.org/10.3389/fendo.2024.1345573
- DeLong E.R., DeLong D.M., Clarke-Pearson D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988; 44(3): 837-45. https://dx.doi.org/10.2307/2531595
- Steyerberg E.W., Vickers A.J., Cook N.R., Gerds T., Gonen M., Obuchowski N. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010; 21(1): 128-38. https://dx.doi.org/10.1097/EDE.0b013e3181c30fb2
- Vickers A.J., Elkin E.B. Decision curve analysis: a novel method for evaluating prediction models. Med. Decis. Making. 2006; 26(6): 565-74. https://dx.doi.org/10.1177/0272989X06295361
- Холин А.М., Муминова К.Т., Балашов И.С., Ходжаева З.С., Боровиков П.И., Иванец Т.Ю., Гус А.И. Прогнозирование преэклампсии в первом триместре беременности: валидация алгоритмов скрининга на российской популяции. Акушерство и гинекология. 2017; 8: 74-84. https://dx.doi.org/10.18565/aig.2017.8.74-84 [Kholin A.M., Muminova K.T., Balashov I.S., Khodzhaeva Z.S., Borovikov P.I., Ivanets T.Yu., Gus A.I. First-trimester prediction of preeclampsia: Validation of screening algorithms in a Russian population. Obstetrics and Gynecology. 2017; (8): 74-84 (in Russian). https://dx.doi.org/10.18565/aig.2017.8.74-84].
- Ившин А.А., Малышев Н.А. Ранняя стратификация риска преэклампсии на основе мультипараметрической модели машинного обучения и рутинно собираемых клинических данных. Акушерство, гинекология и репродукция. 2026; 20(1): 111-29. https://dx.doi.org/10.17749/2313-7347/ob.gyn.rep.2025.706 [Ivshin A.A., Malyshev N.A. Early stratification of the risk of preeclampsia based on a multiparametric machine learning model and routinely collected clinical data. Obstetrics, Gynecology and Reproduction. 2026; 20(1): 111-29 (in Russian). https://dx.doi.org/10.17749/2313-7347/ob.gyn.rep.2025.706].
- Tan M.Y., Syngelaki A., Poon L.C., Rolnik D.L., O'Gorman N., Delgado J.L. et al. Screening for pre-eclampsia by maternal factors and biomarkers at 11-13 weeks’ gestation. Ultrasound Obstet. Gynecol. 2018; 52(2): 186-95. https://dx.doi.org/10.1002/uog.19112
- Platt J.C. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Smola A.J., Bartlett P.L., Schölkopf B., Schuurmans D., eds. Advances in large margin classifiers. Cambridge: MIT Press; 1999: 61-74.
- Gil M.M., Cuenca-Gómez D., Rolle V., Pertegal M., Díaz C., Revello R. et al. Validation a machine-learning model for first-trimester prediction of pre-eclampsia using the cohort from the PREVAL study. Ultrasound Obstet. Gynecol. 2024; 63(1): 68-74. https://dx.doi.org/10.1002/uog.27480
- Torres-Torres J., Villafan-Bernal J.R., Martinez-Portilla R.J., Hidalgo-Carrera J.A., Estrada-Gutierrez G., Adalid-Martinez-Cisneros R. et al. Performance of machine-learning approach for prediction of pre-eclampsia in a middle-income country. Ultrasound Obstet. Gynecol. 2024; 63(3): 350-7. https://dx.doi.org/10.1002/uog.27510
Received 19.01.2026
Accepted 11.02.2026
About the Authors
Aleksandr A. Ivshin, PhD, Associate Professor, Head of the Department of Obstetrics and Gynecology, Dermatovenerology of the Medical Institute, Petrozavodsk State University, 31, Krasnoarmeyskaya str., Petrozavodsk, Republic of Karelia, 185035, Russia, +7(909)567-12-51, scipeople@mail.ru, https://orcid.org/0000-0001-7834-096XYuliya S. Boldina, PhD Student, Senior Lecturer of Department of Obstetrics, Gynecology, Dermatovenereology of the Medical Institute, Petrozavodsk State University, 31, Krasnoarmeyskaya str., Petrozavodsk, Republic of Karelia, 185035, Russia; Obstetrician-Gynecologist, Republican Perinatal Center named after K.A. Gutkin, Petrozavodsk, +7(981)405-85-24, ulia.isakova94@gmail.com, https://orcid.org/0000-0002-1450-650X
Nikita A. Malyshev, PhD Student in the scientific specialty «Information-Measuring and Control Systems», Lecturer, Department of Family Medicine, Public Health, Healthcare Management, Life Safety, Disaster Medicine of the Medical Institute, Petrozavodsk State University, 31, Krasnoarmeyskaya str., Petrozavodsk, Republic of Karelia, 185035, Russia, +7(921)461-38-60, malyshev.nikita.2016@gmail.com, https://orcid.org/0009-0005-2722-5976
Corresponding author: Alexandr A. Ivshin, scipeople@mail.ru



