Machine-Learning Prediction of Intensive Care Unit Admission Among Adults Presenting With Community-Acquired Pneumonia Using Routinely Collected Clinical Variables: A Systematic Evidence Synthesis and Model-Development Framework
DOI:
https://doi.org/10.66687/JMRISKeywords:
intensive care unit, community-acquired pneumonia, machine learningAbstract
Background: Community-acquired pneumonia (CAP) ranges from mild disease manageable outside hospital to rapidly progressive respiratory or circulatory failure requiring intensive care. Accurate identification of patients likely to deteriorate remains difficult. Conventional scores such as the Pneumonia Severity Index (PSI), CURB-65, SMART-COP and Risk of Early Admission to Intensive Care Unit (REA-ICU) provide structured risk assessment, but fixed weighting and limited interaction modelling may restrict performance. Routinely collected electronic clinical data provide an opportunity for machine-learning prediction.
Objective: To synthesize high-quality evidence available through 2021 regarding prediction of intensive care unit (ICU) requirement in adults with CAP and to define a reproducible machine-learning framework using routinely collected clinical variables.
Methods: A structured evidence synthesis was conducted using studies published no later than 31 December 2021 in first-quartile journals relevant to respiratory medicine, infectious diseases, critical care, clinical epidemiology and medical informatics. CAP severity scores, ICU-prediction studies and methodological literature on clinical prediction modelling were examined. Candidate predictors were restricted to variables realistically available at or shortly after emergency-department presentation.
Results: Existing prediction systems consistently identified respiratory rate, blood pressure, oxygenation, mental status, urea, age, comorbidity, radiographic extent and selected laboratory parameters as markers of severe disease. SMART-COP was designed specifically to identify intensive respiratory or vasopressor support and demonstrated high sensitivity in its derivation and validation cohorts. REA-ICU stratified risk of ICU admission within the first three hospital days from approximately 0.7% to 31%. More recent weighted approaches achieved discrimination approaching an AUC of 0.91. Electronic-health-record studies demonstrated that automated multivariable prediction using routinely captured variables was feasible. However, methodological literature showed that machine learning does not inherently outperform logistic regression and that calibration, external validation and clinical utility are essential.
Conclusion: Machine learning offers a plausible method for improving early CAP triage when applied to clinically available variables and evaluated against established severity scores. A robust model should prioritize early availability, prevent information leakage, address missing data within validation folds, compare interpretable and nonlinear algorithms, and report discrimination, calibration and decision-analytic utility. External validation is required before clinical implementation.
References
Fine MJ, Auble TE, Yealy DM, Hanusa BH, Weissfeld LA, Singer DE, et al. A prediction rule to identify low-risk patients with community-acquired pneumonia. N Engl J Med. 1997;336(4):243-250. doi:10.1056/NEJM199701233360402.
Lim WS, van der Eerden MM, Laing R, Boersma WG, Karalus N, Town GI, et al. Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study. Thorax. 2003;58(5):377-382. doi:10.1136/thorax.58.5.377.
Mandell LA, Wunderink RG, Anzueto A, Bartlett JG, Campbell GD, Dean NC, et al. Infectious Diseases Society of America/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin Infect Dis. 2007;44 Suppl 2:S27-S72. doi:10.1086/511159.
Charles PGP, Wolfe R, Whitby M, Fine MJ, Fuller AJ, Stirling R, et al. SMART-COP: a tool for predicting the need for intensive respiratory or vasopressor support in community-acquired pneumonia. Clin Infect Dis. 2008;47(3):375-384. doi:10.1086/589754.
Renaud B, Labarère J, Coma E, Santin A, Hayon J, Gurgui M, et al. Risk stratification of early admission to the intensive care unit of patients with no major criteria of severe community-acquired pneumonia: development of an international prediction rule. Crit Care. 2009;13(2):R54. doi:10.1186/cc7781.
Phua J, See KC, Chan YH, Widjaja LS, Aung NW, Ngerng WJ, et al. Validation and clinical implications of the IDSA/ATS minor criteria for severe community-acquired pneumonia. Thorax. 2009;64(7):598-603.
Chalmers JD, Taylor JK, Mandal P, Choudhury G, Singanayagam A, Akram AR, et al. Validation of the Infectious Diseases Society of America/American Thoracic Society minor criteria for intensive care unit admission in community-acquired pneumonia patients without major criteria or contraindications to intensive care unit care. Clin Infect Dis. 2011;53(6):503-511. doi:10.1093/cid/cir463.
Renaud B, Schuetz P, Claessens YE, Labarère J, Albrich W, Mueller B. Proadrenomedullin improves Risk of Early Admission to ICU score for predicting early severe community-acquired pneumonia. Chest. 2012;142(6):1447-1454. doi:10.1378/chest.11-2574.
Gearhart AM, Furmanek S, English C, Ramirez J, Cavallazzi R. Predicting the need for ICU admission in community-acquired pneumonia. Respir Med. 2019;155:61-65. doi:10.1016/j.rmed.2019.07.007.
Jones BE, Ying J, Nevers M, Alba PR, He T, Patterson OV, et al. Computerized mortality prediction for community-acquired pneumonia at 117 Veterans Affairs Medical Centers. Ann Am Thorac Soc. 2021;18(7):1175-1184. doi:10.1513/AnnalsATS.202011-1372OC.
Metlay JP, Waterer GW, Long AC, Anzueto A, Brozek J, Crothers K, et al. Diagnosis and treatment of adults with community-acquired pneumonia: an official clinical practice guideline of the American Thoracic Society and Infectious Diseases Society of America. Am J Respir Crit Care Med. 2019;200(7):e45-e67. doi:10.1164/rccm.201908-1581ST.
Christodoulou E, Ma J, Collins GS, Steyerberg EW, Verbakel JY, Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019;110:12-22. doi:10.1016/j.jclinepi.2019.02.004.
Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med. 2015;162(1):55-63. doi:10.7326/M14-0697.
Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51-58. doi:10.7326/M18-1376.
Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17:230. doi:10.1186/s12916-019-1466-7.
Riley RD, Ensor J, Snell KIE, Harrell FE Jr, Martin GP, Reitsma JB, et al. Calculating the sample size required for developing a clinical prediction model. BMJ. 2020;368:m441. doi:10.1136/bmj.m441.