AI-Assisted Audit of Intensive-Care Risk Scores under Missing Laboratory Data

Authors

  • Nour Abbes LSU Health New Orleans Author

DOI:

https://doi.org/10.66687/4z49kt09

Keywords:

Artificial Intelligence, Machine Learning, Medical Informatics, Decision Support Systems, Clinical, Reproducibility of Results

Abstract

Intensive-care risk scores can become unreliable when laboratory results arrive late or are missing at the moment clinicians need a prediction. The objective is to test how missing-data mechanisms affect the calibration and usefulness of AI-based deterioration alerts. Relevant methodological and data-quality literature informs the design of the sampling and validation strategy [3–7]. The proposed method is a retrospective, patient-level validation protocol using de-identified longitudinal ICU records, with hospital and calendar-period holdouts. Comparators will include complete-case scoring, imputation and missingness-aware prediction under matched alert budgets. Enterprise-storage sources are used to specify constraints on data availability and provenance [1], with complementary infrastructure evidence defining practical recovery safeguards [2]. These citations are not treated as clinical effectiveness evidence. The design prioritises precise operational definitions and a straightforward baseline before introducing more complex alternatives. Statistical and computational sources help define the reproducibility checks and comparison procedures [8–12]. The primary outcomes are calibration error, sensitivity at a fixed alert rate, subgroup performance and time to actionable warning. Potential biases include patient-level leakage, changes in test-ordering practices and clinicians’ review of ambiguous outcomes. Primary analyses would be reported by the main deployment or participant subgroup so that averaged results do not conceal systematic failures. Additional research informs the prespecified stress tests and limits on interpretation [13–17]. The intended contribution is an auditable research protocol rather than an unsupported claim of effectiveness; related work frames its transferability limits [18–23].

References

[1] Mohammed Nazir. (2021). Automating Enterprise Storage Provisioning with PowerShell and Python: Effects on Deployment Time and Configuration Errors. Journal of Multidisciplinary Research and Integrated Sciences, 1(1), 43–55. https://jmris.com/index.php/jmris/article/view/2021P1V6

[2] Mohammed Nazir. (2022). Performance Comparison of AWS EBS, EFS and S3 for Enterprise Cloud-Storage Workloads. International Journal of Business & Computational Sciences, 2(1), 26–33. https://ijbcs.org/index.php/IJBCS/article/view/2022-01-05

[3] Esteva, A., Kuprel, B., Novoa, R. A., et al. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542, 115–118. https://www.nature.com/articles/nature21056

[4] Johnson, A., Pollard, T., & Mark, R. (2016). MIMIC-III Clinical Database, version 1.4. PhysioNet. https://physionet.org/content/mimiciii/1.4/

[5] Liu, X., Faes, L., Kale, A. U., et al. (2020). Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nature Medicine, 26, 1364–1374. https://www.nature.com/articles/s41591-020-1034-x

[6] Singhal, K., Azizi, S., Tu, T., et al. (2023). Large language models encode clinical knowledge. Nature, 620, 172–180. https://www.nature.com/articles/s41586-023-06291-2

[7] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6

[8] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2

[9] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1706.03762

[10] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[11] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li

[12] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874

[13] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems

[14] Yang, Z. et al. (2024). TeRM: Extending RDMA-Attached Memory with SSD. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/yang-zhe

[15] Xu, J. et al. (2021). Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. arXiv:2110.02642. https://arxiv.org/abs/2110.02642

[16] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise

[17] Li, X. et al. (2023). ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/li-xiaolu

[18] Bai, W. et al. (2023). Empowering Azure Storage with RDMA. USENIX NSDI '23. https://www.usenix.org/conference/nsdi23/presentation/bai

[19] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu

[20] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao

[21] Wu, K. et al. (2021). The Storage Hierarchy is Not a Hierarchy: Optimizing Caching on Modern Storage Devices with Orthus. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/wu-kan

[22] Darban, Z.Z. et al. (2022). Deep Learning for Time Series Anomaly Detection: A Survey. arXiv:2211.05244. https://arxiv.org/abs/2211.05244

[23] Li, N. et al. (2022). Speculative Recovery: Cheap, Highly Available Fault Tolerance with Disaggregated Storage. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/li-nanqinqin

Published

2024-03-15

Similar Articles

1-10 of 134

You may also start an advanced similarity search for this article.