AI-Assisted Audit of Intensive-Care Risk Scores under Missing Laboratory Data: An Audit-Ready Methods Framework
DOI:
https://doi.org/10.66687/gzw8g644Keywords:
Artificial Intelligence, Machine Learning, Medical Informatics, Decision Support Systems, Clinical, Reproducibility of ResultsAbstract
Intensive-care risk scores can become unreliable when laboratory results arrive late or are missing at the moment clinicians need a prediction. This gap has consequences for interpreting performance outside carefully curated evaluation settings. This study aims to test how missing-data mechanisms affect the calibration and usefulness of AI-based deterioration alerts. The evaluation would follow a retrospective, patient-level validation protocol using de-identified longitudinal ICU records, with hospital and calendar-period holdouts. The choice of evaluation units and exclusion criteria is informed by the broader methodological record [3–7]. The analysis will contrast complete-case scoring, imputation and missingness-aware prediction under matched alert budgets. The audit-focused extension preserves processing logs, model decisions and exception handling for independent review. The technical pipeline must remain auditable: prior work on storage operations provides system-level context [1], while a second source identifies infrastructure conditions relevant to data continuity [2], rather than patient-level outcomes. Assessment will focus on calibration error, sensitivity at a fixed alert rate, subgroup performance and time to actionable warning. The supporting evidence base motivates the chosen comparator conditions and robustness criteria [8–12]. Critical sensitivity checks address patient-level leakage, changes in test-ordering practices and clinicians’ review of ambiguous outcomes. Further systems and modelling literature supplies context for the proposed sensitivity analyses [13–17]. Uncertain outcomes would be adjudicated with a predefined rubric, rather than silently recoded as successes. The expected output is a reusable evaluation framework with transparent uncertainty and reporting rules, informed by wider reproducibility literature [18–23].
References
[1] Mohammed Nazir. (2022). SVM-Based Disaster Recovery for Hybrid Enterprise Storage: Effects on Recovery Time and Service Availability. Journal of Computing, Intelligence and Information Sciences, 3(1). https://jciis.com/index.php/jciis/article/view/2022-01-05
[2] Mohammed Nazir. (2022). Performance Comparison of AWS EBS, EFS and S3 for Enterprise Cloud-Storage Workloads. International Journal of Business & Computational Sciences, 2(1), 26–33. https://ijbcs.org/index.php/IJBCS/article/view/2022-01-05
[3] Esteva, A., Kuprel, B., Novoa, R. A., et al. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542, 115–118. https://www.nature.com/articles/nature21056
[4] Johnson, A., Pollard, T., & Mark, R. (2016). MIMIC-III Clinical Database, version 1.4. PhysioNet. https://physionet.org/content/mimiciii/1.4/
[5] Singhal, K., Azizi, S., Tu, T., et al. (2023). Large language models encode clinical knowledge. Nature, 620, 172–180. https://www.nature.com/articles/s41586-023-06291-2
[6] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6
[7] Begum, M. H., Talukder, S. I., Ahmed, M. J., Khan, M. F. I., & Azam, M. A. (2025). XAI-Driven Multimodal Deep Learning for Early Sepsis Prediction in ICU. Journal of Science Technology and Social Transformation, 1(1), 30–41. https://jstst.info/j/article/view/25
[8] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2
[9] Liu, X., Faes, L., Kale, A. U., et al. (2020). Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nature Medicine, 26, 1364–1374. https://www.nature.com/articles/s41591-020-1034-x
[10] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874
[11] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems
[12] Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1706.03762
[13] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html
[14] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li
[15] Li, N. et al. (2022). Speculative Recovery: Cheap, Highly Available Fault Tolerance with Disaggregated Storage. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/li-nanqinqin
[16] Cao, Z. et al. (2020). Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhichao
[17] Qin, R. et al. (2025). Mooncake: Trading More Storage for Less Computation — A KVCache-centric Architecture for Serving LLM Chatbot. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/qin
[18] Tai, A. et al. (2019). Who's Afraid of Uncorrectable Bit Errors? Online Recovery of Flash Errors with Distributed Redundancy. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/tai
[19] Shen, J. et al. (2023). FUSEE: A Fully Memory-Disaggregated Key-Value Store. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/shen
[20] Pang, G. et al. (2020). Deep Learning for Anomaly Detection: A Review. arXiv:2007.02500. https://arxiv.org/abs/2007.02500
[21] Azam, M. A., Hossain, I., & Islam, M. (2024). Advancing Explainable Artificial Intelligence and Predictive Business Analytics to Strengthen Digital Transformation, Operational Resilience, and Productivity among U.S. Small and Medium-Sized Enterprises. European Journal of Management, Economics and Business, 1(1), 70–94. https://ejmeb.com/index.php/journal/article/view/323
[22] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen
[23] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani
Published
Issue
Section
License
Copyright (c) 2026 Anoop Kallingal

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright in their published work. Unless an individual Version of Record identifies different terms, JMRIS articles are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/. This permits sharing and adaptation, including commercial use, with appropriate attribution, a link to the license, and indication of changes. Third-party material may be subject to separate terms. Existing articles retain the license originally granted to their Version of Record; a policy update does not retrospectively replace that license.