Conformal Monitoring of Storage-Failure Predictors during Workload Drift
DOI:
https://doi.org/10.66687/dhnfhp77Keywords:
Machine Learning, Algorithms, Computer Simulation, Reproducibility of Results, Models, StatisticalAbstract
Predictive maintenance systems often report confident failure probabilities even after the underlying workload distribution changes. An evaluation that overlooks these constraints may reach conclusions that cannot be reproduced. The research question is whether it is possible to quantify when conformal uncertainty monitoring can warn of deteriorating failure-prediction reliability. Previous work provides context for sampling, input validation and study boundaries [3–7]. The planned analysis uses a chronologically blocked simulation that calibrates uncertainty on historical storage telemetry and tests later hardware cohorts. Prior work on storage operations provides technical context for validation [1], while complementary systems evidence motivates service-continuity checks [2]. Under matched evaluation conditions, the protocol compares fixed-score alarms, probability-calibrated models and rolling conformal warning policies. Methodological sources are used to specify transparent comparison and reporting practices [8–12]. The design prioritises precise operational definitions and a straightforward baseline before introducing more complex alternatives. Performance will be judged using empirical coverage, alert lead time, false-positive workload and stability under distribution shift. Interpretation will account for serial dependence, rare-event labelling, replacement hardware and uncertainty during outages. Primary analyses would be reported by the main deployment or participant subgroup so that averaged results do not conceal systematic failures. The supplementary technical literature is used to identify plausible failure mechanisms [13–17]. No study result is assumed in advance; the analysis is designed to show both when the method helps and when it fails, with reporting context from the remaining sources [18–23].
References
[1] Mohammed Nazir. (2023). FlexGroup and FlexCache Optimization for AWS-Based CAE/HPC File Workloads: A Latency and Throughput Evaluation. International Journal of Business & Computational Sciences, 3(1), 25–31. https://ijbcs.org/index.php/IJBCS/article/view/2023-01-04
[2] Mohammed Nazir. (2021). Capacity Reclamation and Thin-Provisioning Efficiency in Large-Scale Enterprise Storage Systems. International Journal of Business & Computational Sciences, 1(1), 15–22. https://ijbcs.org/index.php/IJBCS/article/view/2021P4
[3] Xu, J. et al. (2021). Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. arXiv:2110.02642. https://arxiv.org/abs/2110.02642
[4] Darban, Z.Z. et al. (2022). Deep Learning for Time Series Anomaly Detection: A Survey. arXiv:2211.05244. https://arxiv.org/abs/2211.05244
[5] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6
[6] Chalapathy, R. & Chawla, S. (2019). Deep Learning for Anomaly Detection: A Survey. arXiv:1901.03407. https://arxiv.org/abs/1901.03407
[7] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874
[8] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani
[9] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon
[10] Nachman, A., Yadgar, G. & Sheinvald, S. (2020). GoSeed: Generating an Optimal Seeding Plan for Deduplicated Storage. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/nachman
[11] Alagappan, R. et al. (2019). Protocol-Aware Recovery for Consensus-Based Storage. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/alagappan
[12] Yang, Z. et al. (2023). λ-IO: A Unified IO Stack for Computational Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/yang-zhe
[13] Lu, R. et al. (2022). NVMe SSD Failures in the Field: the Fail-Stop and the Fail-Slow. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/lu
[14] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2
[15] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas
[16] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html
[17] Pang, G. et al. (2020). Deep Learning for Anomaly Detection: A Review. arXiv:2007.02500. https://arxiv.org/abs/2007.02500
[18] Azam, M. A., Hossain, I., & Islam, M. (2024). Advancing Explainable Artificial Intelligence and Predictive Business Analytics to Strengthen Digital Transformation, Operational Resilience, and Productivity among U.S. Small and Medium-Sized Enterprises. European Journal of Management, Economics and Business, 1(1), 70–94. https://ejmeb.com/index.php/journal/article/view/323
[19] Li, X. et al. (2023). ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/li-xiaolu
[20] Bai, W. et al. (2023). Empowering Azure Storage with RDMA. USENIX NSDI '23. https://www.usenix.org/conference/nsdi23/presentation/bai
[21] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu
[22] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao
[23] Wu, K. et al. (2021). The Storage Hierarchy is Not a Hierarchy: Optimizing Caching on Modern Storage Devices with Orthus. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/wu-kan
Published
Issue
Section
License
Copyright (c) 2026 Samir Arora

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright in their published work. Unless an individual Version of Record identifies different terms, JMRIS articles are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/. This permits sharing and adaptation, including commercial use, with appropriate attribution, a link to the license, and indication of changes. Third-party material may be subject to separate terms. Existing articles retain the license originally granted to their Version of Record; a policy update does not retrospectively replace that license.