Causal Evaluation of Automated Provisioning through Interrupted Time-Series: A Reproducibility-Centred Evaluation
DOI:
https://doi.org/10.66687/8y5jjj28Keywords:
Machine Learning, Algorithms, Computer Simulation, Reproducibility of Results, Models, StatisticalAbstract
Faster provisioning after an automation rollout does not establish that the automation caused the improvement. This gap has consequences for interpreting performance outside carefully curated evaluation settings. This study aims to estimate how workflow automation changes deployment delays and configuration mistakes while accounting for concurrent platform changes. The evaluation would follow a quasi-experimental interrupted time-series design based on dated infrastructure change logs. The choice of evaluation units and exclusion criteria is informed by the broader methodological record [3–7]. The analysis will contrast pre-intervention trends, post-intervention outcomes and contemporaneous negative-control tasks. The reproducibility extension records dataset versions, model settings, exclusion rules and provenance before any held-out evaluation. Prior work on storage operations provides technical context for validation [1], while complementary systems evidence motivates service-continuity checks [2]. Assessment will focus on provisioning time, post-deployment defect rates and uncertainty around estimated change points. The supporting evidence base motivates the chosen comparator conditions and robustness criteria [8–12]. Critical sensitivity checks address seasonality, shifting request complexity, policy revisions and missing maintenance records. Further systems and modelling literature supplies context for the proposed sensitivity analyses [13–17]. An independent replication exercise would repeat the main analysis from the documented artefacts and quantify disagreements. The expected output is a reusable evaluation framework with transparent uncertainty and reporting rules, informed by wider reproducibility literature [18–23].
References
[1] Mohammed Nazir. (2021). RTO and RPO Optimization Using Asynchronous Replication in Multi-Petabyte Enterprise Storage Environments. Journal of Computing, Intelligence and Information Sciences, 2(1). https://jciis.com/index.php/jciis/article/view/2020-01-04
[2] Mohammed Nazir. (2022). SVM-Based Disaster Recovery for Hybrid Enterprise Storage: Effects on Recovery Time and Service Availability. Journal of Computing, Intelligence and Information Sciences, 3(1). https://jciis.com/index.php/jciis/article/view/2022-01-05
[3] Darban, Z.Z. et al. (2022). Deep Learning for Time Series Anomaly Detection: A Survey. arXiv:2211.05244. https://arxiv.org/abs/2211.05244
[4] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6
[5] Xu, J. et al. (2021). Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. arXiv:2110.02642. https://arxiv.org/abs/2110.02642
[6] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html
[7] Pang, G. et al. (2020). Deep Learning for Anomaly Detection: A Review. arXiv:2007.02500. https://arxiv.org/abs/2007.02500
[8] Azam, M. A., Hossain, I., & Islam, M. (2024). Advancing Explainable Artificial Intelligence and Predictive Business Analytics to Strengthen Digital Transformation, Operational Resilience, and Productivity among U.S. Small and Medium-Sized Enterprises. European Journal of Management, Economics and Business, 1(1), 70–94. https://ejmeb.com/index.php/journal/article/view/323
[9] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani
[10] Chalapathy, R. & Chawla, S. (2019). Deep Learning for Anomaly Detection: A Survey. arXiv:1901.03407. https://arxiv.org/abs/1901.03407
[11] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874
[12] Begum, M. H., Talukder, S. I., Ahmed, M. J., Khan, M. F. I., & Azam, M. A. (2025). XAI-Driven Multimodal Deep Learning for Early Sepsis Prediction in ICU. Journal of Science Technology and Social Transformation, 1(1), 30–41. https://jstst.info/j/article/view/25
[13] Azam, M. A., Ansari, I., Haque, G. M. M., & Jahid, A. (2026). Leveraging Health Information Systems and Predictive Analytics to Improve Patient Outcomes: A Data-Driven Approach. The American Journal of Medical Sciences and Pharmaceutical Research, 8(3), 45–70. https://theamericanjournals.com/index.php/tajmspr/article/view/7512
[14] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2
[15] Haque, G. M. M., Ansari, I., Bhujel, K., Jahid, A., & Azam, M. A. (2026). Digital Transformation Strategies and IT Governance: Aligning Business Value with Technology Investments. The American Journal of Management and Economics Innovations, 8(3), 24–48. https://theamericanjournals.com/index.php/tajmei/article/view/7580
[16] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise
[17] Li, X. et al. (2023). ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/li-xiaolu
[18] Burke, Q. et al. (2025). On Scalable Integrity Checking for Secure Cloud Disks. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/burke
[19] Rahman, M. A., Bhuiyan, M. T. A., Azam, M. A., et al. (2026). TransFuse: An Interpretable Transformer Ensemble Framework for Bangla Smishing Detection. Proceedings of the IEEE 2nd International Conference on Quantum Photonics, Artificial Intelligence & Networking. https://ieeexplore.ieee.org/document/11546480/
[20] Bai, W. et al. (2023). Empowering Azure Storage with RDMA. USENIX NSDI '23. https://www.usenix.org/conference/nsdi23/presentation/bai
[21] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu
[22] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao
[23] Wu, K. et al. (2021). The Storage Hierarchy is Not a Hierarchy: Optimizing Caching on Modern Storage Devices with Orthus. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/wu-kan
Published
Issue
Section
License
Copyright (c) 2026 José Angel Alejandro Soto
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright in their published work. Unless an individual Version of Record identifies different terms, JMRIS articles are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/. This permits sharing and adaptation, including commercial use, with appropriate attribution, a link to the license, and indication of changes. Third-party material may be subject to separate terms. Existing articles retain the license originally granted to their Version of Record; a policy update does not retrospectively replace that license.
