Hierarchical Forecasts of Cloud Storage Demand with Cost-Sensitive Loss: A Reproducibility-Centred Evaluation

Authors

DOI:

https://doi.org/10.66687/sah35020

Keywords:

Machine Learning, Algorithms, Computer Simulation, Reproducibility of Results, Models, Statistical

Abstract

Forecast errors at individual storage pools can accumulate into expensive cloud-capacity decisions. The central research objective is to compare hierarchical demand forecasting strategies under asymmetric penalties for shortages and excess capacity. Previous work provides context for sampling, input validation and study boundaries [3–7]. To answer the question, the study proposes a rolling-origin evaluation of anonymised utilisation traces across storage pools and service classes. Related enterprise-storage studies inform the assessment of operational reliability [1] and the deployment assumptions adopted for system-level comparison [2]. Under matched evaluation conditions, the protocol compares seasonal baselines, independently fitted forecasts and partially pooled hierarchical models. Methodological sources are used to specify transparent comparison and reporting practices [8–12]. The reproducibility extension records dataset versions, model settings, exclusion rules and provenance before any held-out evaluation. Performance will be judged using capacity breach rates, forecast bias, tail-error cost and the amount of unused provisioned capacity. Interpretation will account for workload migrations, discontinuous growth, changes in retention policy and service-level constraints. An independent replication exercise would repeat the main analysis from the documented artefacts and quantify disagreements. The supplementary technical literature is used to identify plausible failure mechanisms [13–17]. No study result is assumed in advance; the analysis is designed to show both when the method helps and when it fails, with reporting context from the remaining sources [18–23].

References

[1] Mohammed Nazir. (2021). Capacity Reclamation and Thin-Provisioning Efficiency in Large-Scale Enterprise Storage Systems. International Journal of Business & Computational Sciences, 1(1), 15–22. https://ijbcs.org/index.php/IJBCS/article/view/2021P4

[2] Mohammed Nazir. (2024). Scenario-Based Disaster Recovery Training for Improving Incident-Response and RTO/RPO Decision-Making Among Enterprise Cloud Engineers. Journal of Computing, Intelligence and Information Sciences, 5(1). https://jciis.com/index.php/jciis/article/view/2024-01-05

[3] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani

[4] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6

[5] Xu, J. et al. (2021). Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. arXiv:2110.02642. https://arxiv.org/abs/2110.02642

[6] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon

[7] Darban, Z.Z. et al. (2022). Deep Learning for Time Series Anomaly Detection: A Survey. arXiv:2211.05244. https://arxiv.org/abs/2211.05244

[8] Pang, G. et al. (2020). Deep Learning for Anomaly Detection: A Review. arXiv:2007.02500. https://arxiv.org/abs/2007.02500

[9] Azam, M. A., Hossain, I., & Islam, M. (2024). Advancing Explainable Artificial Intelligence and Predictive Business Analytics to Strengthen Digital Transformation, Operational Resilience, and Productivity among U.S. Small and Medium-Sized Enterprises. European Journal of Management, Economics and Business, 1(1), 70–94. https://ejmeb.com/index.php/journal/article/view/323

[10] Li, N. et al. (2022). Speculative Recovery: Cheap, Highly Available Fault Tolerance with Disaggregated Storage. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/li-nanqinqin

[11] Chalapathy, R. & Chawla, S. (2019). Deep Learning for Anomaly Detection: A Survey. arXiv:1901.03407. https://arxiv.org/abs/1901.03407

[12] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874

[13] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen

[14] Nachman, A., Yadgar, G. & Sheinvald, S. (2020). GoSeed: Generating an Optimal Seeding Plan for Deduplicated Storage. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/nachman

[15] Alagappan, R. et al. (2019). Protocol-Aware Recovery for Consensus-Based Storage. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/alagappan

[16] Yang, Z. et al. (2023). λ-IO: A Unified IO Stack for Computational Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/yang-zhe

[17] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2

[18] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas

[19] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[20] Esteva, A., Kuprel, B., Novoa, R. A., et al. (2017). Dermatologist-level classification of skin cancer with deep neural networks. Nature, 542, 115–118. https://www.nature.com/articles/nature21056

[21] Cao, Z. et al. (2020). Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhichao

[22] Tai, A. et al. (2019). Who's Afraid of Uncorrectable Bit Errors? Online Recovery of Flash Errors with Distributed Redundancy. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/tai

[23] Johnson, A., Pollard, T., & Mark, R. (2016). MIMIC-III Clinical Database, version 1.4. PhysioNet. https://physionet.org/content/mimiciii/1.4/

Published

2024-03-15

Similar Articles

1-10 of 134

You may also start an advanced similarity search for this article.