Hierarchical Forecasts of Cloud Storage Demand with Cost-Sensitive Loss: A Cross-Site Validation Agenda

Authors

DOI:

https://doi.org/10.66687/j5wk0781

Keywords:

Machine Learning, Algorithms, Computer Simulation, Reproducibility of Results, Models, Statistical

Abstract

Forecast errors at individual storage pools can accumulate into expensive cloud-capacity decisions. To address this, the study will compare hierarchical demand forecasting strategies under asymmetric penalties for shortages and excess capacity. The research design centres on a rolling-origin evaluation of anonymised utilisation traces across storage pools and service classes. The choice of evaluation units and exclusion criteria is informed by the broader methodological record [3–7]. The analysis will contrast seasonal baselines, independently fitted forecasts and partially pooled hierarchical models. The cross-site extension holds out an entire institution or deployment location rather than relying only on random test splits. Related enterprise-storage studies inform the assessment of operational reliability [1] and the deployment assumptions adopted for system-level comparison [2]. Assessment will focus on capacity breach rates, forecast bias, tail-error cost and the amount of unused provisioned capacity. The supporting evidence base motivates the chosen comparator conditions and robustness criteria [8–12]. Critical sensitivity checks address workload migrations, discontinuous growth, changes in retention policy and service-level constraints. Further systems and modelling literature supplies context for the proposed sensitivity analyses [13–17]. Between-site heterogeneity would be examined through prespecified subgroup estimates and transparent domain-shift diagnostics. The expected output is a reusable evaluation framework with transparent uncertainty and reporting rules, informed by wider reproducibility literature [18–23].

References

[1] Mohammed Nazir. (2021). Automating Enterprise Storage Provisioning with PowerShell and Python: Effects on Deployment Time and Configuration Errors. Journal of Multidisciplinary Research and Integrated Sciences, 1(1), 43–55. https://jmris.com/index.php/jmris/article/view/2021P1V6

[2] Mohammed Nazir. (2024). Scenario-Based Disaster Recovery Training for Improving Incident-Response and RTO/RPO Decision-Making Among Enterprise Cloud Engineers. Journal of Computing, Intelligence and Information Sciences, 5(1). https://jciis.com/index.php/jciis/article/view/2024-01-05

[3] Xu, J. et al. (2021). Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy. arXiv:2110.02642. https://arxiv.org/abs/2110.02642

[4] Darban, Z.Z. et al. (2022). Deep Learning for Time Series Anomaly Detection: A Survey. arXiv:2211.05244. https://arxiv.org/abs/2211.05244

[5] McKinney, S. M., Sieniek, M., Godbole, V., et al. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577, 89–94. https://www.nature.com/articles/s41586-019-1799-6

[6] Chalapathy, R. & Chawla, S. (2019). Deep Learning for Anomaly Detection: A Survey. arXiv:1901.03407. https://arxiv.org/abs/1901.03407

[7] Lundberg, S. M., & Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Advances in Neural Information Processing Systems, 30. https://arxiv.org/abs/1705.07874

[8] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani

[9] Alagappan, R. et al. (2019). Protocol-Aware Recovery for Consensus-Based Storage. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/alagappan

[10] Yang, Z. et al. (2023). λ-IO: A Unified IO Stack for Computational Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/yang-zhe

[11] Jumper, J., Evans, R., Pritzel, A., et al. (2021). Highly accurate protein structure prediction with AlphaFold. Nature, 596, 583–589. https://www.nature.com/articles/s41586-021-03819-2

[12] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon

[13] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas

[14] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[15] Pang, G. et al. (2020). Deep Learning for Anomaly Detection: A Review. arXiv:2007.02500. https://arxiv.org/abs/2007.02500

[16] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise

[17] Li, X. et al. (2023). ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/li-xiaolu

[18] Azam, M. A., Hossain, I., & Islam, M. (2024). Advancing Explainable Artificial Intelligence and Predictive Business Analytics to Strengthen Digital Transformation, Operational Resilience, and Productivity among U.S. Small and Medium-Sized Enterprises. European Journal of Management, Economics and Business, 1(1), 70–94. https://ejmeb.com/index.php/journal/article/view/323

[19] Bai, W. et al. (2023). Empowering Azure Storage with RDMA. USENIX NSDI '23. https://www.usenix.org/conference/nsdi23/presentation/bai

[20] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu

[21] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao

[22] Wu, K. et al. (2021). The Storage Hierarchy is Not a Hierarchy: Optimizing Caching on Modern Storage Devices with Orthus. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/wu-kan

[23] Li, N. et al. (2022). Speculative Recovery: Cheap, Highly Available Fault Tolerance with Disaggregated Storage. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/li-nanqinqin

Published

2024-03-15

Similar Articles

1-10 of 134

You may also start an advanced similarity search for this article.