Learning-Based Cache Allocation across Shared HPC and AI Workloads: A Cross-Site Validation Agenda

Authors

  • Fernando Neves Federal University of Amazonas (UFAM) Author

DOI:

https://doi.org/10.66687/h461w997

Keywords:

Artificial Intelligence, Cloud Computing, Information Storage and Retrieval, Algorithms, Computer Security

Abstract

Scientific simulations and AI training can compete for the same storage cache even when aggregate throughput appears satisfactory. An evaluation that overlooks these constraints may reach conclusions that cannot be reproduced. This study aims to assess whether learning-based cache admission improves workload fairness without adding excessive overhead. The evaluation would follow a controlled trace-replay benchmark combining training-data reads with parallel simulation checkpoint traffic. The choice of evaluation units and exclusion criteria is informed by the broader methodological record [3–7]. The analysis will contrast static partitions, recency-based eviction and learned admission/prefetching policies. The cross-site extension holds out an entire institution or deployment location rather than relying only on random test splits. Prior work on storage operations provides technical context for validation [1], while complementary systems evidence motivates service-continuity checks [2]. Assessment will focus on job-level tail latency, backend I/O volume, useful cache occupancy and fairness across applications. The supporting evidence base motivates the chosen comparator conditions and robustness criteria [8–12]. Critical sensitivity checks address working-set changes, cold starts, prediction CPU cost and network contention. Further systems and modelling literature supplies context for the proposed sensitivity analyses [13–17]. Between-site heterogeneity would be examined through prespecified subgroup estimates and transparent domain-shift diagnostics. The expected output is a reusable evaluation framework with transparent uncertainty and reporting rules, informed by wider reproducibility literature [18–23].

References

[1] Mohammed Nazir. (2023). FlexGroup and FlexCache Optimization for AWS-Based CAE/HPC File Workloads: A Latency and Throughput Evaluation. International Journal of Business & Computational Sciences, 3(1), 25–31. https://ijbcs.org/index.php/IJBCS/article/view/2023-01-04

[2] Mohammed Nazir. (2021). Capacity Reclamation and Thin-Provisioning Efficiency in Large-Scale Enterprise Storage Systems. International Journal of Business & Computational Sciences, 1(1), 15–22. https://ijbcs.org/index.php/IJBCS/article/view/2021P4

[3] Zhou, W. et al. (2025). 3L-Cache: Low Overhead and Precise Learning-based Eviction Policy for Caches. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/zhou-wenbin

[4] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas

[5] Rodriguez, L.V. et al. (2021). Learning Cache Replacement with CACHEUS. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/rodriguez

[6] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise

[7] Wong, D.L.-K. et al. (2024). Baleen: ML Admission & Prefetching for Flash Caches. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/wong

[8] Jiao, B., Goel, A. & Wang, A.-I.A. (2025). Silhouette: Leveraging Consistency Mechanisms to Detect Bugs in Persistent Memory-Based File Systems. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/jiao

[9] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[10] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu

[11] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon

[12] Qin, R. et al. (2025). Mooncake: Trading More Storage for Less Computation — A KVCache-centric Architecture for Serving LLM Chatbot. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/qin

[13] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems

[14] Khan, M. F. I., Begum, M. H., Rahman, M. A., Limon, G. Q., Azam, M. A., & Masum, A. K. M. (2025). A comprehensive review of advances in transformer, GAN, and attention mechanisms: Their role in multimodal learning and applications across NLP. International Journal of Science and Research Archive, 15(1), 454–459. https://ijsra.net/content/comprehensive-review-advances-transformer-gan-and-attention-mechanisms-their-role

[15] Mahmud, T. et al. (2023). ConfD: Analyzing Configuration Dependencies of File Systems for Fun and Profit. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/mahmud

[16] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li

[17] Chen, W. et al. (2025). IMPRESS: An Importance-Informed Multi-Tier Prefix KV Storage System for Large Language Model Inference. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/chen-weijian-impress

[18] Dai, Y. et al. (2024). Symbiosis: The Art of Application and Kernel Cache Cooperation. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/dai

[19] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao

[20] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen

[21] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani

[22] Cao, Z. et al. (2020). Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhichao

[23] Alagappan, R. et al. (2019). Protocol-Aware Recovery for Consensus-Based Storage. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/alagappan

Published

2025-06-30

Similar Articles

1-10 of 121

You may also start an advanced similarity search for this article.