Learning-Based Cache Allocation across Shared HPC and AI Workloads

Authors

  • Ludimila Gonçalves Federal University of Amazonas (UFAM) Author

DOI:

https://doi.org/10.66687/dnzq9a53

Keywords:

Artificial Intelligence, Cloud Computing, Information Storage and Retrieval, Algorithms, Computer Security

Abstract

Scientific simulations and AI training can compete for the same storage cache even when aggregate throughput appears satisfactory. This gap has consequences for interpreting performance outside carefully curated evaluation settings. This study aims to assess whether learning-based cache admission improves workload fairness without adding excessive overhead. The evaluation would follow a controlled trace-replay benchmark combining training-data reads with parallel simulation checkpoint traffic. The choice of evaluation units and exclusion criteria is informed by the broader methodological record [3–7]. The analysis will contrast static partitions, recency-based eviction and learned admission/prefetching policies. The design prioritises precise operational definitions and a straightforward baseline before introducing more complex alternatives. Prior work on storage operations provides technical context for validation [1], while complementary systems evidence motivates service-continuity checks [2]. Assessment will focus on job-level tail latency, backend I/O volume, useful cache occupancy and fairness across applications. The supporting evidence base motivates the chosen comparator conditions and robustness criteria [8–12]. Critical sensitivity checks address working-set changes, cold starts, prediction CPU cost and network contention. Further systems and modelling literature supplies context for the proposed sensitivity analyses [13–17]. Primary analyses would be reported by the main deployment or participant subgroup so that averaged results do not conceal systematic failures. The expected output is a reusable evaluation framework with transparent uncertainty and reporting rules, informed by wider reproducibility literature [18–23].

References

[1] Mohammed Nazir. (2023). FlexGroup and FlexCache Optimization for AWS-Based CAE/HPC File Workloads: A Latency and Throughput Evaluation. International Journal of Business & Computational Sciences, 3(1), 25–31. https://ijbcs.org/index.php/IJBCS/article/view/2023-01-04

[2] Mohammed Nazir. (2023). Performance-Telemetry-Based Anomaly Detection for Early Failure Identification in Enterprise Storage Systems. Journal of Multidisciplinary Research and Integrated Sciences, 3(1), 59–70. https://jmris.com/index.php/jmris/article/view/2023V1P6

[3] Zhou, W. et al. (2025). 3L-Cache: Low Overhead and Precise Learning-based Eviction Policy for Caches. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/zhou-wenbin

[4] Rodriguez, L.V. et al. (2021). Learning Cache Replacement with CACHEUS. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/rodriguez

[5] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon

[6] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems

[7] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas

[8] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise

[9] Wong, D.L.-K. et al. (2024). Baleen: ML Admission & Prefetching for Flash Caches. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/wong

[10] Jiao, B., Goel, A. & Wang, A.-I.A. (2025). Silhouette: Leveraging Consistency Mechanisms to Detect Bugs in Persistent Memory-Based File Systems. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/jiao

[11] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[12] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu

[13] Qin, R. et al. (2025). Mooncake: Trading More Storage for Less Computation — A KVCache-centric Architecture for Serving LLM Chatbot. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/qin

[14] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen

[15] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani

[16] Alagappan, R. et al. (2019). Protocol-Aware Recovery for Consensus-Based Storage. USENIX ATC '19. https://www.usenix.org/conference/atc19/presentation/alagappan

[17] Mahmud, T. et al. (2023). ConfD: Analyzing Configuration Dependencies of File Systems for Fun and Profit. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/mahmud

[18] Abdi, M. et al. (2021). A Community Cache with Complete Information. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/abdi

[19] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li

[20] Chen, W. et al. (2025). IMPRESS: An Importance-Informed Multi-Tier Prefix KV Storage System for Large Language Model Inference. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/chen-weijian-impress

[21] Dai, Y. et al. (2024). Symbiosis: The Art of Application and Kernel Cache Cooperation. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/dai

[22] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao

[23] Cao, Z. et al. (2020). Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhichao

Published

2025-06-30

Similar Articles

1-10 of 121

You may also start an advanced similarity search for this article.