Data Mesh versus Central Warehouses for Trustworthy AI Pipelines: A Cross-Site Validation Agenda

Authors

  • Solano Oliveira Federal University of Amazonas (UFAM) Author

DOI:

https://doi.org/10.66687/6mcz0056

Keywords:

Artificial Intelligence, Cloud Computing, Information Storage and Retrieval, Algorithms, Computer Security

Abstract

Data-mesh and central-warehouse architectures allocate ownership and governance responsibilities in different ways. The central research objective is to compare their implications for provenance, access control and reproducible AI training across enterprise units. Previous work provides context for sampling, input validation and study boundaries [3–7]. To answer the question, the study proposes a design-science comparison using matched data-product scenarios, architecture diagrams and traceability tests. Related enterprise-storage studies inform the assessment of operational reliability [1] and the deployment assumptions adopted for system-level comparison [2]. Under matched evaluation conditions, the protocol compares domain-owned data products, a central warehouse and a hybrid governance model. Methodological sources are used to specify transparent comparison and reporting practices [8–12]. The cross-site extension holds out an entire institution or deployment location rather than relying only on random test splits. Performance will be judged using dataset lineage completeness, policy violations, integration effort and model retraining reproducibility. Interpretation will account for conflicting data contracts, institutional access rules, ownership disputes and cross-domain schema changes. Between-site heterogeneity would be examined through prespecified subgroup estimates and transparent domain-shift diagnostics. The supplementary technical literature is used to identify plausible failure mechanisms [13–17]. No study result is assumed in advance; the analysis is designed to show both when the method helps and when it fails, with reporting context from the remaining sources [18–23].

References

[1] Mohammed Nazir. (2024). Scenario-Based Disaster Recovery Training for Improving Incident-Response and RTO/RPO Decision-Making Among Enterprise Cloud Engineers. Journal of Computing, Intelligence and Information Sciences, 5(1). https://jciis.com/index.php/jciis/article/view/2024-01-05

[2] Mohammed Nazir. (2022). Performance Comparison of AWS EBS, EFS and S3 for Enterprise Cloud-Storage Workloads. International Journal of Business & Computational Sciences, 2(1), 26–33. https://ijbcs.org/index.php/IJBCS/article/view/2022-01-05

[3] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon

[4] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems

[5] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas

[6] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise

[7] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu

[8] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao

[9] Qin, R. et al. (2025). Mooncake: Trading More Storage for Less Computation — A KVCache-centric Architecture for Serving LLM Chatbot. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/qin

[10] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen

[11] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani

[12] Rodriguez, L.V. et al. (2021). Learning Cache Replacement with CACHEUS. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/rodriguez

[13] Mahmud, T. et al. (2023). ConfD: Analyzing Configuration Dependencies of File Systems for Fun and Profit. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/mahmud

[14] Wong, D.L.-K. et al. (2024). Baleen: ML Admission & Prefetching for Flash Caches. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/wong

[15] Zhou, W. et al. (2025). 3L-Cache: Low Overhead and Precise Learning-based Eviction Policy for Caches. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/zhou-wenbin

[16] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li

[17] Jiao, B., Goel, A. & Wang, A.-I.A. (2025). Silhouette: Leveraging Consistency Mechanisms to Detect Bugs in Persistent Memory-Based File Systems. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/jiao

[18] Chen, W. et al. (2025). IMPRESS: An Importance-Informed Multi-Tier Prefix KV Storage System for Large Language Model Inference. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/chen-weijian-impress

[19] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html

[20] Bai, W. et al. (2023). Empowering Azure Storage with RDMA. USENIX NSDI '23. https://www.usenix.org/conference/nsdi23/presentation/bai

[21] Wu, K. et al. (2021). The Storage Hierarchy is Not a Hierarchy: Optimizing Caching on Modern Storage Devices with Orthus. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/wu-kan

[22] Li, N. et al. (2022). Speculative Recovery: Cheap, Highly Available Fault Tolerance with Disaggregated Storage. USENIX ATC '22. https://www.usenix.org/conference/atc22/presentation/li-nanqinqin

[23] Cao, Z. et al. (2020). Characterizing, Modeling, and Benchmarking RocksDB Key-Value Workloads at Facebook. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhichao

Published

2025-06-30

Similar Articles

1-10 of 121

You may also start an advanced similarity search for this article.