Data Mesh versus Central Warehouses for Trustworthy AI Pipelines
DOI:
https://doi.org/10.66687/ksf7ta16Keywords:
Artificial Intelligence, Cloud Computing, Information Storage and Retrieval, Algorithms, Computer SecurityAbstract
Data-mesh and central-warehouse architectures allocate ownership and governance responsibilities in different ways. The difficulty is particularly visible when a system is transferred to a new setting. The central research objective is to compare their implications for provenance, access control and reproducible AI training across enterprise units. Previous work provides context for sampling, input validation and study boundaries [3–7]. To answer the question, the study proposes a design-science comparison using matched data-product scenarios, architecture diagrams and traceability tests. Related enterprise-storage studies inform the assessment of operational reliability [1] and the deployment assumptions adopted for system-level comparison [2]. Under matched evaluation conditions, the protocol compares domain-owned data products, a central warehouse and a hybrid governance model. Methodological sources are used to specify transparent comparison and reporting practices [8–12]. The design prioritises precise operational definitions and a straightforward baseline before introducing more complex alternatives. Performance will be judged using dataset lineage completeness, policy violations, integration effort and model retraining reproducibility. Interpretation will account for conflicting data contracts, institutional access rules, ownership disputes and cross-domain schema changes. Primary analyses would be reported by the main deployment or participant subgroup so that averaged results do not conceal systematic failures. The supplementary technical literature is used to identify plausible failure mechanisms [13–17]. No study result is assumed in advance; the analysis is designed to show both when the method helps and when it fails, with reporting context from the remaining sources [18–23].
References
[1] Mohammed Nazir. (2024). Scenario-Based Disaster Recovery Training for Improving Incident-Response and RTO/RPO Decision-Making Among Enterprise Cloud Engineers. Journal of Computing, Intelligence and Information Sciences, 5(1). https://jciis.com/index.php/jciis/article/view/2024-01-05
[2] Mohammed Nazir. (2022). SVM-Based Disaster Recovery for Hybrid Enterprise Storage: Effects on Recovery Time and Service Availability. Journal of Computing, Intelligence and Information Sciences, 3(1). https://jciis.com/index.php/jciis/article/view/2022-01-05
[3] Maneas, S. et al. (2022). Operational Characteristics of SSDs in Enterprise Storage Systems: A Large-Scale Field Study. USENIX FAST '22. https://www.usenix.org/conference/fast22/presentation/maneas
[4] Vrable, M., Savage, S. & Voelker, G.M. (2012). BlueSky: A Cloud-Backed File System for the Enterprise. USENIX FAST '12. https://www.usenix.org/conference/fast12/bluesky-cloud-backed-file-system-enterprise
[5] Cidon, A. et al. (2013). Copysets: Reducing the Frequency of Data Loss in Cloud Storage. USENIX ATC '13. https://www.usenix.org/conference/atc13/technical-sessions/presentation/cidon
[6] Patel, T. et al. (2020). Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/patel-hpc-systems
[7] Mahmud, T. et al. (2023). ConfD: Analyzing Configuration Dependencies of File Systems for Fun and Profit. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/mahmud
[8] Wong, D.L.-K. et al. (2024). Baleen: ML Admission & Prefetching for Flash Caches. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/wong
[9] Zhou, W. et al. (2025). 3L-Cache: Low Overhead and Precise Learning-based Eviction Policy for Caches. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/zhou-wenbin
[10] Li, T. et al. (2024). MinFlow: High-performance and Cost-efficient Data Passing for I/O-intensive Stateful Serverless Analytics. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/li
[11] Jiao, B., Goel, A. & Wang, A.-I.A. (2025). Silhouette: Leveraging Consistency Mechanisms to Detect Bugs in Persistent Memory-Based File Systems. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/jiao
[12] Chen, W. et al. (2025). IMPRESS: An Importance-Informed Multi-Tier Prefix KV Storage System for Large Language Model Inference. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/chen-weijian-impress
[13] Guo, C. et al. (2017). On Calibration of Modern Neural Networks. Proceedings of Machine Learning Research, 70, 1321–1330. https://proceedings.mlr.press/v70/guo17a.html
[14] Mihailescu, M., Soundararajan, G. & Amza, C. (2013). MixApart: Decoupled Analytics for Shared Storage Systems. USENIX FAST '13. https://www.usenix.org/conference/fast13/technical-sessions/presentation/mihailescu
[15] Jiao, Z. et al. (2024). The Design and Implementation of a Capacity-Variant Storage System. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/jiao
[16] Qin, R. et al. (2025). Mooncake: Trading More Storage for Less Computation — A KVCache-centric Architecture for Serving LLM Chatbot. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/qin
[17] Cao, Z., Kuenning, G. & Zadok, E. (2020). Carver: Finding Important Parameters for Storage System Tuning. USENIX FAST '20. https://www.usenix.org/conference/fast20/presentation/cao-zhen
[18] Mahdisoltani, F., Stefanovici, I. & Schroeder, B. (2017). Proactive Error Prediction to Improve Storage System Reliability. USENIX ATC '17. https://www.usenix.org/conference/atc17/technical-sessions/presentation/mahdisoltani
[19] Rodriguez, L.V. et al. (2021). Learning Cache Replacement with CACHEUS. USENIX FAST '21. https://www.usenix.org/conference/fast21/presentation/rodriguez
[20] Dai, Y. et al. (2024). Symbiosis: The Art of Application and Kernel Cache Cooperation. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/dai
[21] Yang, Z. et al. (2024). TeRM: Extending RDMA-Attached Memory with SSD. USENIX FAST '24. https://www.usenix.org/conference/fast24/presentation/yang-zhe
[22] Li, X. et al. (2023). ParaRC: Embracing Sub-Packetization for Repair Parallelization in MSR-Coded Storage. USENIX FAST '23. https://www.usenix.org/conference/fast23/presentation/li-xiaolu
[23] Burke, Q. et al. (2025). On Scalable Integrity Checking for Secure Cloud Disks. USENIX FAST '25. https://www.usenix.org/conference/fast25/presentation/burke
Published
Issue
Section
License
Copyright (c) 2026 Atacílio Cunha

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors retain copyright in their published work. Unless an individual Version of Record identifies different terms, JMRIS articles are distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0): https://creativecommons.org/licenses/by/4.0/. This permits sharing and adaptation, including commercial use, with appropriate attribution, a link to the license, and indication of changes. Third-party material may be subject to separate terms. Existing articles retain the license originally granted to their Version of Record; a policy update does not retrospectively replace that license.