Automated SnapMirror Migration from On-Premises Storage to Cloud Volumes ONTAP: A Replication Performance Study

Authors

  • Mohammed Nazir Honda North America, Raymond, OH Author

Keywords:

asynchronous replication, cloud migration, Cloud Volumes ONTAP, SnapMirror

Abstract

Background: Hybrid-cloud migration requires movement of large, actively changing datasets without extending application outage windows. SnapMirror provides snapshot-based asynchronous replication between ONTAP systems and can be used to seed Cloud Volumes ONTAP from on-premises storage, while Cloud Manager and REST interfaces permit the workflow to be automated.

Objective: To evaluate the performance determinants of automated SnapMirror migration and to develop a reproducible framework linking baseline transfer time, incremental convergence, cutover duration, and automation quality.

Methods: A structured technical review synthesized peer-reviewed evidence on asynchronous mirroring, wide-area replication, deduplication, cloud backup, and persistent-state migration together with product-specific technical publications on SnapMirror and Cloud Volumes ONTAP. A phase-based analytical model was used to separate baseline transfer, delta catch-up, and cutover components.

Results: Across the evidence, transfer completion is governed principally by effective end-to-end throughput and changed-data rate rather than nominal link speed. Snapshot- and block-aware replication reduces avoidable retransmission, while delta compression and deduplication can further improve WAN efficiency. Automation improves migration performance primarily by reducing orchestration latency and variance: pre-validation, relationship creation, health polling, retry control, convergence checks, final-update sequencing, and destination activation can be executed consistently without repeated manual intervention. The model shows that baseline time declines approximately inversely with effective throughput, whereas successful cutover requires the sustained replication rate to remain greater than the source change rate.

Conclusion: Automated SnapMirror migration is most effective when treated as a closed-loop control problem rather than a one-time copy task. Reliable migration depends on measuring effective throughput, maintaining convergence headroom, controlling competing workloads, and using automated gates for cutover and rollback. Automation therefore complements, but does not replace, sound replication-capacity engineering.

References

Patterson RH, Manley S, Federwisch M, Hitz D, Kleiman S, Owara S. SnapMirror: file-system-based asynchronous mirroring for disaster recovery. In: Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST 02). Berkeley: USENIX Association; 2002. p. 117-129.

Adams K. Geographically distributed system for catastrophic recovery. In: Proceedings of the 16th Systems Administration Conference (LISA 02). Berkeley: USENIX Association; 2002. p. 47-64.

Kim M, Cox LP, Noble BD. Safety, visibility, and performance in a wide-area file system. In: Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST 02). Berkeley: USENIX Association; 2002.

Chang F, Ji M, Leung STA, MacCormick J, Perl SE, Zhang L. Myriad: cost-effective disaster tolerance. In: Proceedings of the 1st USENIX Conference on File and Storage Technologies (FAST 02). Berkeley: USENIX Association; 2002. p. 103-116.

Chun BG, Dabek F, Haeberlen A, Sit E, Weatherspoon H, Kaashoek MF, et al. Efficient replica maintenance for distributed storage systems. In: Proceedings of the 3rd USENIX Symposium on Networked Systems Design and Implementation (NSDI 06). Berkeley: USENIX Association; 2006.

Bradford R, Kotsovinos E, Feldmann A, Schioberg H. Live wide-area migration of virtual machines including local persistent state. In: Proceedings of the 3rd International Conference on Virtual Execution Environments. New York: ACM; 2007. p. 169-179. doi:10.1145/1254810.1254834.

Cully B, Lefebvre G, Meyer D, Feeley M, Hutchinson N, Warfield A. Remus: high availability via asynchronous virtual machine replication. In: Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI 08). Berkeley: USENIX Association; 2008. p. 161-174.

Weatherspoon H, Ganesh L, Marian T, Balakrishnan M, Birman K. Smoke and Mirrors: reflecting files at a geographically remote location without loss of performance. In: Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST 09). Berkeley: USENIX Association; 2009. p. 211-224.

Vrable M, Savage S, Voelker GM. Cumulus: filesystem backup to the cloud. In: Proceedings of the 7th USENIX Conference on File and Storage Technologies (FAST 09). Berkeley: USENIX Association; 2009. p. 225-238.

Meyer DT, Bolosky WJ. A study of practical deduplication. In: Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST 11). Berkeley: USENIX Association; 2011.

Min J, Yoon D, Won Y. Efficient deduplication techniques for modern backup operation. IEEE Trans Comput. 2011;60(6):824-840. doi:10.1109/TC.2010.263.

Tan Y, Jiang H, Feng D, Tian L, Yan Z. CABdedupe: a causality-based deduplication performance booster for cloud backup services. In: 2011 IEEE International Parallel and Distributed Processing Symposium. IEEE; 2011. p. 1266-1277. doi:10.1109/IPDPS.2011.76.

Shilane P, Huang M, Wallace G, Hsu W. WAN optimized replication of backup datasets using stream-informed delta compression. In: Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST 12). Berkeley: USENIX Association; 2012.

Kovacs G. Data replication using Cloud Volumes ONTAP and SnapMirror. NetApp; 2017 May 14.

Degani A. Cross-region replication: how to do it with Cloud Volumes ONTAP. NetApp; 2019 Apr 23.

NetApp. Build your Data Fabric with NetApp HCI and converged infrastructure. Technical Report TR-4748. Sunnyvale: NetApp; 2019.

P1 Technologies. Data protection with Cloud Volumes ONTAP: Part VI - replication. 2020 Jul 10.

Degani A. Automating cloud operations with Cloud Volumes ONTAP and REST. NetApp; 2019 Jan 10.

Downloads

Published

2022-03-15

Similar Articles

You may also start an advanced similarity search for this article.