Technical White Paper Dell EMC PowerScale: CloudPools and Google Cloud Architectural overview, considerations, and best practices Abstract This white paper provides an overview of Dell EMC™ PowerScale™ CloudPools software in OneFS™ 9.1.0.0. It describes its policy-based capabilities that can reduce storage costs and optimize storage by automatically moving infrequently accessed data to Google Cloud. April 2021 H17993.3 Revisions Revisions Date Description October 2019 Initial release June 2020 Updated best practices October 2020 Updated CloudPools operations April 2021 Updated best practices Acknowledgments Author: Jason He ([email protected]) Dell EMC and the authors of this document welcome your feedback on this white paper. This document may contain certain words that are not consistent with Dell's current language guidelines. Dell plans to update the document over subsequent future releases to revise these words accordingly. This document may contain language from third party content that is not under Dell's control and is not consistent with Dell's current guidelines for Dell's own content. When such third party content is updated by the relevant third parties, this document will be revised accordingly. The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any software described in this publication requires an applicable software license. Copyright © 2019 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners. [4/25/2021] [Technical White Paper] [H17993.3] 2 Dell EMC PowerScale: CloudPools and Google Cloud | H17993.3 Table of contents Table of contents Revisions............................................................................................................................................................................. 2 Acknowledgments ............................................................................................................................................................... 2 Table of contents ................................................................................................................................................................ 3 Executive summary ............................................................................................................................................................. 5 Audience ............................................................................................................................................................................. 5 1 CloudPools solution architectural overview .................................................................................................................. 6 1.1 PowerScale ......................................................................................................................................................... 6 1.1.1 SmartPools ......................................................................................................................................................... 7 1.1.2 SmartLink files .................................................................................................................................................... 7 1.1.3 File pool policies ................................................................................................................................................. 7 1.2 Google Cloud ...................................................................................................................................................... 9 1.2.1 Cloud metadata object ........................................................................................................................................ 9 1.2.2 Cloud data object ................................................................................................................................................ 9 1.3 CloudPools operations ....................................................................................................................................... 9 1.3.1 Archive ................................................................................................................................................................ 9 1.3.2 Recall ................................................................................................................................................................ 11 1.3.3 Read ................................................................................................................................................................. 11 1.3.4 Update .............................................................................................................................................................. 12 2 CloudPools 2.0 ........................................................................................................................................................... 14 2.1 AWS signature v4 authentication support ........................................................................................................ 14 2.2 NDMP and SyncIQ support .............................................................................................................................. 15 2.3 Non-disruptive upgrade support ....................................................................................................................... 15 2.4 Snapshot efficiency .......................................................................................................................................... 15 2.4.1 Scenario 1 ......................................................................................................................................................... 17 2.4.2 Scenario 2 ......................................................................................................................................................... 17 2.4.3 Scenario 3 ......................................................................................................................................................... 18 2.4.4 Scenario 4 ......................................................................................................................................................... 18 2.4.5 Scenario 5 ......................................................................................................................................................... 19 2.5 Sparse files handling ........................................................................................................................................ 20 2.6 Quota management .......................................................................................................................................... 20 2.7 Anti-virus integration ......................................................................................................................................... 21 2.8 WORM integration ............................................................................................................................................ 21 3 Best practices for PowerScale storage and Google Cloud ........................................................................................ 22 3.1 PowerScale configuration ................................................................................................................................. 22 3 Dell EMC PowerScale: CloudPools and Google Cloud | H17993.3 Table of contents 3.1.1 CloudPools settings .......................................................................................................................................... 22 3.1.2 File pool policy .................................................................................................................................................. 23 3.1.3 Other considerations ........................................................................................................................................ 23 3.2 Google Cloud configuration .............................................................................................................................. 25 3.3 Protecting SmartLink files ................................................................................................................................. 25 3.3.1 SyncIQ .............................................................................................................................................................. 25 3.3.2 NDMP ............................................................................................................................................................... 26 3.4 Performance ..................................................................................................................................................... 27 4 Reporting .................................................................................................................................................................... 28 4.1 CloudPools network stats ................................................................................................................................. 28 4.2 Query network stats by CloudPools account ...................................................................................................