VMware vRealize Operations Management Pack for Google Cloud Platform

Management Packs for vRealize Operations Manager 1.1 VMware vRealize Operations Management Pack for Google Cloud Platform

You can find the most up-to-date technical documentation on the VMware website at: https://docs.vmware.com/

VMware, Inc. 3401 Hillview Ave. Palo Alto, CA 94304 www.vmware.com

© Copyright 2020 VMware, Inc. All rights reserved. Copyright and trademark information.

VMware, Inc. 2 Contents

1 VMware vRealize Operations Management Pack for Google Cloud Platform 4

2 Introduction to VMware vRealize Operations Management Pack for Google Cloud Platform 5 Supported GCP Services 5

3 Installing VMware vRealize Operations Management Pack for Google Cloud Platform 6

4 Configuring VMware vRealize Operations Management Pack for Google Cloud Platform 7 Creating a Service Account 10

5 Alerts in VMware vRealize Operations Management Pack for Google Cloud Platform 12

6 Metrics in VMware vRealize Operations Management Pack for Google Cloud Platform 13

7 Dashboards in VMware vRealize Operations Management Pack for Google Cloud Platform 20

VMware, Inc. 3 VMware vRealize Operations Management Pack for Google Cloud Platform 1

The vRealize Operations Management Pack for Google Cloud Platform guide describes how to install and configure the Management Pack for Google Cloud Platform. It also explains how this Management Pack works and how to configure its adapters. It covers the objects that it discovers and also the alerts that it raises. Furthermore, it provides guidance on the dashboards that are deployed with this Management Pack.

Intended Audience

The information in this guide is intended for anyone who wants to install and configure the Management Pack for Google Cloud Platform.

VMware, Inc. 4 Introduction to VMware vRealize Operations Management Pack for Google Cloud Platform 2

The vRealize Operations Management Pack for Google Cloud Platform allows you to dive into the key performance indicators for your Google Cloud Platform environment. Each adapter instance of this Management Pack has diagnostic dashboards and collects metrics and properties from Google Cloud.

This Management Pack supports the following Google Cloud Platform products: n Compute Engine n Container Engine n Cloud Storage n Cloud VPN n Big Query

This chapter includes the following topics: n Supported GCP Services

Supported GCP Services

The Management Pack for Google Cloud Platform supports the following services.

Table 2-1.

Service Abbreviation

Google Compute Engine CE

Cloud Storage STG

Google Container/Kubernetes Engine KE

Cloud BigQuery BQ

Cloud VPN VPN

VMware, Inc. 5 Installing VMware vRealize Operations Management Pack for Google Cloud Platform 3

The VMware vRealize Operations Management Pack for Google Cloud Platform consists of a PAK file that contains default dashboards for the objects that the solution identifies.

Prerequisites n Download the PAK file for VMware vRealize Operations Management Pack for Google Cloud Platform from VMware Marketplace, and save that PAK file to a temporary folder on your local system.

Procedure

1 Log in to the vRealize Operations Manager user interface with administrator privileges.

2 In the menu, select Administration and in the left pane select Solutions > Repository.

3 On the Repository tab, click Add/Upgrade.

4 Browse to locate the temporary folder and select the PAK file.

5 Click Upload. The upload might take several minutes.

6 Read and accept the EULA, and click Next. Installation details appear in the window during the process.

7 When the installation is completed, click Finish.

What to do next

Configure an adapter instance for the management pack.

VMware, Inc. 6 Configuring VMware vRealize Operations Management Pack for Google Cloud Platform 4

After the installation, configure an instance for this management pack.

Prerequisites n Install the Management Pack for Google Cloud Platform. n Obtain the service account JSON file. See Creating a Service Account. n Determine the services for which you collect metrics. See Supported GCP Services, n Determine the regions to which you subscribe. The default value * includes all regions in your subscription. If you do not want to subscribe to all regions, you can specify region identifiers in the Regions field.

Table 4-1.

Region-Friendly Name Region Identifier

Asia Pacific (Taiwan) asia-east1

Asia Pacific (Hong Kong) asia-east2

Asia Pacific (Tokyo) asia-northeast1

Asia Pacific (Osaka) asia-northeast2

Asia Pacific (Seoul) asia-northeast3

Asia Pacific (Mumbai) asia-south1

Asia Pacific (Singapore) asia-southeast1

Asia Pacific (Sydney) australia-southeast1

EU (Finland) europe-north1

EU (Belgium) europe-west1

EU (London) europe-west2

EU (Frankfurt) europe-west3

EU (Netherlands) europe-west4

EU (Zürich) europe-west6

South America(Canada) northamerica-northeast1

South America (Osasco) southamerica-east1

VMware, Inc. 7 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 4-1. (continued)

Region-Friendly Name Region Identifier

Iowa (Central) us-central1

US East (South Carolina) us-east1

US East (Northern Virginia) us-east4

US West (Oregon) us-west1

US West (Los Angeles) us-west2

US West (Salt Lake City) us-west3

ASIA (Multi-regions) asia

EU (Multi-regions) eu

US (Multi-regions) us n Determine any denylist or allowlist filters. These filters use regular expressions to filter in or out specific objects by name. For example, a allow list filter of .*indows.* allows only objects with a name including "indows". A denylist filter of .*indows.* filters out all objects with that string in their name.

Procedure

1 On the menu, click Administration.

2 In the left pane, expand Solutions and click Other Accounts.

3 Under Other Accounts, click the ADD ACCOUNT icon.

4 Configure the adapter instance.

Option Description

Display Name The name for the adapter instance.

Description (Optional) The description of the adapter instance.

Project Id Enter the Google Cloud Platform service account project Id.

VMware, Inc. 8 VMware vRealize Operations Management Pack for Google Cloud Platform

Option Description

Credential Select the credential you want to use to sign on to the environment from the drop-down menu. To add new credentials to access this management pack environment, click the plus sign. n Credential Name. Enter an instance name for the credential values you are creating. This is not the name of the adapter instance, but a friendly name for the Service account JSON file credential. n Service Account JSON. Provide the service account private key downloaded as a JSON file. n Provide the HTTP proxy details in the following text boxes. n Proxy Host Name n Proxy Port n Proxy Username n Proxy Password

Collector / Group Select the collector upon which you want to run the adapter instance. A collector gathers objects into its inventory for monitoring. The collector specified by default has been selected for optimal data collecting.

5 Click the arrow to the left of the Advanced Settings to configure advanced settings.

Option Action

Services Selected the required services from which the data has to be collected. If the Services drop-down is left blank, the data is collected from all the services.

Regions Selected the required regions from which the data has to be collected. If the Regions drop-down is left blank, the data is collected from all the regions.

Support Auto Discovery Set this option to true for automatic discovery of the Google Cloud Platform services. If you set this value to false, when you create an adapter instance you must perform manual discovery of services.

Allowed List Regex Add regular expressions to allow only objects with names that fit the criteria you specify.

Denied List Regex Add regular expressions to filter out objects by name.

6 To initiate the authentication request, click Validate Connection.

7 Click Save.

The adapter instance is added to the list.

What to do next

Verify that the adapter is configured and collecting data by viewing application-related data.

VMware, Inc. 9 VMware vRealize Operations Management Pack for Google Cloud Platform

Where to View the Information Information to View

Collection Status and Collection State columns in the MP The strings Collecting or Data receiving appear for GCP Solution Details pane on the Solutions tab approximately 10 minutes after you have configured the adapter.

Environment Overview The objects related to Google Cloud Platform are added to the inventory trees.

Dashboards The Management Pack for Google Cloud Platform dashboards are added to vRealize Operations Manager.

Creating a Service Account

To configure the Management Pack for Google Cloud Platform, you must create a service account in Google Cloud Platform and download the private key as a JSON file. To create the service account, you must have the Service Account Admin role (roles/ iam.serviceAccountAdmin) or the Editor primitive role (roles/editor). For read-only access, the service account requires the project level viewer role (Viewer - primitive role on GCP).

To monitor the Google Cloud Platform account using this Management Pack, enable the following APIs: n BigQuery API n Compute Engine API n Cloud Storage and Google Cloud Storage JSON API n Kubernetes Engine API n Stackdriver Monitoring API (The Stackdriver monitoring API (monitoring.googleapis.com) is required to monitor time-series metric data).

To enable these APIs:

1 In the Cloud Console, navigate to APIs & Services for your project.

2 In the Library page, search for the above APIs.

3 Select the Service API you want to enable.

4 Click Enable.

When the APIs are enabled and the service account has the correct set of roles and associated permissions, this Management Pack can retrieve Google Cloud Platform data. When creating a service account, you must select a Google Cloud Platform project as Google Cloud Platform does not allow the service account to belong directly under the Google Cloud Platform Organization.

Procedure

1 In the Cloud Console, navigate to IAM & Admin > Service Accounts Management > Create Service Account Key

2 From the Service account list, select New service ccount.

VMware, Inc. 10 VMware vRealize Operations Management Pack for Google Cloud Platform

3 In the Service account name text box, enter a name.

4 From the Role list, The Role field authorizes the service account to access resources. Select Project > Owner or select the required services in read-only (as a viewer).

5 Click Save.

6 Download the service account private key as a JSON file.

VMware, Inc. 11 Alerts in VMware vRealize Operations Management Pack for Google Cloud Platform 5

The following alerts are triggered when any of the monitoring resources in Google Cloud Platform display an unexpected behavior.

Table 5-1. Alerts in the Management Pack for Google Cloud Platform

Alert Description

GCP CE Instance CPU Utilization is very high Triggered with the Google Cloud Platform CE Instance CPU Utilization is very high.

GCP CE Instance is not running Triggered with the Google Cloud Platform CE Instance is not running.

GCP K8s Container CPU usage time is very high Triggered with the Google Cloud Platform K8s Container CPU usage time is very high.

GCP K8s Container restart count is high Triggered with the Google Cloud Platform K8s Container restart count is high.

GCP K8s Node CPU Utilization is very high Triggered with the Google Cloud Platform K8s Node CPU Utilization is very high

GCP K8s Node state is not running Triggered with the Google Cloud Platform K8s Node state is not running.

VMware, Inc. 12 Metrics in VMware vRealize Operations Management Pack for Google Cloud Platform 6

The VMware vRealize Operations Management Pack for Google Cloud Platform collects metrics for objects.

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics

Object Type Metric Key

GCP World summary | Total CE Instances summary | Active CE Instances summary | Number of Storage Buckets summary | Number of K8s Engines summary | Number of BigQuery Datasets summary | Number of VPN Gateways

GoogleCloudPlatformAdapterInstance summary | Total CE Instances summary | Active CE Instances summary | Number of Storage Buckets summary | Number of K8s Engines summary | Number of BigQuery Datasets summary | Number of VPN Gateways

VMware, Inc. 13 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

CE Instance CPU | utilization CPU | usage_time CPU | reserved_cores CPU | scheduler_wait_time CPU | vCPUs CPU | IsSharedCpu Status Disk | read_bytes_count Disk | read_ops_count Disk | throttled_read_bytes_count Disk | throttled_read_ops_count Disk | throttled_write_bytes_count Disk | throttled_write_ops_count Disk | write_bytes_count Disk | write_ops_count Disk | Disk I/O Average (Count) Disk | Disk I/O Average (Bytes) Memory | Total Memory | maximumPersistentDisksSizeGb balloon | ram_size balloon | ram_used balloon | swap_in_bytes_count balloon | swap_out_bytes_count firewall | dropped_bytes_count firewall | dropped_packets_count instance_group | size network | received_bytes_count network | received_packets_count network | sent_bytes_count network | sent_packets_count network | Network I/O Average (Bytes) network | Network I/O Average (Packets) integrity | early_boot_validation_status integrity | late_boot_validation_status uptime mirroring | dropped_packets_count mirroring | mirrored_packets_count mirroring | mirrored_bytes_count

VMware, Inc. 14 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

Storage Bucket Summary | request_count Average Summary | request_count Maximum Summary | request_count Minimum Summary | request_count Sum Summary | object_count Average Summary | object_count Maximum Summary | object_count Minimum Summary | total_byte_seconds Average Summary | total_byte_seconds Maximum Summary | total_byte_seconds Minimum Summary | total_bytes Average Summary | total_bytes Maximum Summary | total_bytes Minimum authz | authentication_count Average authz | authentication_count Maximum authz | authentication_count Minimum authz | acl_based_object_access_count Average authz | acl_based_object_access_count Maximum authz | acl_based_object_access_count Minimum authz | acl_operations_count Average authz | acl_operations_count Maximum authz | acl_operations_count Minimum authz | object_specific_acl_mutation_count Average authz | object_specific_acl_mutation_count Maximum authz | object_specific_acl_mutation_count Minimum network | received_bytes_count Average network | received_bytes_count Maximum network | received_bytes_count Minimum network | sent_bytes_count Average network | sent_bytes_count Maximum network | sent_bytes_count Minimum

VMware, Inc. 15 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

K8s Clusters CPU | utilization Average CPU | utilization Maximum CPU | utilization Minimum CPU | usage_time CPU | reserved_cores disk | bytes_total Average disk | bytes_used Average disk | bytes_used Maximum disk | bytes_used Minimum disk | inodes_free disk | inodes_total memory | bytes_total Average memory | bytes_used Average memory | bytes_used Maximum memory | bytes_used Minimum memory | page_fault_count uptime pid_used pid_limit accelerator | memory_total Average accelerator | memory_used Average accelerator | memory_used Maximum accelerator | memory_used Minimum accelerator | memory_used accelerator | duty_cycle accelerator | request

Big Query DataSet slots | allocated slots | allocated_for_project slots | allocated_for_project_and_job_type slots | allocated_for_reservation slots | total_allocated_for_reservation slots | total_available query | count query | execution_times query | scanned_bytes query | scanned_bytes_billed query | statement_scanned_bytes query | statement_scanned_bytes_billed job | num_in_flight storage | table_count

VMware, Inc. 16 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

Big Query Tables storage | stored_bytes storage | uploaded_bytes storage | uploaded_bytes_billed storage | uploaded_row_count

VPN Gateways gateway | connections

VPN Tunnels network | dropped_received_packets_count network | dropped_sent_packets_count network | received_bytes_count network | received_packets_count network | sent_bytes_count network | sent_packets_count tunnel_established

VMware, Inc. 17 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

K8s Nodes CPU | utilization CPU | usage_time CPU | reserved_cores CPU | scheduler_wait_time CPU | vCPUs CPU | IsSharedCpu Status Disk | read_bytes_count Disk | read_ops_count Disk | throttled_read_bytes_count Disk | throttled_read_ops_count Disk | throttled_write_bytes_count Disk | throttled_write_ops_count Disk | write_bytes_count Disk | write_ops_count Disk | Disk I/O Average (Count) Disk | Disk I/O Average (Bytes) Memory | Total Memory | maximumPersistentDisksSizeGb balloon | ram_size balloon | ram_used balloon | swap_in_bytes_count balloon | swap_out_bytes_count firewall | dropped_bytes_count firewall | dropped_packets_count instance_group | size network | received_bytes_count network | received_packets_count network | sent_bytes_count network | sent_packets_count network | Network I/O Average (Bytes) network | Network I/O Average (Packets) integrity | early_boot_validation_status integrity | late_boot_validation_status uptime mirroring | dropped_packets_count mirroring | mirrored_packets_count mirroring | mirrored_bytes_count

VMware, Inc. 18 VMware vRealize Operations Management Pack for Google Cloud Platform

Table 6-1. VMware vRealize Operations Management Pack for Google Cloud Platform Metrics (continued)

Object Type Metric Key

K8s Pods network | received_bytes_count network | sent_bytes_count volume | total_bytes volume | used_bytes volume | utilization

K8s Container CPU | core_usage_time CPU | limit_cores CPU | limit_utilization CPU | request_cores CPU | request_utilization memory | limit_bytes memory | limit_utilization memory | page_fault_count memory | request_bytes memory | request_utilization memory | used_bytes memory | restart_count uptime

VMware, Inc. 19 Dashboards in VMware vRealize Operations Management Pack for Google Cloud Platform 7

With the dashboards in the VMware vRealize Operations Management Pack for Google Cloud Platform, you can monitor the following Google Cloud Platform services: n Google Compute Engine n Container/Kubernetes Engine n Cloud Storage n Cloud VPN n Big Query

Access the Dashboards

1 To access the dashboards, from the main menu of VMware vRealize Operations Manager, click Dashboards.

2 From the dashboard list, select the required Google Cloud Platform dashboard.

GCP Availability Dashboard

You can view the heat maps of the Google Cloud Platform services monitored by this Management Pack.

GCP Big Data: Big Query Dashboard

You can view the information about the monitored Cloud Big Query type resources, with the curated tables and charts.

GCP Compute: Container Dashboard

You can view the information about the monitored Cloud Kubernetes Engine type resources, with the curated tables and charts.

VMware, Inc. 20 VMware vRealize Operations Management Pack for Google Cloud Platform

GCP Compute: CE Dashboard

You can view the information about the monitored Compute Engine type resources, with the curated tables and charts.

GCP Inventory Dashboard

You can view the information about the number of monitored resources of a Google Cloud Platform services type.

GCP Network: VPN Dashboard

You can view the information about the monitored Cloud VPN type resources, with the curated tables and charts.

GCP Storage: Buckets Dashboard

You can view the information about the monitored Cloud Storage type resources, with the curated tables and charts.

VMware, Inc. 21