Installation Guide
Total Page:16
File Type:pdf, Size:1020Kb
PRODUCT DOCUMENTATION Pivotal™ Greenplum Database® Version 4.3 Installation Guide Rev: A17 © 2017 Pivotal Software, Inc. Copyright Installation Guide Notice Copyright Privacy Policy | Terms of Use Copyright © 2017 Pivotal Software, Inc. All rights reserved. Pivotal Software, Inc. believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED "AS IS." PIVOTAL SOFTWARE, INC. ("Pivotal") MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Use, copying, and distribution of any Pivotal software described in this publication requires an applicable software license. All trademarks used herein are the property of Pivotal or their respective owners. Revised January 2017 (4.3.11.2) 2 Contents Installation Guide Contents Chapter 1: Preface.......................................................................................6 About This Guide................................................................................................................................ 7 About the Greenplum Database Documentation Set..........................................................................8 Document Conventions....................................................................................................................... 9 Command Syntax Conventions................................................................................................ 9 Getting Support................................................................................................................................. 10 Product information and Technical Support........................................................................... 10 Chapter 2: Introduction to Greenplum.................................................... 11 The Greenplum Master..................................................................................................................... 12 Master Redundancy................................................................................................................12 The Segments................................................................................................................................... 13 Segment Redundancy............................................................................................................ 13 Example Segment Host Hardware Stack...............................................................................14 Example Segment Disk Layout.............................................................................................. 15 The Interconnect................................................................................................................................17 Interconnect Redundancy.......................................................................................................17 Network Interface Configuration............................................................................................. 17 Switch Configuration...............................................................................................................18 ETL Hosts for Data Loading............................................................................................................. 20 Greenplum Performance Monitor...................................................................................................... 22 Chapter 3: Estimating Storage Capacity.................................................23 Calculating Usable Disk Capacity..................................................................................................... 24 Calculating User Data Size...............................................................................................................25 Calculating Space Requirements for Metadata and Logs................................................................ 26 Chapter 4: Configuring Your Systems and Installing Greenplum.........27 System Requirements....................................................................................................................... 28 Setting the Greenplum Recommended OS Parameters...................................................................30 Linux System Settings............................................................................................................30 Running the Greenplum Installer...................................................................................................... 34 Installing and Configuring Greenplum on all Hosts.......................................................................... 36 About gpadmin........................................................................................................................36 Confirming Your Installation................................................................................................... 37 Installing Oracle Compatibility Functions.......................................................................................... 38 Installing Greenplum Database Extensions...................................................................................... 39 Creating the Data Storage Areas......................................................................................................40 Creating a Data Storage Area on the Master Host................................................................40 Creating Data Storage Areas on Segment Hosts.................................................................. 40 Synchronizing System Clocks........................................................................................................... 42 Enabling iptables............................................................................................................................... 43 Example iptables Rules..........................................................................................................43 Amazon EC2 Configuration (Amazon Web Services).......................................................................46 About Amazon EC2................................................................................................................46 Working with EC2 Instances.................................................................................................. 47 3 Contents Installation Guide About Amazon Machine Image (AMI).................................................................................... 49 About Amazon Elastic IP Addresses..................................................................................... 49 Notes.......................................................................................................................................49 References..............................................................................................................................50 Next Steps......................................................................................................................................... 51 Chapter 5: Validating Your Systems....................................................... 52 Validating OS Settings...................................................................................................................... 53 Validating Hardware Performance.................................................................................................... 54 Validating Network Performance............................................................................................ 54 Validating Disk I/O and Memory Bandwidth..................................................................................... 56 Chapter 6: Configuring Localization Settings........................................ 57 About Locale Support in Greenplum Database................................................................................ 58 Locale Behavior...................................................................................................................... 59 Troubleshooting Locales.........................................................................................................59 Character Set Support...................................................................................................................... 60 Setting the Character Set..................................................................................................................63 Character Set Conversion Between Server and Client.....................................................................64 Chapter 7: Initializing a Greenplum Database System.......................... 66 Overview............................................................................................................................................ 67 Initializing Greenplum Database....................................................................................................... 68 Creating the Initialization Host File........................................................................................ 68 Creating the Greenplum Database Configuration File........................................................... 69 Running the Initialization Utility.............................................................................................. 69 Setting Greenplum Environment Variables......................................................................................