Render Farm Deployment Kit on AWS Developer Guide Render Farm Deployment Kit on AWS Developer Guide Render Farm Deployment Kit on AWS: Developer Guide Copyright © 2020 Amazon Web Services, Inc. and/or its affiliates. All rights reserved. Amazon's trademarks and trade dress may not be used in connection with any product or service that is not Amazon's, in any manner that is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon. All other trademarks not owned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored by Amazon. Render Farm Deployment Kit on AWS Developer Guide Table of Contents What is the RFDK? ............................................................................................................................. 1 Why use the RFDK? .................................................................................................................... 1 Where can I get the RFDK? ......................................................................................................... 5 Additional documentation and resources ....................................................................................... 5 About Amazon Web Services ....................................................................................................... 5 Getting started .................................................................................................................................. 6 Prerequisites .............................................................................................................................. 6 Onboarding to CDK .................................................................................................................... 6 Example development environment .............................................................................................. 6 Prerequisites ...................................................................................................................... 7 Step 1: Create an AWS CodeCommit repository ..................................................................... 7 Step 2: Create an AWS Cloud9 environment .......................................................................... 7 Step 3: Encrypt Cloud9 EBS volume ..................................................................................... 8 Step 4: Increase storage capacity (optional) ........................................................................... 8 Step 5: Configure Cloud9 for use with CodeCommit ............................................................... 8 Step 6: Clone the AWS CodeCommit repository ..................................................................... 9 Next steps ......................................................................................................................... 9 Your first RFDK app .................................................................................................................... 9 Initialize the RFDK app ..................................................................................................... 10 Setup the environment ..................................................................................................... 11 Define a Deadline render farm ........................................................................................... 12 Deploy the render farm .................................................................................................... 16 Update the render farm .................................................................................................... 17 (Optional) Submit a job to the render farm ......................................................................... 19 Tear down the render farm ............................................................................................... 21 Next steps ....................................................................................................................... 21 Working with the RFDK ..................................................................................................................... 22 RFDK prerequisites ................................................................................................................... 22 Creating a project ..................................................................................................................... 22 Creating an AWS CDK application ....................................................................................... 22 Installing RFDK ................................................................................................................ 23 Deadline Container Images ........................................................................................................ 24 Using AWS Thinkbox ECR Repositories ................................................................................ 24 Staging Deadline Recipes .................................................................................................. 26 Listing available RFDK versions .................................................................................................. 28 Working with the RFDK in Python .............................................................................................. 28 Prerequisites .................................................................................................................... 28 Working with the RFDK in TypeScript ......................................................................................... 29 Installing peer dependencies .............................................................................................. 29 Connecting To Render Farm ....................................................................................................... 29 Connecting With Site-to-Site VPN ...................................................................................... 29 Connecting With AWS Client VPN ....................................................................................... 30 Connecting With VPC peering ............................................................................................ 33 Allowing connection to the Render Queue ........................................................................... 35 Getting remote connection server address ........................................................................... 35 Best practices .................................................................................................................................. 36 Organizing your stacks - Multi-tiered architecture ......................................................................... 36 Benefits ........................................................................................................................... 36 Example .......................................................................................................................... 36 Managing resources .................................................................................................................. 37 Developing on an EC2 Instance .................................................................................................. 37 Source control ......................................................................................................................... 38 Additional readings ................................................................................................................... 38 Security ........................................................................................................................................... 39 iii Render Farm Deployment Kit on AWS Developer Guide Additional Readings .................................................................................................................. 38 Data protection in the RFDK ...................................................................................................... 39 Encryption in transit ......................................................................................................... 40 Identity and access management in the RFDK .............................................................................. 44 Infrastructure security in the RFDK ............................................................................................. 44 Configuring network firewalls for the RFDK ......................................................................... 44 Patching software used by the RFDK .................................................................................. 45 Security best practices for the RFDK ........................................................................................... 45 Secure the CDK bootstrap AWS S3 bucket ........................................................................... 45 OpenPGP keys ................................................................................................................................. 46 RFDK OpenPGP key .................................................................................................................. 46 Verifying the integrity of GitHub release downloads ..................................................................... 47 Troubleshooting ............................................................................................................................... 49 Finding logs ............................................................................................................................