Internet2 Cloud Strategy Update and Community Resources Internet2 Cloud Strategy Update George K. Loftus AVP Network Services, Internet2 Cloud Strategy Focus: • Integrated organization-wide thinking on cloud solution requirements developed in concert with the Internet2 community. • How do we leverage the contractual and program Benefits the community has developed through NET+ and other agreements? • How do we Bring together community knowledge and tools in support of a multi-cloud approach for researchers and enterprise? • How do we leverage Internet2 & R&E community private infrastructure and trusted identity solution to connect members with puBlic and private clouds? I 3 I Cloud Requirements Program • Analyze Cloud Access Solutions • Survey of current state of the cloud market • User Story Collection • First Phase service development and pilots • Formation of advisory council After GloBal Summit 18 we move in to a new phase, moving “Cloud Access” to a service and Beginning translation of the collected user stories in to future roadmap items I 4 I Cloud Requirements: We need community use stories: We are currently gathering stories from the community about how they are using, or want to use, cloud infrastructure to meet their research and enterprise compute and storage needs. Send us a few sentences that tell your story about your requirements at: https://tinyurl.com/y8xkhy5k Story collection is open and we have received about 40 thus far. I 5 I An Example Story: (Thanks Emory University): 2/14/18 I 6 I Story Titles to Date Visibility and Inventory of Institutional Assets Looking to the Future of Computing and the Data Center Researcher education, moving from CAPEX to OPEX Requirements the Community Has HPC Across Campus and the Cloud AWS COnnectivity Needs Affordable Direct Connections to Major Cloud Providers Infrastructure must support open API's Presenting research projects to cloud compute resources so that Multi-cloud Networking they can be manipulated, processed, and/or analyzed Multi-cloud Cost Management and Billing Using Small-scale RDBMs The Internet is Down Large Data Sets Internet2 Cloud Expert Pool and Services Very Large Data Sets Open Research Platforms and Internet2 Single Sign On Locally and in the Cloud Organizing, Orchestrating and Delivering Data from Lakes Database PAAS Services for Local Applications Cloud Connect POC Data Transfer Associated with Evaluation and Workload Bursting Performing machine learning (ML) and deep learning (DL) on Large Data Set Moves large-scale gene expression data sets. Backup to Cloud Storage Brandeis Genomics Hackathon Data Cost Clemson University Service Sharing Compute Engine to explore generalizations of the Sato-Tate Robust, Reliable private Connectivity Conjecture and the conjecture of Birch and Swinnerton-Dyer Internet2 cloud experts: an SGCI Partner to curves of higher genus. (1:2) Non-metered traffic out of commercial clouds Compute Engine to explore generalizations of the Sato-Tate AWS console and InCommon Conjecture and the conjecture of Birch and Swinnerton-Dyer Internet2 cloud expert pool to curves of higher genus. (2:2) Alzheimer's Human Genome Data Collection Off-premise HPC and big data options for new faculty Meeting the Demands for Virtual Laboratories researchers I 7 I Cloud Community Advisory Group # Name Title Org. Email 1 Dave Marble CEO OSHEAN [email protected] 2 James Deaton Exec. Director Great Plains Network [email protected] 3 Sarah Christen Associate Director of Cloud Service Cornell [email protected] 4 Barr von Oehsen Assoc. VP, Off. of Adv’d Research Computing Rutgers University [email protected] 5 Dave Kelly Cloud Services The University of Iowa [email protected] 6 Andrew Reich IT Architect The University of Utah [email protected] 7 Wayne Ortman Dir, Network Services LITS Emory University [email protected] 8 Oren Sreebny Senior Director for Cloud Strategy UChicago [email protected] 9 Jim Basney Senior Research Scientist U Illinois [email protected] 10 Greg Palmer ISC Research Liaison U Penn [email protected] 11 Adam Smith IT Service Delivery Lead GA Tech [email protected] 12 Sharif Nijim Sr Dir IT Service Delivery Norte Dame [email protected] 13 Mike Corn CISO UCSD [email protected] I 8 I Roadmap Input & Annual Planning Cycle Infrastructure Enablement Focus New Features New Features (Network Portal & Resulting from User Resulting from User API enablement) Story Sorting Story Sorting Infrastructure Feature Feature Planning & Planning & Planning & Community Community Community Feature Input Startup Validation Validation Development 2018 2019 2020 Features Features Features Feature Deployment Requirements Requirements Gathering Gathering Infrastructure Requests User Story Sorting User Story Sorting New User Stories New User Stories New User Stories I 9 I Cloud Strategy Focus: • Integrated organization-wide thinking on cloud solution requirements developed in concert with the Internet2 community. • How do we leverage the contractual and program Benefits the community has developed through NET+ and other agreements? • How do we Bring together community knowledge and tools in support of a multi-cloud approach for researchers and enterprise? • How do we leverage Internet2 & R&E community private infrastructure and trusted identity solution to connect members with puBlic and private clouds? I 10 I NET+ Cloud Services Update Sean O’Brien Program Manager, Internet2 Community-Driven Internet2 Cloud Services I 12 I Defining Community: Internet2 Cloud Partnerships The Internet2 Member Community: Affiliates & Non- Global Partners: Members: Partnering with Extending benefits International to more NRENs communities (K20, Libraries, Museums) Industry Members: I 13 I The Result? A TRUSTED ECOSYSTEM of Tailored Top-Quality Cloud Solutions I 14 I Areas of Focus for NET+ Cloud Services • Deliver the current successes, through the current key success factors, through a portfolio of modest size • Representing “high-impact” services (“impact” = high adoption; ”infrastructural”; strategic to community and other Internet2 interests) in a self-supporting business model • Aligning cloud services portfolio services efforts to Internet2's cross-organizational cloud strategies (ex. Google Cloud Platform work) • Updating business models and agreements to improve transactional efficiently (ex. Migration of agreements to provider-direct community validated agreements or through resellers/distributors) I 15 I Why NET+ Cloud Services? • Influences industry to develop services more useful to the Research and Education community • Encourages competition among service providers on direct value of services • Encourages collaboration within the community • Provides an opportunity for each member of the community to contribute to expansion of service offerings • Encourages a strategic relationship between the community and service providers • Provides a basis for long-term collaboration on R&D I 16 I NET+ Service Lifecycle Pre-validation Research Incubator SERVICE VALIDATION Validated and available EARLY ADOPTER GENERAL AVAILIBILITY SUNSET I 17 I Service development • Discovery • Understanding the opportunity (what are the possibilities? Market scope?) • Alignment • Are the provider and community goals strategically aligned (are we headed in the same direction?) • Feasibility • Are the investments and mutual accommodations required likely to materialize? • Identifying a Sponsor • A CIO or executive from a member institution • Developing a Proposal • With support of the Sponsor • Identifying additional SV participants • Review of Requirements • Networking, Identity, Security, Business model and terms I 18 I NET+ Service Validation • Assessment of the service for inclusion in the catalogue, applying a consistent process, and determining how best to make it available at scale to the entire higher education community: • SV Group is led by the Sponsoring institution and Internet2 and Includes: • Service Provider • Sponsoring University and 5-7 University Participants • SV participants represent • The Community • Apply a consistent process to assess the service for inclusion in the catalogue • Determine how to make it available at scale to the entire R&E community I 19 I NET+ Service Validation Components • Functional Assessment • Business • Review features and functionality • Tune service for research and education • Legal: customized agreement using community NET+ community contract templates • Technical Integration • Business model • Network: determine optimal connection and • Define pricing and value proposition optimize service to use the Internet2 R&E • Deployment network • Documentation • Identity: InCommon integration • Security and Compliance • Use cases • Security assessment: Cloud Controls Matrix • Support model • FERPA, HIPAA, privacy, data handling • Accessibility I 20 I Service Stewardship – Ongoing Service Administration • Ongoing review and management of the key areas of focus from service validation • Functional, identity, network, security, accessibility, business and legal • Convening the community in meaningful ways around cloud services • Service advisory boards (one board for every service in general availability) • Service working groups (ex. Learning management system integration) • Online communities of practice (community forum, Slack channel, email) • Support for cloud standards, integrations and overall cloud architecture • Contract administration • Internet2 reviews campus concerns, questions and proposed changes with the Service