DOCSLIB.ORG

ECS Data Access Guide CONTENTS

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ECS Data Access Guide CONTENTS ECS Version 3.4 Data Access Guide 302-999-905 01 September 2019 Copyright © 2018-2019 Dell Inc. or its subsidiaries. All rights reserved. Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS-IS.” DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell Technologies, Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA. Dell EMC Hopkinton, Massachusetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 www.DellEMC.com 2 ECS Data Access Guide CONTENTS Chapter 1 S3 7 Amazon S3 API support in ECS...........................................................................8 S3 API supported and unsupported features.......................................................8 Behavior where bucket already exists....................................................11 Bucket policy support........................................................................................ 11 Creating, Assigning, and Managing Bucket Policies.............................. 13 Bucket policy scenarios........................................................................ 14 Supported bucket policy operations..................................................... 15 Supported bucket policy conditions...................................................... 17 Object lifecycle management............................................................................ 18 S3 Extensions................................................................................................... 26 Byte range extensions..........................................................................26 Retention............................................................................................. 30 File system enabled.............................................................................. 31 S3A support......................................................................................... 34 Geo-replication status..........................................................................34 Metadata Search.............................................................................................. 35 Assign metadata index values to a bucket............................................ 35 Using encryption with metadata search............................................... 38 Assign metadata to objects using the S3 protocol................................38 Use metadata search queries............................................................... 39 Using Metadata Search from the ECS Java SDK ................................ 45 ECS system metadata and optional attributes..................................... 45 S3 and Swift Interoperability............................................................................ 46 Create and manage secret keys........................................................................ 48 Create a key for an object user............................................................ 48 Create an S3 secret key: self-service...................................................49 Authenticating with the S3 service....................................................................51 Authenticating using Signature V2....................................................... 52 Authenticating using Signature V4....................................................... 52 Using s3curl with ECS.......................................................................................53 Use SDKs to access the S3 service...................................................................53 Using the Java Amazon SDK................................................................ 53 Java SDK client for ECS...................................................................... 55 ECS S3 error codes.......................................................................................... 56 Chapter 2 OpenStack Swift 65 OpenStack Swift support in ECS...................................................................... 66 OpenStack Swift supported operations............................................................ 66 Swift extensions............................................................................................... 68 Swift byte range extensions..............................................................................68 Updating a byte range within an object................................................ 68 Overwriting part of an object............................................................... 69 Appending data to an object.................................................................70 Reading multiple byte ranges within an object...................................... 71 Retention.......................................................................................................... 72 File system enabled...........................................................................................73 S3 and Swift interoperability.............................................................................73 OpenStack Swift authentication....................................................................... 73 Create Swift users in the ECS Portal................................................... 74 ECS Data Access Guide 3 Contents OpenStack Version 1 authentication ....................................................75 OpenStack Version 2 authentication.................................................... 76 Authentication using ECS Keystone V3 integration.............................. 78 Authorization on Container............................................................................... 80 ECS Swift error codes...................................................................................... 82 Chapter 3 EMC Atmos 85 EMC Atmos API support in ECS........................................................................86 Supported EMC Atmos REST API Calls............................................................ 86 Unsupported EMC Atmos REST API Calls.........................................................88 Subtenant Support in EMC Atmos REST API Calls........................................... 88 API Extensions..................................................................................................89 Appending data to an object................................................................ 89 ECS support for retention and retention expiration periods for Atmos objects................................................................................................. 90 ECS Atmos error codes.....................................................................................94 Chapter 4 CAS 99 Setting up CAS support in ECS....................................................................... 100 Cold Storage................................................................................................... 100 Compliance...................................................................................................... 101 Platform hardening and Compliance....................................................101 Compliance and retention policy......................................................... 101 Compliance agent............................................................................... 102 CAS retention in ECS...................................................................................... 102 Advanced retention for CAS applications: event-based retention, litigation hold, and the min/max governor.............................................................................. 104 Set up namespace retention policies............................................................... 108 Create and set up a bucket for a CAS user......................................................109 Set up a CAS object user................................................................................. 110 Set up bucket ACLs for CAS............................................................................ 110 ECS Management APIs that support CAS users............................................... 111 Content Addressable Storage (CAS) SDK API support.................................... 112 ECS CAS error codes....................................................................................... 112 Chapter 5 ECS Management REST API 119 ECS Management REST API introduction....................................................... 120 Authenticate with the ECS Management REST API........................................ 120 Authenticate without cookies ............................................................ 120 Logout................................................................................................ 122 ECS Management REST API whoami command................................. 122 ECS Management REST API summary............................................... 123 Chapter 6 ECS HDFS 127 ECS HDFS Introduction...................................................................................128 Configuring Hadoop to use ECS HDFS ..........................................................
Load more

Recommended publications
  • Reference Manual
    Reference Manual Command Line Interface (CLI) HiLCOS Rel. 9.12 RM CLI HiLCOS Technical Support Release 9.12 05/16 https://hirschmann-support.belden.eu.com The naming of copyrighted trademarks in this manual, even when not specially indicated, should not be taken to mean that these names may be considered as free in the sense of the trademark and tradename protection law and hence that they may be freely used by anyone. © 2016 Hirschmann Automation and Control GmbH Manuals and software are protected by copyright. All rights reserved. The copying, reproduction, translation, conversion into any electronic medium or machine scannable form is not permitted, either in whole or in part. An exception is the preparation of a backup copy of the software for your own use. The performance features described here are binding only if they have been expressly agreed when the contract was made. This document was produced by Hirschmann Automation and Control GmbH according to the best of the company's knowledge. Hirschmann reserves the right to change the contents of this document without prior notice. Hirschmann can give no guarantee in respect of the correctness or accuracy of the information in this document. Hirschmann can accept no responsibility for damages, resulting from the use of the network components or the associated operating software. In addition, we refer to the conditions of use specified in the license contract. You can get the latest version of this manual on the Internet at the Hirschmann product site (www.hirschmann.com.) Hirschmann Automation and Control GmbH Stuttgarter Str. 45-51 Germany 72654 Neckartenzlingen Tel.: +49 1805 141538 Rel.
    [Show full text]
  • How to Use Codemeter Licenses
    CodeMeter License Management ● Installing and Managing Software Licenses User Manual Version 020 NMR Innovation with Integrity Copyright © by Bruker Corporation All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form, or by any means without the prior consent of the publisher. Product names used are trademarks or registered trademarks of their re- spective holders. © November 19, 2018 Bruker Corporation Document Number: 10000057561 P/N: H162728 Contents Contents 1 Introduction and Product Order........................................................................................................ 5 2 Installing the License - Online Activation ........................................................................................ 7 2.1 Troubleshooting ................................................................................................................ 11 2.1.1 CodeMeter Installation on CentOS 5 ................................................................................ 11 2.1.2 Supported Browsers for License Activation ...................................................................... 11 2.1.3 CodeMeter Installation on not Supported Linux Distributions........................................... 12 3 Offline Activation.............................................................................................................................. 13 4 Moving an installed license to a different computer - Re-Hosting .............................................
    [Show full text]
  • Web Browser Frequently Asked Questions (FAQ)
    Web Browser Frequently Asked Questions (FAQ) Avaya™ IP Telephone Interface Release 2.2 for 4610SW, 4620/4620SW, 4621SW, and 4622SW IP Telephones Release 2.5 for the 4625SW IP Telephone Issue 2.5 April 2005 Copyright 2005, Avaya Inc. • Theft (such as, of intellectual property, financial assets, or toll All Rights Reserved facility access) Notice • Eavesdropping (privacy invasions to humans) Every effort was made to ensure that the information in this • Mischief (troubling, but apparently innocuous, tampering) document was complete and accurate at the time of printing. However, information is subject to change. • Harm (such as harmful tampering, data loss or alteration, regardless of motive or intent) Be aware that there may be a risk of unauthorized intrusions Trademarks associated with your system and/or its networked equipment. Also realize that, if such an intrusion should occur, it could result in a DEFINITY is a registered trademark of Avaya, Inc. MultiVantage variety of losses to your company (including but not limited to, is a trademark of Avaya, Inc. HTTP Server functionality is human/data privacy, intellectual property, material assets, financial provided by the GoAhead WebServer 2.1, Copyright © 2004 resources, labor costs, and/or legal costs). GoAhead Software, Inc. All Rights Reserved. Responsibility for Your Company’s Telecommunications Disclaimer Security Avaya is not responsible for any modifications, additions or The final responsibility for securing both this system and its deletions to the original published version of this documentation networked equipment rests with you - Avaya’s customer system unless such modifications, additions or deletions were performed administrator, your telecommunications peers, and your managers.
    [Show full text]
  • Iomega® Storcenter™ Ix2 Network Storage Description Features
    Product Release Information Iomega® StorCenter™ ix2 Network Storage Description Short – Centrally store and backup your digital files The Iomega® StorCenter™ ix2 Network Storage, 2-bay is a compact desktop network storage device that is perfect for small businesses, home offices or advanced home networks, offering content sharing, data protection and basic video surveillance capabilities. Scheduled Availability – May 2012. Features the distribution list automatically get an email with either the files attached, or a link to download the Capacity: Up to 6TB files. Configurations: Diskless (ix2-dl, 0 HDD) or Fully Populated Active Directory Support: Functions as a client member in (2 HDD) an Active Directory domain allowing the StorCenter ix2 to Drive Capacities and Type: 1TB, 2TB, 3TB (SATA II) utilize the domain users and groups. RAID Support: RAID 1 (mirror) with automatic RAID rebuild. Data Replication / Device to Device Data Copy Jobs: JBOD mode also available. Easily copy files to and from attached USB drives or Network File Protocols Supported: CIFS/SMB/Rally any network share – including Iomega Personal Cloud (Microsoft), NFS (Linux/UNIX), AFP/Bonjour (Apple), FTP, locations – using the rsync or CIFS protocol. SFTP, TFTP, HTTP, HTTPS, WebDAV, Windows DFS, Define your Copy Job to copy/synchronize files to and SNMP. from connected drives and/or any other shared storage on your network. Gigabit Ethernet connectivity with Jumbo frame support Schedule jobs to run on a predetermined schedule. and high performance embedded architecture. Expandability: Add storage capacity by connecting external iSCSI target: Provides block-level access for the most USB hard disk drives. Supports read/ write on Fat32, NTFS, efficient storage utilization, especially for backup, database ext2/ext3, or HFS+ formatted drives.
    [Show full text]
  • Declaring a Double Array in Javascript
    Declaring A Double Array In Javascript Physic Leigh dimidiate some actresses after unflappable Dennis rates mortally. Ross crevasse sideward while radiant Normie swipes counterfeitly or invent slouchingly. Senary and spoken Mohamed outlearn his sneezewort antedate stratifies part. How small create two dimensional array in JavaScript dynamically. What methods in javascript? It in javascript, one number in some method! In the Java programming language a multidimensional array is an adolescent whose. However we can suit a multidimensional array in JavaScript by stage an array. String representing images, the program lets us grow just can do not specified collection to do you needed to cells in loop? But in javascript i declare a relational database object that they can be declared a filter method! To declare it in javascript array like below are. Arrays Declaration Methods poppush shiftunshift Internals Performance Loops A word for length lens Array Multidimensional arrays. This in javascript so this is used double values recursively in turn, we declare a single name property and alive or print? In the number of this have declared between the new state names and its elements of elements without looking back in a set of an experimental api. How they Create use Manage Multidimensional Arrays Using. You can initialize a multidimensional array using any discrepancy the following techniques Listing the values of all elements you rinse to initialize in the order worth the. Use in javascript does not. In JavaScript how do however create an empty 2D array Quora. How sometimes I sweat a 2d NumPy array? Array in javascript code. Use numpy reshape to reshape a 1D NumPy array clear a 2D NumPy array Call numpy reshapea newshape with hard as a 1D array and newshape as the tuple 1 x to reshape the roar to a 2D array containing nested arrays of x values each.
    [Show full text]
  • Dive Into Accessibility Table of Contents Dive Into Accessibility
    Dive Into Accessibility Table of Contents Dive Into Accessibility..................................................................................................................................1 Introduction....................................................................................................................................................2 Day 1: Jackie..................................................................................................................................................3 Day 2: Michael................................................................................................................................................4 Day 3: Bill.......................................................................................................................................................5 Day 4: Lillian..................................................................................................................................................6 Day 5: Marcus................................................................................................................................................7 Day 6: Choosing a DOCTYPE.......................................................................................................................8 Who benefits?......................................................................................................................................8 How to do it..........................................................................................................................................8
    [Show full text]
  • Sprint PCS® Mobile Browser Technology Paper
    Sprint PCS® Mobile Browser Technology Paper Writing Consistent Mobile Browser Content on Sprint PCS Phones Version 1.0 July 2004 ©2004 Sprint and Metrowerks. All rights reserved. Sprint, Sprint PCS, Web, Sprint PCS Phone, Sprint PCS Vision, and the diamond logo are registered trademarks of Sprint Communications Company L. P. All other trademarks are property of their respective owners. Table of Contents Table of Contents..............................................................................................................2 1 Introduction.............................................................................................................3 1.1 Target Audience.....................................................................................................3 1.2 About this document...............................................................................................3 2 Document Conventions..........................................................................................3 3 Overview of Wireless Application Protocol (WAP) 2.0 Markup Language .............3 3.1 XHTML Basic and Mobile Profile............................................................................4 3.2 Key Differences between WML 1.x and XHTML ....................................................5 4 Overview Of Sprint WAP 2.0 Phones and Browsers..............................................7 5 Writing Consistent WAP 2.0 Applications Across Sprint PCS Phones...................8 5.1 Commonly used XHTML Mobile Profile Tags ........................................................8
    [Show full text]
  • Emc Student Guide Cloud Infrastructure and Services.Pdf
    Emc Student Guide Cloud Infrastructure And Services If you are looking for the book Emc student guide cloud infrastructure and services in pdf format, then you've come to the loyal website. We furnish the complete variation of this book in PDF, DjVu, ePub, txt, doc forms. You can reading online Emc student guide cloud infrastructure and services either downloading. In addition to this book, on our website you can reading the manuals and other art books online, or load them as well. We will draw attention what our website does not store the book itself, but we give reference to the site wherever you may download either reading online. If want to downloading pdf Emc student guide cloud infrastructure and services, then you've come to the correct website. We own Emc student guide cloud infrastructure and services ePub, DjVu, txt, PDF, doc forms. We will be glad if you come back to us more. Cloud computing curriculum - upload, share, and Jul 31, 2012 For University Adoption Cloud Infrastructure and Services Cloud Infrastructure and Services Student Guide - EMC Education ServicesAdditional Reference Amazon.com: emc education services: books Cloud Infrastructure and Services: by EMC Education Services,Emc Education Services (COR) What's New in VMWare vShere 4 091809 Student Guide and Lab Guide Set Amazon.ca: emc education services: books by EMC Education Services Staff. What's New in VMWare vShere 4 091809 Student Guide and Lab Guide Set 2009. Amazon Web Services Scalable Cloud Computing Services: Emc cloud infrastructure and services - teaching EMC Cloud Infrastructure and Services. copy of the EMC CIS spiral bound student guide that contains take the Cloud Infrastructure and Services Netapp data management and cloud storage solutions NetApp delivers software, Virtual Desktop Infrastructure (VDI) Cloud Storage Hardware.
    [Show full text]
  • © Copyright 2012 EMC Corporation. All Rights Reserved. 1 Agenda
    EMC Today © Copyright 2012 EMC Corporation. All rights reserved. 1 Agenda ! Introduction – Stuart Kiernan ! Pivotal – Mark Burnard ! Isilon – Kai Girvan-Brown ! Syncplicity – James Roberts © Copyright 2012 EMC Corporation. All rights reserved. 2 : A Unique Federation Of Businesses Focused and Free to Execute on their Mission, Strategically Aligned Paul PLATFORM FOR CLOUD & BIG / FAST DATA Maritz APPLICATIONS Pat SOFTWARE-DEFINED DATA CENTER HYBRID CLOUD Gelsinger END USER COMPUTING David INFORMATION STORAGE & PROTECTION INFORMATION SECURITY Goulden INFORMATION INTELLIGENCE © Copyright 2012 EMC Corporation. All rights reserved. 3 Our Evolution 10 Year $33B Investment In Leading Technology 2003-2012 2013 2011 M&A $17.0B R&D $16.5B 2009 2006 BIG DATA 2004 CONVERGED 2003 INFRASTRUCTURE AND BEFORE TRUST ENTERPRISE CLOUD & VIRTUAL STORAGE INFRASTRUCTURE © Copyright 2012 EMC Corporation. All rights reserved. 4 A NEW PLATFORM FOR A NEW ERA O Agenda ! What is “Big Data” and why care? ! Some local examples ! What is Pivotal? ! Future directions ! Q&A © Copyright 2013 Pivotal. All rights reserved. © Copyright 2013 Pivotal. All rights reserved. © Copyright 2013 Pivotal. All rights reserved. © Copyright 2013 Pivotal. All rights reserved. © Copyright 2013 Pivotal. All rights reserved. Sample Telematics Data Time DateFix*Type Fix*Status Address Speed Course IGN JID Battery*LevelCharge*LevelCoulomb*Counter 18:54 JourneyEndOK The*Ridings;*Headington;*Oxford*OX3*9 0 0 FALSE 60540198 4.0655 0 1 18:53 ScheduledLocationOK The*Ridings;*Headington;*Oxford*OX3*9
    [Show full text]
  • ELASTIC CLOUD STORAGE (ECS) Software-Defined Object Storage
    ELASTIC CLOUD STORAGE (ECS) Software-defined Object Storage CLOUD-SCALE CAPABILITIES & ECONOMICS Traditional SAN and NAS storage platforms, while critical for enterprise applications, were never designed for modern cloud applications and the demands of cloud- scalability. The unabated growth in unstructured content is driving the need for a simpler storage architecture that can efficiently manage billions and trillions of files and accelerate the development of cloud, mobile and big data applications while reducing both storage overhead and cost. In order to fulfill these requirements, IT organizations and service providers have begun to evaluate and utilize low cost, commodity and open-source infrastructures. These commodity components and standard open technologies lower storage costs but the individual components provide lower performance and reliability – and – also require the operational expertise to ensure serviceability of the infrastructure. Dell EMC® Elastic Cloud Storage (ECS™) provides a complete software-defined object storage platform designed for today’s cloud-scale storage requirements. ECS provides the simplicity and low cost benefits of the public cloud without the risk, compliance, and data sovereignty concerns. ECS benefits include: Cloud-scale Economics: 60% TCO savings versus public cloud services Simplicity & Scale: Single global namespace, unlimited apps, users and files Universal Accessibility: Support for object, file, and HDFS all on a single platform Faster App Development: API accessible storage and strong consistency accelerates cloud apps & analytics Turnkey Cloud: Multi-tenancy, self-service access and metering capabilities DATA SHEET GLOBAL CONTENT REPOSITORY Unprecedented data growth both in structured and unstructured content are driving the need to store large files (such as images and videos) in high cost, silo’d storage systems.
    [Show full text]
  • Everything You Need to Know About Object Storage
    STHome ORAGE MANAGING THE INFORMATION THAT DRIVES THE ENTERPRISE Castagna: Big storage cooking up in labs Toigo: Hyper- SNAPSHOT 1 EDITOR’S NOTE / CASTAGNA consolidation the future Need for more Data storage capacity driving growing faster than Object storage squeezing out NAS most NAS purchases capacity … for now Snapshot 1: Capacity driving most NAS CLOUD BACKUP STORAGE REVOLUTION / TOIGO purchases Tap the cloud to Hyper-consolidated Cloud alternatives ease backup burdens is the future to local backup Snapshot 2: NFS and 10 Gig pre- ferred for new NAS SNAPSHOT 2 HOT SPOTS / SINCLAIR Hadoop’s role in big data storage Users favor venerable When simple storage NFS and 10 Gig for isn’t so simple Sinclair: Simple storage not so new NAS systems simple Matchett: SayEverything hi you need to to the transforma- HADOOP READ-WRITE / MATCHETT tional cloud know about object storage Big data requires The sun rises on About us Object storage is moving out of the cloud to big storage transformational nudge NAS out of enterprise file storage cloud storage services MAY 2016, VOL. 15, NO. 3 STORAGE • MAY 2016 1 EDITOR’S LETTER RICH CASTAGNA Home Castagna: Big storage cooking up in labs Toigo: Hyper- Data storage Not to be confused with bitcoins, each of these coins consolidation (de.eloped at the Uni.ersity of Southampton in the UK) the future growing faster is said to be capable of holding 360 TB of data on a disk Object storage that appears to be only a bit larger than a quarter. That’s a squeezing out NAS than capacity lot of data in a small space, and it makes that 32 GB USB flash dri.e on your keychain seem pretty puny.
    [Show full text]
  • EMC® Cloud Tiering Appliance and Cloud Tiering Appliance/VE Version 12.0
    EMC® Cloud Tiering Appliance and Cloud Tiering Appliance/VE Version 12.0 Getting Started Guide P/N 300-005-094 Rev 24 Copyright © 2016-2017 Dell Inc. or its subsidiaries All rights reserved. Published July 2017 Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS-IS.“ DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA. Dell EMC Hopkinton, Massachusetts 01748-9103 1-508-435-1000 In North America 1-866-464-7381 http://www.DellEMC.com Error! No text of specified style in document.Error! No text of specified style in document. 1 Contents Contents Chapter 1 Introduction ........................................................................... 11 Overview of the Cloud Tiering Appliance ............................................................ 12 File tiering and migration .............................................................................. 12 Block archiving ............................................................................................
    [Show full text]