Introducing the View of SNIA Japan Cold Storage TWG on "Cold Storage"
Total Page:16
File Type:pdf, Size:1020Kb
Introducing the view of SNIA Japan Cold Storage TWG on "Cold Storage" 19 Sep 2016 Kazuhiko Kawamura Sony Corporation 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. 2 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Agenda 1. Introduction Why we are focusing on Cold Storage? About us (SNIA-J CSTWG) 2. Discussion Part-1 Definition of Cold Storage 3. Discussion Part-2 Taxonomy for Cold Storage Activity summary and next steps 4. Latest optical technology (Sony’s approach to Cold Storage) Archival Disc Technology Trial mapping of Cold Storage media 3 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Your data can be Cold, Colder, Coldest.. always access Hot frequently Warm Mapping Lukewarm sometimes Cold almost no access Extremely cold The toBulk of Data Storage market! Completely frozen! Source: IDC Worldwide Cold Storage 4 Ecosystem Taxonomy, 2014 #246732 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. What’s your image for Cold Storage? 5 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Why you don’t care for Cold data? Excuse 1 There are no clear border lines between hot, warm and cold data and you think you can’t help this situation. Excuse 2 Cold data is old and not mission critical, thus it is something you can defer your decision. Excuse 3 Some imagines that Cold data is useless, simply because it is not earning money for now. Where is cold data … Cold data should be found everywhere!6 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Minefield of Regulatory Compliance Minefield of Regulatory Compliance Compliance with 20,000 regulations worldwide This results in: • Scope: Data retention and data security • Cost to comply or remediate • Level: International, national, state and local regulations • Significant penalties for non-compliance • Depth: Industry-specific, Private, Public, Government • Potential damage to business reputation Archiving is Mandatory! Source: Alliance Storage Technologies Inc. Corporate presentation 2016 7 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. facebook amazon Linked in Twitter Microsoft Instagram Google LINE Baidu 8 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Cold data is accumulating Access After uploading to SNS, Frequency frequent accesses start within several minutes Cost Adding more and more data, Access Accesses decrease without updating. steeply after a short while. Almost no access Must stay as cold data forever minutes hours days weeks months years Flash card SSD HDD large capacity HDD SMR-HDD/Blu-ray/Tape Archive Cloud Service Cloud Service (ex. Google Nearline, Glacier) (ex. Amazon S3, …) 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Cold Data There is no single device for all needs Ideal device for Hot, Warm to Cold data? Nano-sec latency Great throughput Large capacity, Unlimited expansion Data migration free Excellent tolerance to any disasters ..and at an affordable cost. Do you believe it?? Forget about “one-size-fits-all” type of approach. We should combine multiple devices for efficient data management. 10 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. 2016 SNIA-Japan Organization General Assembly Audit Executive Director Board Meeting Office Technical Marketing Education Committee Committee Committee Cold Storage TWG 40 members from 13 organizations NG NVM* TWG *) NG NVM : Next Generation Non-Volatile Memory Green Storage TWG 11 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Cold Storage Technical Working Group Academic / Others Hardware / System vendors Tokyo Electron FUJITSU TOSHIBA Device Shibaura Institute of Technology HITACHI HITACHI LG SONY National Institute of Informatics Panasonic HGST NEC Tapes, Optical, HDD, Memory, Cloud, Object Storage TUV Rheinland Media vendors FUJIFILM Research Tapes for Long-term Archive MITSUBISHI Optical Discs KAGAKU MEDIA 12 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Discussion Part-1: (2014.7 – 2015.7) Definition of Cold Storage (“SNIA Japan” official version) 13 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Tape vendors’ opinions Strong market demand for Tape-based Cold Storage Most commonly used media as low-cost storage, large-capacity, and suitable for long-term archive. Good features for Cold storage Large capacity : Max 10TB (30TB with data compression) High transfer rate : Max 360MB/s (1080MB/s with compression) Low cost : Low-cost media, Low power consumption Long-term data preservation: More than 30 years of shelf life Security : Anti-Tamper specification(WORM), Encryption Availability : Data durability Verify while Writing, Strong error correction Linear Serpentine recording technology 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Optical vendors’ opinions Long-life and Highly reliable media Media life is over 50 years at normal temperature Excellent tolerance to any disasters Non-contact reading Most suitable media for compliance purpose True WORM Highly compatible between generations The first CD 34 years ago can be played back on current BD players!! Environmentally friendly media Can be stored OFFLINE without air-conditioning Reduced waste thanks to its migration free feature Advent of next generation optical technologies Much larger capacity & greater throughput 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. HDD vendors’ opinions Background of HDD based Cold Storage market demand Explosion of data requires Active Archive “Cold data” is getting warmer. When data becomes more accessible, its value increases. Required specification for HDD as Cold Storage Lower Cost : 20~30% lower cost against Near-line HDD Latency : Less than a second Reliability : Same as Near-line HDD Trade-Off Random Access New segmentation with nearline HDD Capacity • Any application Enterprise • Large capacity, High performance, Random access (PMR, He-PMR) • High reliability, Many functionality Nearline Active • Sequential write, Write in-frequently/ Read many Archive • Low latency against Tape/Optical disc (SMR) • Trade-off between performance & functionality and reliability Deep Archive • Write once/Read many (optical disc, • High latency Cold Storage Cold tape) • Lowest price/GB SMR(Shingled Magnetic Recording) 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. SSD vendors’ opinions SSD by NGD Systems HDD formerly NxGn Data Source: OCP 2x PCIe/NVMe FH-FL 30x 3.5” (4TB) SAS Capacity The same 128TB 120TB Active Power 90% savings 50 W 500 W Idle Power 99% savings 2 W 240 W Peak Power 91% savings 50 W 600 W Physical Space 95% savings 112 cubic inches 2400 cubic inches Trade-Off Weight 96% savings 1.5 lbs 43 lbs DWPD 0.4 (Drive Writes Per Day) 0.35 0.3 Operational Savings: 0.25 • Energy Savings (for operation) 0.2 SSD 0.15 HDD • Energy Savings (for cooling) 0.1 • Mechanical Failures 0.05 0 • Physical space Relative Cost $/GB Cost Relative 1 2 Today3 4 5 6 7 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. 17 SDS vendors’ opinions Lower cost configuration by using Common PC servers Get/Put/Delete by CIFS/NFS access Scale-out storage for unstructured rd http(RestAPI) by 3 party gateway data Get/Put/Delete by HTTP(RestAPI) Expandability Cluster Node Node Node Node Node Automatically adding data-node up to PB class capacity OS OS OS OS OS KVS: Key KVS:Value Key store Access by RESTful API X86 server X86 server X86 server X86 server X86 server Redundancy by data distribution CIFS/NFS are supported via gateway Example of distributed object storage Availability Data Center A Data Replication Error correction, Replication among Datacenters Issue Data Center B Heat Dissipation Media Data Center C Integrated HDDs in PC servers Trial to combine Optical storage 2016 Storage Developer Conference. © Insert Your Company Name. All Rights Reserved. Cloud vendors’ opinions Storage Service latency vs Cost/GB/month Graph shows relationship Service base price of cloud storage(\/GB/month) between Cloud Service 1000 Cost and Latency, media by media Jan 2014 July 2015 DRAM 100 Devices aligned in a line on Jan 2017 Flash logarithmic scale. HDD 10 Good matching with Low-speed SNIA Japan Forum Large Capacity HDD Optical End Users survey result. 1 Disc Latency(sec) Tape 1.0E-08 1.0E-06 1.0E-04 1.0E-02 1.0E+00 1.0E+02 1.0E+04 #1 Storage service price includes not only storage unit cost but also operation cost, electricity cost, DC facility cost, maintenance cost, and margin. 0.1 #2 This does not include additional/optional cost such as optional data transfer cost, communication cost, etc. Cold Storage 2016 Storage Developer Conference. © Insert Your Company Name. All Rights0.01 Reserved. Definition of Cold Storage Cold Storage is … “Data storage to store data which has relatively less demand for access (i.e. cold data) at a low cost.” It can be a Hardware, System or even Service. Sacrifice performance to achieve lower cost It typically includes features like below. Large capacity Long-term data preservation Not always needed! Lower power consumption, etc. 20 2016 Storage Developer Conference. ©