Azure File Service: File Azure White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Home , Azure (color)

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Light Yellow Light Orange Light Magenta Light Purple Light Blue Light Teal Light Green R255 G241 B0 R255 G140 B0 R227 G0 B140 R180 G160 B255 R0 G188 B242 R0 G178 B148 R186 G216 B10 Yellow Orange Red Magenta Purple Blue Teal Green R255 G185 B0 R216 G59 B1 R232 G17 B35 R180 G0 B158 R92 G45 B145 R0 G120 B215 R0 G130 B114 R16 G124 B16 Mid Blue R0 G24 B143

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

Microsoft

David Goebel David

Expectations vs. Reality on the Public Cloud Public the on Reality vs. Expectations Azure File Service: File Azure White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 years

four four

What we’ve learned in the past past the in learned we’ve What by a conventional file system file conventional a by The design of an SMB server not backed not server SMB an of design The The features, API surfaces and scenarios scenarios and surfaces API features, The Survey of SMB landscape @MS landscape SMB of Survey

Azure File Service File Azure

enabled

0. Talk Topics: Talk White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 of baggage. of and compound commands. commands. and compound lots Irps

negotiate and other security features. security other and negotiate clusters. enhancements. 3.0.2 added Win8.1: SMB cluster encryption 3.1.1 adds SMB negotiated secure Win10: algorithm, multichannel & RDMA (SMB Direct), and persistent handles to to handles and persistent Direct), RDMA (SMB & multichannel on SODA hosted shares supportAvailable) CA (Continuously supersede the older oplock scheme taken from 1.3 from taken scheme oplock older the supersede SMB 3.0 added Win8: encryption, directoryon leases handles, Durable handles allowed handles to be reconnect after a network afternetwork a reconnect be to handles allowed handles Durable hiccup. which “leases” handles and resilient SMB 2.1 introduced Win7: Vista: SMB 2.02 was a vast simplification to reduce chattiness and chattiness reduce to simplification was a SMB 2.02 Vista:vast NT commands to map SMB <= Srv03<= and was V1.3 carried

• •

• • • • SMB Protocol History Protocol SMB White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

SMB2] - [MS White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

Azure File Service not CMU’s Andrew File System. I wasn’t on the naming committee. committee. naming the on wasn’t I System. File Andrew CMU’s not Service File Azure

¹ AFS¹ Fundamental Concepts Fundamental AFS¹

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Current AFS Status/Limits AFS Current White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Yes No No No No SMB3 Encryption No Yes No Yes Yes Yes SMB3 Persistent Persistent SMB3 Handles Yes 2.08 2.08 2.08 2.09 2.03 CIFS CIFS Version 2.03 - - 4 - - 78 - - - 4.4.59 4.4.0 4.4.70 18.9.1 92.20.2 Kernel Kernel Version generic 4.13 3.10.0 514.10.2.el7 3.16.0 generic SUSE SUSE Publisher Canonical Canonical Wave Rogue Software Credativ

17.10

SP3 Linux Enterprise LinuxEnterprise

Current Linux Support Linux Current

Server Server 12 SUSE Open SUSE Leap 42.2 Open SUSE Debian 8 Debian CentOS 7.3 CentOS Ubuntu Server Server Ubuntu Ubuntu Server LTS Server 16.04 Ubuntu Linux Distribution Linux

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Note: Port 445 outbound must be unblocked. be must outbound 445 Port Note:

Scenario Enabled Enabled Encryption SMB3

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 DEMO

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Scenarios Enabled By AFS By Enabled Scenarios

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 What about REST? about What

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Leveraging Azure Table Infrastructure Table Azure Leveraging White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 It is a hybrid type, keyed by by keyed type, hybrid a is It locks (64bit like NTFS). (64bit FileId to files and directories.and files to or FileName 1 with Azure containers. Azure with 1 - allocated file ranges and their backing page blobs. page backing their and rangesfile allocated All currently active SMB leases.SMB active currentlyAll notifies. change Registered range byte active currently All A table of all files and directories. and files all of table A either The handles openAll

Change Notify Change Locks Range Byte Handle Lease File Page An AFS share’s metadata is stored as a collection of of collection a as stored is metadata share’s AFS An are: which of notable most the tables, AFS shares are 1 are shares AFS

• • AFS Tables AFS

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Typical namespace requests namespace Typical White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 nodes. EN EN Node N Node N Node Front End Front ...... EN Node 1 Node Node 2 Node service manages moving partition ownership in ownership partition moving manages service Front End Front TableMaster EN Node 0 Node Node 1 Node Front End Front nodes receive connections from clients. Any FE node can service any share. any service can node FE Any clients. from connections receive nodes

Back End Back

Node 0 Node

Front End Front

Table Node X Node Table FrontEnd the case of BE node failure or for load balancing. Page blobs are managed by by managed are blobs Page balancing. load for or failure node BE of case the Currently a single share/container is within a single partition which is at any time “owned” time any at is which partition single a within is share/container single a Currently A Node. Table BE single a by Mapping AFS to hardware to AFS Mapping

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Achieving active/active high availability high active/active Achieving

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Tiering State By Durability Requirement Durability By State Tiering White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

but not all states require expensive distributed distributed expensive require states all not but

transactional semantics transactional SMB is a stateful protocol, protocol, stateful a is SMB White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 445 : 32 . 217 Node N Node . Front End Front 56 . Load Balancer Load ...... DNS for example 157 example for Node 2 Node Front End Front ”: Ephemeral state and immutable state. immutable and state Ephemeral ”: ”: Solid and Fluid durable state. durable Fluid and Solid ”: ShareName \ Detailsslide in next BackEnd FrontEnd “ “ Node 1 Node Front End Front Azure Table and Blob Store Table Azure .file.core.windows.net

Node 0 Node AccountName \

Front End Front \ White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 , open handles handles open , dirs 1 relation between share and and share between relation 1 - Azure Table and Blob Store Table Azure

associated, allowing transactions across them. across transactions allowing associated, Our tables for the various metadata are specially specially are metadata various the for tables Our Currently we have a 1 a have we Currently partition. Table operations are transactional within a partition. a within transactional are operations Table store metadata associated with files/ with associated metadata store state. other and them to AFS uses the underlying Azure Tables infrastructure to to infrastructure Tables Azure underlying the uses AFS

•

• • White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 premises - Node N Node Front End Front Clients A & B both accessingboth B & the A Clients samevia thesame share/files name.DNS Samethey were coherency as if on a singletalkingto server. • • ...... Node 2 Node MyShare Front End Front \ MySrv \ \ Client B accessing Client Node 1 Node Front End Front Azure Table and Blob Store Table Azure MyShare \

MySrv \ Node 0 Node Client A accessing A accessing Client \ Front End Front White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Node N Node Front End Front Clients B loses connection B FE1 Clients to a dueFE1 goes to or down(either intentionalsortorof some failure upgrade).software • ...... Node 2 Node MyShare Front End Front \ MySrv \ \ Client B accessing Client Node 1 Node Front End Front Azure Table and Blob Store Table Azure MyShare \

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 . ClientB and the Loadtheand MyShare Node N Node \ Front End Front MySrv \ \ Thisto is completely*transparent runningany onapplication Client B automatically reconnectsB automaticallyClient to BalancerselectsFE. new a completely completely with mostly with SMB3, SMB2.1 * • • ...... Node 2 Node MyShare Front End Front \ MySrv \ \ Client B accessing Client Node 1 Node Front End Front Azure Table and Blob Store Table Azure MyShare \

Mid Blue R0 G24 B143

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

“Solid” here meaning the state is generated by AFS and not generally changeable by normal by normal not generally and changeable AFS by is generated the state “Solid” meaning here while client/application the “Fluid” is by of File fully actions changeable APIs. Examples of state tiering state of Examples

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Example: Durable Handle Reconnect Handle Durable Example:

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Example: Persistent Handles Persistent Example:

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Observations and Lessons Learned Learned Lessons and Observations White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28

Points Points Pain Pain Specific Specific White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 - - available - https://azure.microsoft.com/en generally us/library/azure/dn744326.aspx - - now - service.aspx - storage - file - file - azure -

https://msdn.microsoft.com/library/azure/dn167011.aspx https://msdn.microsoft.com/en us/blog/azure microsoft http://blogs.msdn.com/b/windowsazurestorage/archive/2014/05/12/introducing Resources:

White Light Gray Gray Mid Gray Dark Gray Rich Black R255 G255 B255 R230 G230 B230 R210 G210 B210 R115 G115 B115 R80 G80 B80 R0 G0 B0

Dark Red Dark Magenta Dark Purple Dark Blue Dark Teal Dark Green R168 G0 B0 R92 G0 B92 R50 G20 B90 R0 G32 B80 R0 G75 B80 R0 G75 B28 Thank you Thank