Benchmarking Linux Filesystems for Database Performance – Revisited K.S. Bhaskar Development Director" F# [email protected] %& (6&)) 5,-./0(+ Background & Motivation • Database workloads interest us" as the develo!ers of FIS GT.45 – Es!ecially transactional 1orkloads • Platform for the three largest real.time core.banking systems in the world that we know of – databases of a fe1 3B" 1)"))) concurrent users (plus 1eb users" 734 net1orks" voice res!onse units" etc.* • Increasingly used for electronic health records – Es!ecially 8o 9L ':8ot ;nly 9L<) data – =ses P; #> APIs • Benchmarking com!lete a!!lications is hard – 8ot widely available • Licenses often re?uire permission to publish benchmark results – 3ypically com!lex" requiring expertise to configure & operate • Benchmarking re?uires re!eatability • Ideally “dro! dead sim!le< • '=!date work presented at Linux Enterprise End User Summit 20&)* GT.M Daemonless Database Engine 7!!lication 7!!lication ... !rocess !rocess hared memory buffer !ool and control structures Database file Concurrent Multi-process Workloads • ioAthrash – :Download" com!ile" run” – 78SI C – originally developed in 0))/C u!dated for current gcc releases – Publicly released in 0))- • threeen1f – 3n+& se?uence lengths – :Download" install" run< • (But 1e did change default !arameters a little* – Developed as benchmark and sam!le program for Eikipedia page – Publicly released in 0)&) Nuts and Bolts • BP= – AMD Phenom II X4 F(+ Processor @ 3.42GH • RAM – 82iB DDR3 @1.6GGH in 2 banks of /2iB • Disk – 2x Seagate Barracuda S3&)))DM))D; benchmark filesystems in logical volumes striped across both drives • ; – 6/.bit Ubuntu 12.&) • Filesystems – default mount o!tions exce!t nodataco1 for btrfs • Results – usually the median of at least three runs" exce!t – btrfs & extD io_thrash (t1o runs for 0)")))"))) #;s* – Ifs io_thrash (one run for 0)")))"))) #;s* Elapsed Seconds – io_thrash nIo btrfs extD ext/ Jfs xfs 0)"))) ).DD ).&( ).&0 ).&) ).F( 0))"))) D.)F D,.+& &.0, ).F/ F.++ 0")))"))) D+F.&+ /"/++.,( ,+&.FD -//.&& (,-.+- 0)")))"))) ,0"F&F./0 &)F",FF.0( D0"/&,.+) D)"D&,.(& D)"F&+./& &))"))).) &)"))).) &"))).) s d btrfs n o c e ext3 &)).) d ext4 e s ! Jfs a l 6 &).) xfs &.) ).& 0)))) 0))))) 0)))))) 0))))))) 8umber of #;s Elapsed Seconds – 3n+1 Range end btrfs extD ext/ Jfs xfs &))"))) & & & & & &")))"))) / + + + + &)")))"))) -D &"(0) -D &D+ -+ &))")))"))) &+"&&/ /D"D+/ -"(F+ &+"&+) ("/DF +)))) +))) s d +)) btrfs n o c e ext3 d ext4 e s ! +) Jfs a l 6 xfs + ).+ &))))) &)))))) &))))))) &)))))))) Range 6nd Reads/Second – 3n+1 Range end btrfs extD ext/ jfs xfs &))"))) D&-")&0 D&,",&- D&,"-D- D&,",&0 D&,",,, &")))"))) ,F0"+&( (DD"F-- (D/")0, (DD"F,0 (D/")&( &)")))"))) D-0"D0F &F"+-F D-0"D0D 0D("/FD D,,",-D &))")))"))) 0)"FFD ,"D&F D("/F0 0)"F/F /F"0-, ,))))) d btrfs n o c ext3 e ,)))) s K s ext4 d a e Jfs R xfs ,))) &))))) &)))))) &))))))) &)))))))) Range 6nd Updates/Second – 3n+1 Range end btrfs extD ext/ jfs xfs &))"))) 0&-")&0 0&,",&- 0&,"-D- 0&,",&0 0&,",,, &")))"))) +/0"+&( /DD"F-- /D/")0, /DD"F,0 /D/")&( &)")))"))) 0(&"-/, &D"/&( 0(&"-/& &(&"F(F 0+-",D( &))")))"))) &/"D,, +")&0 0/"FF& &/"D/, DD",+/ +))))) d n btrfs o c e extD s K +)))) s e ext/ t a d Jfs ! = xfs +))) &))))) &)))))) &))))))) &)))))))) Range 6nd Results • xfs is best • ext4 is a good choice • Jfs met ex!ectations • btrfs was a pleasant surprise • Avoid extD Links • FIS GT.M home page: htt!LKKfis.gtm.com • This !resentation: htt!LKKtinco.!air.comKbhaskarKgtmKdocKmiscK&D)+&).&LinuxFileSystemBenchmarks.!df • Go1 To: htt!LKKtinco.!air.comKbhaskar/gtmKdocKmiscK&D)+&0.&LF BenchmarkGow3o.!df • Ra1 Data: htt!LKKtinco.!air.comKbhaskarKgtmKdocKmiscK&D)/0D.&FilesystemBenchmarkData.ods • lshw of platformL htt!LKKtinco.!air.comKbhaskarKgtmKdocKmiscK&D)+&0.2LFSBenchmarklshw.txt • K.S. Bhaskar K ks.bhaskar$fisglobal.com K %& (6&)) +,-./0(+ Questions / Discussion.