Collaboration with LTSI Testing
Yoshitake Kobayashi
Corporate Software Engineering Center Toshiba Corporation
Copyright 2014, Toshiba Corporation.
LTSI Workshop / Embedded Linux Conference 2014 2
LTSI Workshop / Embedded Linux Conference 2014 3
LTSI Workshop / Embedded Linux Conference 2014 4
LTSI Workshop / Embedded Linux Conference 2014 5
Patches available backport on upstream
LTSI-3.10
Patches available backport on Xilinx’s repository
LTSI Workshop / Embedded Linux Conference 2014 6
LTSI Workshop / Embedded Linux Conference 2014 7
LTSI Workshop / Embedded Linux Conference 2014 8
LTSI Workshop / Embedded Linux Conference 2014 9 This test case available at the following URL: https://github.com/ystk/fs-test Target Host Writer processes (N procs) Target files
Reset at random timing
write() system call
Each writer process
Logger • writes to text files (ex. 100 files) Log Host • sends progress log to logger
LTSI Workshop / Embedded Linux Conference 2014 10 Verify the following metrics • file size • file contents Estimated file contents OK NG OK NG Target file AAAAA AAAAA AAAAA AAAAA BBBBB BBBBB BBBBB BBBBB CCCCC CCCCC CCCCC CCCCC DDDDD DDDDD DDDDD DDDDD Checker EEEEE AAAAA EEEEE ? FFFFF Estimated file size LOG data mismatch size mismatch file
LTSI Workshop / Embedded Linux Conference 2014 11 2.00 45.9% File size mismatch 1.50 kernel [%] Data mismatch 2.6.18 1.00
0.50 Error rate Error
0.00 EXT3- EXT3- * * * JFS XFS ORDERED JOURNAL
2.00 13.3%
[%] 1.50 kernel 2.6.31 1.00
0.50 Error rate Error
0.00 EXT3- EXT3- EXT4- EXT4- * JFS XFS ORDERED JOURNAL JOURNAL ORDERED
2.00 43.2% 84.7% 82.4% 1.50 43.4% 41.4% kernel [%] 2.6.33 1.00 0.50
Error rate Error 0.00 EXT3- EXT3- EXT4- EXT4- EXT4- * XFS BTRFS ORDERED JOURNAL JOURNAL ORDERED WRITEBACK
LTSI Workshop / Embedded Linux Conference 2014 12 2.00 45.9% File size mismatch 1.50 kernel [%] Data mismatch 2.6.18 1.00
0.50 Point 1： Error rate Error 0.00 A file system has EXT3- EXT3- * * * JFS XFS ORDERED JOURNAL different characteristics 2.00 13.3% of data reliability
[%] 1.50 kernel 2.6.31 1.00
0.50 Error rate Error
0.00 EXT3- EXT3- EXT4- EXT4- * JFS XFS ORDERED JOURNAL JOURNAL ORDERED
2.00 43.2% 84.7% 82.4% 1.50 43.4% 41.4% kernel [%] 2.6.33 1.00 0.50
Error rate Error 0.00 EXT3- EXT3- EXT4- EXT4- EXT4- * XFS BTRFS ORDERED JOURNAL JOURNAL ORDERED WRITEBACK
LTSI Workshop / Embedded Linux Conference 2014 13 2.00 45.9% File size mismatch 1.50 kernel [%] Data mismatch 2.6.18 1.00
0.50 Point 1： Error rate Error 0.00 A file system has EXT3- EXT3- * * * JFS XFS ORDERED JOURNAL different characteristics 2.00 13.3% of data reliability
[%] 1.50 kernel 2.6.31 1.00
0.50 Point 2: Error rate Error
0.00 Some Results depends EXT3- EXT3- EXT4- EXT4- * JFS XFS ORDERED JOURNAL JOURNAL ORDERED on kernel version 2.00 43.2% 84.7% 82.4% 1.50 43.4% 41.4% kernel [%] 2.6.33 1.00 0.50
Error rate Error 0.00 EXT3- EXT3- EXT4- EXT4- EXT4- * XFS BTRFS ORDERED JOURNAL JOURNAL ORDERED WRITEBACK
LTSI Workshop / Embedded Linux Conference 2014 14 2.00 45.9% File size mismatch 1.50 kernel [%] Data mismatch 2.6.18 1.00
0.50 Point 1： Error rate Error 0.00 A file system has EXT3- EXT3- * * * JFS XFS ORDERED JOURNAL different characteristics 2.00 13.3% of data reliability
[%] 1.50 kernel 2.6.31 1.00
0.50 Point 2: Error rate Error
0.00 Some Results depends EXT3- EXT3- EXT4- EXT4- * JFS XFS ORDERED JOURNAL JOURNAL ORDERED on kernel version 2.00 43.2% 84.7% 82.4% 1.50 43.4% 41.4% kernel [%] 2.6.33 1.00 Point 3: 0.50 EXT4-Journal and BTRFS
Error rate Error 0.00 EXT3- EXT3- EXT4- EXT4- EXT4- * XFS BTRFS has a nice result ORDERED JOURNAL JOURNAL ORDERED WRITEBACK
LTSI Workshop / Embedded Linux Conference 2014 15 Issues • Long-term testing takes really long time → We want results as fast as possible Accelerate
START GOAL
Things that cannot be accelerated Focus to accelerate clock • CPU clock • I/O access speed (ex. SSD) • Network bandwidth Try to detect errors that caused • etc. by clock
LTSI Workshop / Embedded Linux Conference 2014 16 Xdaliclock works as a stopwatch
Returned an incorrect value after about 450 days. (It takes about 6 hours in 1000 times acceleration)
LTSI Workshop / Embedded Linux Conference 2014 17
LTSI Workshop / Embedded Linux Conference 2014 18
LTSI Workshop / Embedded Linux Conference 2014 19
LTSI Workshop / Embedded Linux Conference 2014 20
LTSI Workshop / Embedded Linux Conference 2014 21 LTSI Workshop / Embedded Linux Conference 2014 22