Revision [4092]
Last edited on 2011-08-10 19:50:11 by KenFongAdditions:
./iozone -M -l2 -u2 -r1m -s512m -i0 -i1 -i2 -F /storage/t1 /storage/t2
# 3 threads, 1m record size, 512M, read/write/random tests only.
# 3 threads, 1m record size, 512M, read/write/random tests only.
Deletions:
# 3 threads, 4k size, 512M, read/write/random tests only.
Revision [4043]
Edited on 2011-06-24 18:06:54 by KenFongAdditions:
Compared with a LinuxVM sitting on san
Operations performed: 6002 Read, 3999 Write, 401 Other = 10402 Total
Read 93.781Mb Written 62.484Mb Total transferred 156.27Mb (89.85Mb/sec)
5750.43 Requests/sec executed
total time: 1.7392s
total number of events: 10001
total time taken by event execution: 6.1917
min: 0.00ms
max: 369.01ms
approx. 95 percentile: 1.55ms
events (avg/stddev): 2500.2500/370.49
execution time (avg/stddev): 1.5479/0.12
Operations performed: 6002 Read, 3999 Write, 401 Other = 10402 Total
Read 93.781Mb Written 62.484Mb Total transferred 156.27Mb (89.85Mb/sec)
5750.43 Requests/sec executed
total time: 1.7392s
total number of events: 10001
total time taken by event execution: 6.1917
min: 0.00ms
max: 369.01ms
approx. 95 percentile: 1.55ms
events (avg/stddev): 2500.2500/370.49
execution time (avg/stddev): 1.5479/0.12
Deletions:
Operations performed: 6002 Read, 4003 Write, 400 Other = 10405 Total
Read 93.781Mb Written 62.547Mb Total transferred 156.33Mb (5.615Mb/sec)
359.36 Requests/sec executed
total time: 27.8411s
total time taken by event execution: 16.9815
avg: 1.70ms
max: 229.97ms
events (avg/stddev): 2501.2500/139.28
execution time (avg/stddev): 4.2454/0.09
Revision [4042]
Edited on 2011-06-24 18:00:54 by KenFongAdditions:
Compared with 2xWD 640G 7200rpm
Operations performed: 6002 Read, 4003 Write, 400 Other = 10405 Total
Read 93.781Mb Written 62.547Mb Total transferred 156.33Mb (5.615Mb/sec)
359.36 Requests/sec executed
total time: 27.8411s
total time taken by event execution: 16.9815
avg: 1.70ms
max: 229.97ms
events (avg/stddev): 2501.2500/139.28
execution time (avg/stddev): 4.2454/0.09
Operations performed: 6002 Read, 4003 Write, 400 Other = 10405 Total
Read 93.781Mb Written 62.547Mb Total transferred 156.33Mb (5.615Mb/sec)
359.36 Requests/sec executed
total time: 27.8411s
total time taken by event execution: 16.9815
avg: 1.70ms
max: 229.97ms
events (avg/stddev): 2501.2500/139.28
execution time (avg/stddev): 4.2454/0.09
Deletions:
Running the test with following options:
Number of threads: 4
Extra file open flags: 0
4 files, 128Mb each
512Mb total file size
Block size 16Kb
Number of random requests for random IO: 10000
Read/Write ratio for combined random IO test: 1.50
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random r/w test
Threads started!
Done.
Revision [4041]
Edited on 2011-06-24 17:58:48 by KenFongAdditions:
==sysbench==
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw prepare
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw run
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw cleanup
Result on Seagate hybrid:
sysbench 0.4.12: multi-threaded system evaluation benchmark
Running the test with following options:
Number of threads: 4
Extra file open flags: 0
4 files, 128Mb each
512Mb total file size
Block size 16Kb
Number of random requests for random IO: 10000
Read/Write ratio for combined random IO test: 1.50
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random r/w test
Threads started!
Done.
Operations performed: 6001 Read, 4004 Write, 396 Other = 10401 Total
Read 93.766Mb Written 62.562Mb Total transferred 156.33Mb (3.8785Mb/sec)
248.22 Requests/sec executed
Test execution summary:
total time: 40.3067s
total number of events: 10005
total time taken by event execution: 6.2396
per-request statistics:
min: 0.01ms
avg: 0.62ms
max: 350.00ms
approx. 95 percentile: 0.11ms
Threads fairness:
events (avg/stddev): 2501.2500/34.74
execution time (avg/stddev): 1.5599/0.18
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw prepare
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw run
sysbench --test=fileio --num-threads=4 --file-num=4 --file-total-size=512M --file-test-mode=rndrw cleanup
Result on Seagate hybrid:
sysbench 0.4.12: multi-threaded system evaluation benchmark
Running the test with following options:
Number of threads: 4
Extra file open flags: 0
4 files, 128Mb each
512Mb total file size
Block size 16Kb
Number of random requests for random IO: 10000
Read/Write ratio for combined random IO test: 1.50
Periodic FSYNC enabled, calling fsync() each 100 requests.
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random r/w test
Threads started!
Done.
Operations performed: 6001 Read, 4004 Write, 396 Other = 10401 Total
Read 93.766Mb Written 62.562Mb Total transferred 156.33Mb (3.8785Mb/sec)
248.22 Requests/sec executed
Test execution summary:
total time: 40.3067s
total number of events: 10005
total time taken by event execution: 6.2396
per-request statistics:
min: 0.01ms
avg: 0.62ms
max: 350.00ms
approx. 95 percentile: 0.11ms
Threads fairness:
events (avg/stddev): 2501.2500/34.74
execution time (avg/stddev): 1.5599/0.18
Revision [4008]
Edited on 2011-06-05 02:06:37 by KenFongAdditions:
~===[[FileSystemsBenchMarkSDD]]===
Deletions:
Revision [4007]
Edited on 2011-06-05 02:06:22 by KenFongAdditions:
===File Systems Benchmarks===
===~[[FileSystemsBenchMarkSDD]]===
===~[[FileSystemsBenchMarkSDD]]===
Revision [3731]
Edited on 2010-06-29 22:41:23 by KenFongAdditions:
EXT4 - 4 LVM stripes over SAN storage
bonnie++ -d /OS -r 512 -u root -s 2g -n0 -q -f -b
Version 1.03e ------Sequential Output------ --Sequential Input- --Random-
mongodb2.thumbpl 2G 87118 99 205443 57 1873668 99 3210 6
mongodb2.thumbplay.com,2G,,,87118,99,205443,57,,,1873668,99,3209.6,6,,,,,,,,,,,,,
bonnie++ -d /OS -r 512 -u root -s 2g -n0 -q -f -b
Version 1.03e ------Sequential Output------ --Sequential Input- --Random-
mongodb2.thumbpl 2G 87118 99 205443 57 1873668 99 3210 6
mongodb2.thumbplay.com,2G,,,87118,99,205443,57,,,1873668,99,3209.6,6,,,,,,,,,,,,,
Revision [3583]
Edited on 2009-11-24 08:42:01 by WikiAdminAdditions:
"The tests performed by IOzone measure many things, starting with the simpler metrics such as read, write, reread, and rewrite performance. Read and write are obvious. Reread is measures how well a system caches a file that was recently read. There are two rewrite tests; the one reported as simply rewrite overwrites an existing file. The record rewrite writes to a specific location in a file over and over again. " http://www.linux.com/archive/feature/139744
Revision [3582]
Edited on 2009-11-24 08:39:58 by WikiAdminAdditions:
./iozone -l3 -u3 -r4k -s512m -i0 -i1 -i2 -F /storage/t1 /storage/t2 /storage/t3
# 3 threads, 4k size, 512M, read/write/random tests only.
Output
Command line used: iozone -l3 -u3 -r16k -s512m -i0 -i1 -i2 -F /opt/t1 /opt/t2 /opt/t3
Output is in Kbytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 Kbytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
Min process = 3
Max process = 3
Throughput test with 3 processes
Each process writes a 524288 Kbyte file in 16 Kbyte records
Children see throughput for 3 initial writers = 190551.92 KB/sec
Parent sees throughput for 3 initial writers = 95358.14 KB/sec
Min throughput per process = 59399.04 KB/sec
Max throughput per process = 67102.94 KB/sec
Avg throughput per process = 63517.31 KB/sec
Min xfer = 464848.00 KB
Children see throughput for 3 rewriters = 192879.43 KB/sec
Parent sees throughput for 3 rewriters = 97202.22 KB/sec
Min throughput per process = 61424.02 KB/sec
Max throughput per process = 67892.16 KB/sec
Avg throughput per process = 64293.14 KB/sec
Min xfer = 475440.00 KB
Children see throughput for 3 readers = 5169973.62 KB/sec
Parent sees throughput for 3 readers = 5043432.88 KB/sec
Min throughput per process = 1274313.12 KB/sec
Max throughput per process = 2559450.75 KB/sec
Avg throughput per process = 1723324.54 KB/sec
Min xfer = 254640.00 KB
Children see throughput for 3 re-readers = 5141331.25 KB/sec
Parent sees throughput for 3 re-readers = 5082621.95 KB/sec
Min throughput per process = 1280551.88 KB/sec
Max throughput per process = 2565787.75 KB/sec
Avg throughput per process = 1713777.08 KB/sec
Min xfer = 259664.00 KB
Children see throughput for 3 random readers = 4574113.12 KB/sec
Parent sees throughput for 3 random readers = 4539378.00 KB/sec
Min throughput per process = 1218295.25 KB/sec
Max throughput per process = 2109693.00 KB/sec
Avg throughput per process = 1524704.38 KB/sec
Min xfer = 303872.00 KB
Children see throughput for 3 random writers = 49672.07 KB/sec
Parent sees throughput for 3 random writers = 30601.92 KB/sec
Min throughput per process = 15888.48 KB/sec
Max throughput per process = 17488.86 KB/sec
Avg throughput per process = 16557.36 KB/sec
Min xfer = 476272.00 KB
# 3 threads, 4k size, 512M, read/write/random tests only.
Output
Command line used: iozone -l3 -u3 -r16k -s512m -i0 -i1 -i2 -F /opt/t1 /opt/t2 /opt/t3
Output is in Kbytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 Kbytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
Min process = 3
Max process = 3
Throughput test with 3 processes
Each process writes a 524288 Kbyte file in 16 Kbyte records
Children see throughput for 3 initial writers = 190551.92 KB/sec
Parent sees throughput for 3 initial writers = 95358.14 KB/sec
Min throughput per process = 59399.04 KB/sec
Max throughput per process = 67102.94 KB/sec
Avg throughput per process = 63517.31 KB/sec
Min xfer = 464848.00 KB
Children see throughput for 3 rewriters = 192879.43 KB/sec
Parent sees throughput for 3 rewriters = 97202.22 KB/sec
Min throughput per process = 61424.02 KB/sec
Max throughput per process = 67892.16 KB/sec
Avg throughput per process = 64293.14 KB/sec
Min xfer = 475440.00 KB
Children see throughput for 3 readers = 5169973.62 KB/sec
Parent sees throughput for 3 readers = 5043432.88 KB/sec
Min throughput per process = 1274313.12 KB/sec
Max throughput per process = 2559450.75 KB/sec
Avg throughput per process = 1723324.54 KB/sec
Min xfer = 254640.00 KB
Children see throughput for 3 re-readers = 5141331.25 KB/sec
Parent sees throughput for 3 re-readers = 5082621.95 KB/sec
Min throughput per process = 1280551.88 KB/sec
Max throughput per process = 2565787.75 KB/sec
Avg throughput per process = 1713777.08 KB/sec
Min xfer = 259664.00 KB
Children see throughput for 3 random readers = 4574113.12 KB/sec
Parent sees throughput for 3 random readers = 4539378.00 KB/sec
Min throughput per process = 1218295.25 KB/sec
Max throughput per process = 2109693.00 KB/sec
Avg throughput per process = 1524704.38 KB/sec
Min xfer = 303872.00 KB
Children see throughput for 3 random writers = 49672.07 KB/sec
Parent sees throughput for 3 random writers = 30601.92 KB/sec
Min throughput per process = 15888.48 KB/sec
Max throughput per process = 17488.86 KB/sec
Avg throughput per process = 16557.36 KB/sec
Min xfer = 476272.00 KB
Deletions:
# two threads, 4k size, 512M test
Revision [2270]
Edited on 2009-04-08 00:00:55 by WikiAdminAdditions:
Show iostat
iostat -Nx
iostat -Nx
Revision [2185]
Edited on 2009-02-05 05:52:08 by WikiAdminAdditions:
# This produce cleaner output. Output=write, Input=read
bonnie++ -d /storage -r 512 -u root -s 2g -n0 -q -f -b
bonnie++ -d /storage -r 512 -u root -s 2g -n0 -q -f -b
Revision [2184]
Edited on 2009-02-05 05:42:09 by WikiAdminAdditions:
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 10525 34 +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 13829 43 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 32444 99 +++++ +++ +++++ +++
===Another test (IOZone)===
http://www.iozone.org/
./iozone -l 2 -u 2 -r 4k -s 512m -F /storage/f1 /storage/f2
# two threads, 4k size, 512M test
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 10525 34 +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 13829 43 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 32444 99 +++++ +++ +++++ +++
===Another test (IOZone)===
http://www.iozone.org/
./iozone -l 2 -u 2 -r 4k -s 512m -F /storage/f1 /storage/f2
# two threads, 4k size, 512M test
Deletions:
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 10525 34 +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 13829 43 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ 32444 99 +++++ +++ +++++ +++
Revision [1250]
Edited on 2008-01-04 21:57:07 by WikiAdminAdditions:
# Updated - specify -n 1 to test the creation of 1024 files
bonnie++ -d /tmp -r 512 -u root -s 1g -n 1
bonnie++ -d /tmp -r 512 -u root -s 1g -n 1
Revision [1210]
Edited on 2007-11-28 09:37:40 by WikiAdminAdditions:
**In this test**, JFS & ReiserFS offer the best read performance, while XFS offers the best write performance. But that's just sequential read/write of a not-so-large file. I've had some good experience with Oracle on JFS and some bad ones with ReiserFS. ReiserFS4 and ext4 have promising performance but I'm too lazy to get my kernel to support them, and they may not be as matured as the others.
One also have to take into consideration about how often random access is used. Certainly not to under-estimate the effect that ext3 is officially supported and is widely used for obvious reasons. Think about when your fs crashes, you certainly don't want to learn that the fs is not supported by your favorate live-cd/rescue-cd.
One also have to take into consideration about how often random access is used. Certainly not to under-estimate the effect that ext3 is officially supported and is widely used for obvious reasons. Think about when your fs crashes, you certainly don't want to learn that the fs is not supported by your favorate live-cd/rescue-cd.
Deletions:
So, it's your call.
Revision [1209]
Edited on 2007-11-28 09:33:40 by WikiAdminAdditions:
==Conclusion==
**In this test**, JFS & ReiserFS offer the best read performance, while XFS offers the best write performance. Of course ext3 is the only filesystem officially supported. I've had some good experience with Oracle on JFS and some bad ones with ReiserFS. ReiserFS4 and ext4 have promising performance but I'm too lazy to get my kernel to support them, and they may not be as matured as the others.
So, it's your call.
**In this test**, JFS & ReiserFS offer the best read performance, while XFS offers the best write performance. Of course ext3 is the only filesystem officially supported. I've had some good experience with Oracle on JFS and some bad ones with ReiserFS. ReiserFS4 and ext4 have promising performance but I'm too lazy to get my kernel to support them, and they may not be as matured as the others.
So, it's your call.
Revision [1208]
Edited on 2007-11-28 09:29:55 by WikiAdminAdditions:
ReiserFS3 - yum install reiserfs-utils
ism.comme.ca 256M 76964 96 30437 5 16506 1 103556 99 +++++ +++ +++++ +++
16 +++++ +++ +++++ +++ +++++ +++ 32444 99 +++++ +++ +++++ +++
ism.comme.ca 256M 76964 96 30437 5 16506 1 103556 99 +++++ +++ +++++ +++
16 +++++ +++ +++++ +++ +++++ +++ 32444 99 +++++ +++ +++++ +++
Deletions:
N/A
Revision [1207]
Edited on 2007-11-28 09:23:07 by WikiAdminAdditions:
ReiserFS3 - Can't get reiserfsprogs to compile. http://www.namesys.com/
N/A
N/A
Revision [1206]
Edited on 2007-11-28 09:15:33 by WikiAdminAdditions:
# create a file used as the test partition
dd if=/dev/zero of=/dev/testdrv bs=1024k count=1024
mkfs.??? /testdrv
mount -oloop -t??? /dev/testdrv /mnt/test
# Test with 256M file, limiting memory to 128M
bonnie++ -s256 -r128 -uroot -d/mnt/test
ism.comme.ca 256M 67760 99 105487 18 +++++ +++ 62100 99 +++++ +++ +++++ +++
dd if=/dev/zero of=/dev/testdrv bs=1024k count=1024
mkfs.??? /testdrv
mount -oloop -t??? /dev/testdrv /mnt/test
# Test with 256M file, limiting memory to 128M
bonnie++ -s256 -r128 -uroot -d/mnt/test
ism.comme.ca 256M 67760 99 105487 18 +++++ +++ 62100 99 +++++ +++ +++++ +++
Deletions:
ism.comme.ca 256M 63196 89 438416 62 +++++ +++ 103752 100 +++++ +++ +++++ +++
Revision [1205]
Edited on 2007-11-28 09:12:10 by WikiAdminAdditions:
XFS - Get xfsprogs from ftp://oss.sgi.com/projects/xfs/cmd_tars or yum install xfsprogs
ism.comme.ca 256M 94347 96 +++++ +++ +++++ +++ 71158 99 +++++ +++ +++++ +++
16 13829 43 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
ism.comme.ca 256M 94347 96 +++++ +++ +++++ +++ 71158 99 +++++ +++ +++++ +++
16 13829 43 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++