Testing 3FS

This section describes how to use the fio tool to test the read and write performance of the 3FS mount directory.

1. Use fio to test the concurrent read performance of 3FS on three clients.

   yum install fio -y
   fio -numjobs=128 -fallocate=none -iodepth=2 -ioengine=libaio -direct=1 \
   	-rw=read -bs=4M --group_reporting -size=100M -time_based -runtime=3000 \
   	-name=2depth_128file_4M_direct_read_bw -directory=/3fs/stage

   In the 4 MB concurrent read test, each client can achieve a bandwidth of 10 GB/s.

   

2. If necessary, use USRBIO on the client to test the read and write performance of the mount directory.

   1. Set temporary library paths.

   export LD_LIBRARY_PATH=/usr/local/lib64:/usr/local/lib:/usr/local:/usr/lib:/usr/lib64:$LD_LIBRARY_PATH

   2. Test USRBIO write.

   /home/fio/fio -numjobs=100 -fallocate=none -ioengine=external:/usr/lib64/hf3fs_usrbio.so -direct=1 -rw=write -bs=4M -group_reporting -filesize=500MB -nrfiles=20 -iodepth=1 -name=/3fs/stage/write_test -mountpoint=/3fs/stage -ior_depth=1

   The test result is as follows:

   

   3. Test USRBIO read.

   /home/fio/fio -numjobs=100 -fallocate=none -ioengine=external:/usr/lib64/hf3fs_usrbio.so -direct=1 -rw=read -bs=4M -group_reporting -filesize=500MB -nrfiles=20 -iodepth=1 -name=/3fs/stage/read_test -mountpoint=/3fs/stage -ior_depth=1

   The test result is as follows: