Test Procedure

The following uses 500 files (each 1200 MB) as an example. Run the following command on the server1 node to perform the test:

/usr/local/hadoop/bin/hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.0-tests.jar TestDFSIO -write -nrFiles 500 -size 1200MB -compression org.apache.hadoop.io.compress.GzipCodec

-write indicates a write test.

-nrFiles 500 indicates 500 files.

-size 1200MB indicates that the size of each file is 1200 MB.

-compression org.apache.hadoop.io.compress.GzipCodec indicates that gzip compression is used.