Verifying the Effect of Object Storage Compression

Configure the ~/.s3cfg file.

Press i to enter the insert mode and configure the file as follows:

[default]
access_key = access_key
secret_key = secret_key
host_base = rgw_host_ip:rgw_host_port
host_bucket = compress_ratio_bucket
use_https = False

**Table 1** Parameter description
Parameter	Description
access_key	Set this parameter to the actual access key of the S3 user.
secret_key	Set this parameter to the actual secret key of the S3 user.
host_base	Set this parameter to the actual IP address and port number of the RGW gateway.

Press Esc to exit the insert mode. Type :wq! and press Enter to save the file and exit.

Create a bucket.
1
s3cmd mb s3://compress_ratio_bucket
Keep a 100 MB test file ready for the test.
1
dd if=/dev/zero of=/home/compress_test bs=1M count=100
You can also use a real dataset file.

Write the data.

s3cmd put /home/compress_test s3://compress_ratio_bucket/test

Verify the compression effect.
1
radosgw-admin bucket stats --bucket=compress_ratio_bucket
size_kb_actual indicates that the size of the raw data is 100 MB. size_kb_utilized indicates that the size of the data is 4 KB after compression. Therefore, the compression ratio is 102,400/4 = 25,600. In the example, all-zero data is used, so the compression ratio is high. The compression ratio of actual datasets typically ranges from 2 to 10.

Parent topic: Verifying the Compression algorithm