Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

COSBench Fails to Read Large Files

Problem Description

Table 1 Basic information

Item

Information

Source of the Problem

Online maintenance

Product

Kunpeng BoostKit

Sub-item

SDS

Service Scenario

Debugging and running

Component

Other

Output Time

2019-10-28

Author

Chen Xiaobo 00416232

Team

Kunpeng BoostKit

Review Result

Review passed

Review Date

2019-11-05

Release Date

2020-03-20

Keywords

Failed to read large files

Symptom

During the 256 KB get test, COSBench fails to read files.

Key Process and Cause Analysis

The default maximum size of files read by COSBench is 128 KB. The size of the tested files exceeds the limit.

Conclusion and Solution

  1. View COSBench logs.
    vim /path/to/cosbench/archive/workload/workload.log
    It consists the following error message: 
    Uploading large file fails with ResetException: Failed to reset the request input stream
  2. Add the following to the Java command line in the /path/to/cosbench/cosbench-start.sh script and modify the parameter value:
    -Dcom.amazonaws.sdk.s3.defaultStreamBufferSize=<YOUR_MAX_PUT_SIZE>