Tuning the Client Configuration File
Purpose
Modify client parameters based on physical machine resources to improve concurrency.
Procedure
- Modify the parameters in the storm.conf file based on your requirements.
Table 1 storm.conf File Parameter
Recommended Value
Description
hibench.streambench.storm.nimbus
Set this parameter based on the site requirements.
Primary Nimbus address.
hibench.streambench.storm.home
Set this parameter based on the site requirements.
Storm client address.
hibench.streambench.storm.worker_count
8
Number of workers, which is the same as the number of bolts. Each supervisor node corresponds to eight workers.
hibench.streambench.storm.spout_threads
16
Number of spouts. Change this value to twice the number of workers.
hibench.streambench.storm.bolt_threads
24
Equal to the number of workers (this parameter greatly affects the throughput).
- Modify the parameters in the hibench.conf file based on your requirements.
Table 2 hibench.conf File Parameter
Recommended Value
Description
hibench.streambench.kafka.home
Set this parameter based on the site requirements.
Kafka client address.
hibench.streambench.zkHost
Set this parameter based on the site requirements.
ZooKeeper address.
hibench.streambench.kafka.brokerList
Set this parameter based on the site requirements.
Broker node address.
hibench.streambench.datagen.recordsPerInterval
50000
Amount of data generated each time. Set this parameter based on the environment capability.