Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

Tuning Guidelines

  1. You are advised to set the number of partitions based on the number of disks. Generally, the number of partitions is one to two times the total number of disks on all data nodes.
  2. If possible, separate the data nodes from the Kafka test clients to avoid the impact of client production data on the data nodes.
  3. Increase the number of threads used by Kafka to process network and I/Os as far as possible.
  4. Multiple threads can be started on the host to start the Kafka test commands, and the concurrent consumers is about two to three times as many as the concurrent producers. You can adjust them based on the scenario requirements. For example, 10 kafka-perf threads (commands) are started in the production scenario, and 30 threads (consumption commands) are started in the consumption scenario to consume data.
Parent topic: Introduction