Rate This Document
Findability
Accuracy
Completeness
Readability

Typical Configuration

Table 1 describes the configuration of each component in real-time search scenarios.

Table 1 Typical configuration in big data real-time search scenarios

Node Type

Typical Configuration

Node Quantity

Quantity Calculation

Management node

Two-socket rack server, two Huawei Kunpeng 916 or Kunpeng 920 processors, 128 GB or larger memory, six 600 GB or larger 2.5-inch SAS drives, 1 GB LSI RAID 0/1 card (more than three RAID 1 arrays are supported), two 10GE network ports, two GE network ports (the two network ports are bonded and connected to two access switches), and independent power supply

2

Active/standby architecture: one active node + one standby node

Controller node

Two-socket rack server, two Huawei Kunpeng 916 or Kunpeng 920 processors, 256 GB or larger memory, ten 600 GB or larger 2.5-inch SAS drives, 1 GB LSI RAID 0/1 card (more than five RAID 1 arrays are supported), two 10GE network ports, two GE network ports (the two network ports are bonded and connected to two access switches), and independent power supply

3/5/9/11

  • A cluster with 30 to 100 nodes: three controller nodes
  • A cluster with 100 to 500 nodes: five controller nodes
  • A cluster with 500 to 2000 nodes: nine controller nodes
  • A cluster with 2000 to 5000 nodes: 11 controller nodes

Management and controller nodes (hybrid deployment)

Two-socket rack server, two Huawei Kunpeng 916 or Kunpeng 920 processors, 256 GB or larger memory, twelve 600 GB or larger 2.5-inch SAS drives, 1 GB LSI RAID 0/1 card (more than six RAID 1 arrays are supported), two 10GE network ports, two GE network ports (the two network ports are bonded and connected to two access switches), and independent power supply

3

A cluster with 3 to 30 nodes

Elasticsearch node

Two-socket rack server, two Huawei Kunpeng 916 or Kunpeng 920 processors, 256 GB or larger memory, two 600 GB or larger 2.5-inch SAS drives, twenty-four 1.2 TB 2.5-inch SAS drives, 1 GB LSI RAID 0/1 card (more than one RAID 1 array and more than four RAID 5 arrays are supported), two 10GE network ports, two GE network ports (the two network ports are bonded and connected to two access switches), and independent power supply

Calculated based on the data volume

The calculation formula is as follows: Number of nodes = Planned data volume x 1.5 (data expansion rate) x 1 (data compression rate) x 2 (two copies)/0.8 (drive utilization)/0.9 (drive numeral system conversion)/(24 (number of drives) x 1.2 TB (drive capacity) x 5/6 (RAID coefficient))

HBase node

Two-socket rack server, two Huawei Kunpeng 916 or Kunpeng 920 processors, 128 GB or larger memory, two 600 GB 2.5-inch SAS drives, twelve 4 TB or larger 3.5-inch SATA drives, 1 GB LSI RAID 0/1 card (more than one RAID 1 array is supported), two 10GE network ports, and two GE network ports (the two network ports are bonded and connected to two access switches), and independent power supply

Calculated based on the data volume

The calculation formula is as follows: Number of nodes = Planned data volume x 1.5 (data expansion rate) x 1 (data compression rate) x 3 (three copies)/0.8 (drive utilization)/0.9 (drive numeral system conversion)/(12 (number of drives) x 4 TB (drive capacity))