Hyper IO Configuration Item Reference
Configure the /opt/IO_Middleware/IO_Middleware_2.6.1_aarch64/conf/xxx.json file to set Hyper IO options, including the logging module, compression level, compression method, and middleware acceleration policy. /opt/IO_Middleware/ indicates the path to the Hyper IO installation package, and /xxx.json indicates the sample configuration file provided for individual applications. The configuration items are described in Table 1, (Optional) To use the file aggregation function, configure the global dataset group information., and (Optional) To enable out-of-order output for a single file, configure the dataset entity information..
Item |
Description |
Type |
Default Value |
|
|---|---|---|---|---|
Global dataset general information (GENERAL) |
LOG_FLOW |
Prints FLOW module logs. |
String
|
OFF |
LOG_PROCESSOR |
Prints PROCESSOR module logs. |
String
|
OFF |
|
LOG_BRIDGE |
Prints BRIDGE module logs. |
String
|
OFF |
|
LOG_INTERCEPTOR |
Prints logs of all INTERCEPTOR modules. |
String
|
OFF |
|
LOG_CONFIG |
Prints CONFIG module logs. |
String
|
OFF |
|
TRANSCACHESIZE |
Aggregates data into a single write operation when the total data volume reaches the cache size. The value range is [0, 128]. The unit is MB. The default value is 0, indicating that aggregation is not performed. |
Integer |
0 |
|
COMPRESSMETHOD |
Specifies the data compression method. The value range is [1, 2]. The default value is 1. |
Integer
|
1 |
|
COMPRESSLEVEL |
Specifies the data compression level. The value range is [0, 5]. The default value is 0, indicating that compression is not performed. A higher data compression level indicates a higher compression ratio. |
Integer |
0 |
|
WITHOUTGROUP |
Connects to Hyper IO without configuring group information. |
String
|
OFF |
|
Dataset access pattern information (DATA_ACCESS_PATTERN) |
FIXED |
Indicates whether write operations of all entities remain unchanged between steps. |
Boolean
|
false |
RANDOM |
Indicates whether to randomize the particle order in particle applications. |
Boolean
|
false |
|
WRITE_AGGREGATE_STEPS |
Specifies the number of metadata steps to aggregate into a single write, mitigating frequent small I/O operations. The value range is [1, 64]. |
Integer |
1 |
|
WRITE_AGGREGATE_RANKS |
Specifies the number of metadata ranks to aggregate into a single write. The value range is [1, 64]. |
Integer |
1 |
|
- (Optional) To use the file aggregation function, configure the global dataset group information.
Table 2 Global dataset group information (GROUPS) Name
Description
Type
Default Value
GROUPNAME
Mandatory. Name of the aggregated file in aggregation mode. The value must match the regular expression specified for FILEWHITELIST.
String of up to 64 characters
-
FILEWHITELIST
Optional. Regular expression to match files to be aggregated into the GROUPNAME file.
String of up to 64 characters
-
- (Optional) To enable out-of-order output for a single file, configure the dataset entity information.
Table 3 Dataset entity information (ENTITIES) Name
Description
Type
Default Value
NAME
Mandatory. Name of the entity represented by a path.
String of up to 64 characters
-
SHUFFLE
Optional. Whether to randomize the particle order in particle applications.
Boolean
- false
- true
The value is case-insensitive.
false