Documentation
Rate This Document
Findability
Accuracy
Completeness
Readability
SubmitClose

Change History

Date

Description

2025-12-30

This issue is the thirty-first official release.

Update OmniStream, OmniStateStore, and Hardware Compatibility.

2025-09-30

This issue is the thirtieth official release.

Updated OmniAdvisor, Feature List, and Hardware Compatibility, and released OmniAdvisor 2.0.

2025-09-10

This issue is the twenty-ninth official release.

Removed graph analysis algorithm library documents.

2025-06-30

This issue is the twenty-eighth official release.

  • Added the Parquet format to Spark 3.3.1 for OmniOperator to support column-based write.
  • Added the OmniStream feature. For details, see OmniStream.
  • Added the OmniStateStore feature. For details, see OmniStateStore.

2025-03-30

This issue is the twenty-seventh official release.

  • Added support for Spark 3.4.3 and Spark 3.5.2 in OmniOperator.
  • Added support for Spark 3.4.3 in OmniMV.
  • Added the OmniScheduler feature. For details, see OmniScheduler.

2025-01-14

This issue is the twenty-sixth official release.

Removed the hybrid deployment content since the FusionInsight platform has supported hybrid deployment of x86 and Arm servers.

2024-12-30

This issue is the twenty-fifth official release.

  • Adapted OmniOperator to the Hive engine and added operator and expression details.
  • The OmniShuffle Memory Fabric supports a minimum of 1 GB memory. Added support for mistake-proof deployment in External Shuffle Service (ESS) and Remote Shuffle Service (RSS) modes. Added a communication library with higher multi-thread performance in ESS mode.
  • Added remote attestation support for OmniShield.

2024-09-30

This issue is the twenty-fourth official release.

  • Added the OmniShield feature. This feature provides the data source encryption and decryption functions. Data is computed in the TEE to ensure data security along the entire computing link.
  • Due to the adjustment of the overall product planning, the decoupled storage and compute feature and the HBase index optimization feature are brought offline.

2024-06-30

This issue is the twenty-third official release.

  • Added support for Hive 3.1.0 in OmniOperator. The performance of Hive 3.1.0 is improved by 20%.
  • Added support for flat-wide table query in the OmniOperator memory optimization. The performance is improved by 30% in the TPC-DS benchmark test of 3 TB data.
  • Added support for RSS mode in OmniShuffle. The performance is improved by 10% compared with that of Celeborn.

2024-03-30

This issue is the twenty-second official release.

  • Upgraded the OmniOperator version to 1.4.0, with performance improvement and support for the operator spill function and Spark 3.3.1.
  • Upgraded the OmniShuffle version to 1.4.0 with support for NEON instruction tuning.
  • Upgraded the OmniAdvisor version to 1.1.0, added the functions of parsing tasks and tuning parameters in the Spark Application Yarn Cluster mode, and enhanced parameter sampling algorithms.

2024-01-11

This issue is the twenty-first official release.

  • Added the parameter tuning feature for OmniAdvisor.
  • Added the HBase secondary index feature for OmniHBaseGSI.
  • Added the adaption of machine learning algorithms to Spark 3.3.1. Only the DBSCAN, Word2Vec, DTB, and SVM algorithms are supported.
  • Added the adaption of the graph analysis algorithm library to Spark 3.3.1. Only the Betweenness, MSSP, MCE, and PageRank algorithms are supported.

2023-10-24

This is the twentieth official release.

  • Upgraded the OmniOperator version to 1.3.0, with performance improvement from 20% to 30% and support for the Parquet format and combination with OmniShuffle.
  • Optimized OmniShuffle to support the Parquet format and combination with OmniOperator.

2023-07-12

This is the nineteenth official release.

  • Upgrade the OmniOperator version to 1.2.0. For details, see OmniOperator.
  • Upgrade the OmniMV version to 1.1.0. For details, see OmniMV.

2023-03-10

This issue is the eighteenth official release.

Some features have been incorporated into the open source community, and can be directly used in Hadoop and HBase of the new version. Therefore, the HDFS EC instruction acceleration, SM encryption and decryption, Smart I/O prefetch, Yarn NUMA-aware, and HBase lock optimization features are brought offline.

2022-12-30

This issue is the seventeenth official release.

  • Added OmniMV.
  • Added the machine learning algorithms: DTB and Word2Vec.
  • Added the graph analysis algorithm: Trillion PageRank.

2022-07-27

This issue is the sixteenth official release.

  • Updated the names of machine learning algorithms: from RF to Random Forest and from Kmeans to K-means.
  • Updated the names of graph analysis algorithms: from TC to Triangle Count, from KCore to K-Core, from PR to PageRank, from IncPageRank to Incremental PageRank, and from Personalized PageRank to Personal PageRank.

2022-07-12

This issue is the fifteenth official release.

2022-04-08

This issue is the fourteenth official release.

  • Updated the hardware constraints and hybrid deployment constraints of the machine learning and graph analysis algorithm libraries. For details, see Feature List.
  • Added performance indicators for the machine learning and graph analysis algorithm libraries. For details, see Feature List.
  • Added Hardware Compatibility.

2022-02-22

This issue is the thirteenth official release.

Added the hardware constraints and hybrid deployment constraints of the machine learning and graph analysis algorithm libraries. For details, see Feature List.

2021-12-31

This issue is the twelfth official release.

  • Added the HBase Trie index optimization feature. For details, see the HBase Index Optimization and Feature List.
  • Updated the installation package download links of the machine learning and graph analysis algorithm libraries and smart I/O prefetch in Feature List.

2021-11-10

This issue is the eleventh official release.

Added constraints on key features and description about whether these features can be used on VMs. For details, see Feature List.

2021-09-30

This issue is the tenth official release.

Added the decoupled storage and compute and OmniData operator pushdown features. For details, see the Decoupled Storage and Compute, OmniData, and Feature List.

2021-06-21

This issue is the ninth official release.

Added the software package formats and the link for obtaining the software packages in Feature List.

2021-05-20

This issue is the eighth official release.

2021-03-10

This issue is the seventh official release.

Updated Solution Features.

2021-01-25

This issue is the sixth official release.

2021-01-07

This issue is the fifth official release.

2020-07-06

This issue is the fourth official release.

Adjusted the structure in Solution Features.

2020-06-20

This issue is the third official release.

Updated Solution Features.

2020-06-16

This issue is the second official release.

Added the link to the corresponding feature guide in Feature List.

2020-06-05

This issue is the first official release.