Rate This Document
Findability
Accuracy
Completeness
Readability

Constraints

OmniData

  • If an out-of-bounds error occurs during numeric calculation, OmniData throws an out-of-bounds exception.
  • When comparing character strings, ensure that constants are enclosed in single quotation marks. Example: select * from table where char = '123'
  • The decimal (38,38) data type is not supported.
  • The timestamp data type is not supported. It is processed in the native calculation approach.
  • Operator pushdown is unavailable for transaction tables, which are processed in the native calculation approach.
  • Operator pushdown is unavailable for bucket tables, which are processed in the native calculation approach.
  • Ensure that the analyze information of a data table is the latest. Otherwise, the pushdown selectivity is inaccurate.

OmniOperator

  1. Currently, the UDF plugin supports only simple UDFs. It is used to execute UDFs compiled based on the Hive UDF framework.
  2. Currently, 64-bit and 128-bit Decimal data types are supported. If the Decimal data exceeds 128 bits, an exception is thrown or null is returned. In this case, an issue that does not match native behaviors of the engine may occur. For example, during SUM or AVG aggregation, if the intermediate result exceeds Decimal 128 bits, the engine native behaviors are normal, but OmniOperator throws an exception or returns null based on the configuration. If AVG calculation is required for a field and the accumulated result may be too large, use other storage types such as Double.
  3. Different loads require different memory configurations. For example, for a TPC-DS 3 TB dataset, the recommended Spark Extension configuration requires that off-heap memory be greater than or equal to 30 GB so that all the 99 SQL statements can be successfully executed. During the execution, "MEM_CAP_EXCEEDED" may be reported in logs, but the execution result is not affected. If the off-heap memory is insufficient, the SQL execution result may be incorrect.
  4. In security cluster mode, data in the ORC format cannot be read in native mode.