q64 Suspended During Remote Deployment of Hive MetaStore

Symptom

When deploying Hive MetaStore remotely and running 1 TB ORC TPCDS-99, q64 is suspended. A Cartesian product is generated and join is always performed.

Key Process and Cause Analysis

This problem may also occur when Hive executes open source SQL statements. That is, when q44 and q64 are executed in sequence, the MetaStore cache causes the q64 execution plan to change, resulting in a Cartesian product and a large amount of data.

Conclusion and Solution

Solution 1: Choose local deployment instead to prevent SQL statement execution plan changes caused by the cache.

Solution 2: If you still use remote deployment, execute q64 before q44.