Errors Reported in TPC-DS Partition Tables

Symptom

TPC-DS partition tables SQL 5, 13, 25, 62, 88, and 99 report errors. Error message:

1

DeserializeRead detail: Reading byte[] of length 4096 at start offset 532 for length 2 to read 1 fields with types [int].  Read field #1 at field start position 0 current read offset 534

Key Process and Cause Analysis

Hive parameters are incorrectly configured.

Conclusion and Solution

• Add the following parameters to the hive-site.xml configuration file of Hive:

  1 2 3 4 5 6 7 8 9

  <property> <name>hive.mapjoin.hybridgrace.hashtable</name> <value>false</value> </property> <property> <name>hive.vectorized.execution.mapjoin.native.fast.hashtable.enabled</name> <value>true</value> </property>

• Run the set command to set the environment variables.

  1 2	set hive.mapjoin.hybridgrace.hashtable=false; set hive.vectorized.execution.mapjoin.native.fast.hashtable.enabled=true;