Hash join exceeded maximum number of recursions, without reducing partitions enough to be memory resident. Probably cause: Too many duplicate keys.

Sun, 27 Mar 2022 20:52:58 -0700 

????????
            ??????Flink 1.13.2 
????HiveCatalog????Hive????????????????????????????


Caused by: java.lang.RuntimeException: Hash join exceeded maximum number of 
recursions, without reducing partitions enough to be memory resident. Probably 
cause: Too many duplicate keys.
        at 
org.apache.flink.table.runtime.hashtable.BinaryHashTable.buildTableFromSpilledPartition(BinaryHashTable.java:443)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.table.runtime.hashtable.BinaryHashTable.prepareNextPartition(BinaryHashTable.java:403)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.table.runtime.hashtable.BinaryHashTable.nextMatching(BinaryHashTable.java:265)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.table.runtime.operators.join.HashJoinOperator.endInput(HashJoinOperator.java:176)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.endOperatorInput(TableOperatorWrapper.java:124)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.table.runtime.operators.multipleinput.BatchMultipleInputStreamOperator.endInput(BatchMultipleInputStreamOperator.java:56)
 ~[flink-table-blink_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.endOperatorInput(StreamOperatorWrapper.java:93)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.OperatorChain.endInput(OperatorChain.java:428)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:69)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.io.StreamMultipleInputProcessor.processInput(StreamMultipleInputProcessor.java:87)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:681)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:636)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:647)
 ~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:620) 
~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) 
~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) 
~[flink-dist_2.11-1.13.2.jar:1.13.2]
        at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_181]

回复