[
https://issues.apache.org/jira/browse/FLINK-30727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678947#comment-17678947
]
lincoln lee commented on FLINK-30727:
-------------------------------------
[~337361...@qq.com] I also encountered this failure in a local machine
{code}
[ERROR] Errors:
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithLeftOuterJoin:230->assertEquals:47
» Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithLeftOuterJoin:230->assertEquals:47
» Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testBushyTreeJoinReorder:352->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testBushyTreeJoinReorder:352->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithFullOuterJoin:174->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithFullOuterJoin:174->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerAndFullOuterJoin:192->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerAndFullOuterJoin:192->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerAndLeftOuterJoin:249->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerAndLeftOuterJoin:249->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerJoin:210->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithInnerJoin:210->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithLeftOuterJoin:230->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithLeftOuterJoin:230->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithMixedJoinTypeAndCondition:300->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithMixedJoinTypeAndCondition:300->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithRightOuterJoin:267->assertEquals:65
Runtime
[ERROR]
JoinReorderITCase>JoinReorderITCaseBase.testJoinReorderWithRightOuterJoin:267->assertEquals:65
Runtime
[INFO]
[ERROR] Tests run: 5110, Failures: 0, Errors: 18, Skipped: 10
{code}
{code}
[ERROR]
org.apache.flink.table.planner.runtime.batch.sql.join.JoinReorderITCase.testJoinReorderWithLeftOuterJoin(boolean)[1]
Time elapsed: 2.297 s <<< ERROR!
Caused by: java.lang.IllegalArgumentException
at org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:122)
at
org.apache.flink.table.runtime.hashtable.BaseHybridHashTable.<init>(BaseHybridHashTable.java:164)
at
org.apache.flink.table.runtime.hashtable.BinaryHashTable.<init>(BinaryHashTable.java:163)
at
org.apache.flink.table.runtime.operators.join.HashJoinOperator.open(HashJoinOperator.java:135)
at
org.apache.flink.table.runtime.operators.multipleinput.MultipleInputStreamOperatorBase.open(MultipleInputStreamOperatorBase.java:128)
at
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:107)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:730)
at
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:706)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:673)
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:945)
at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:914)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:738)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:556)
at java.lang.Thread.run(Thread.java:877)
...
Caused by: java.io.IOException: Insufficient number of network buffers:
required 97, but only 74 available. The total number of network buffers is
currently set to 2048 of 32768 bytes each. You can increase this number by
setting the configuration keys '
taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and
'taskmanager.memory.network.max'.
at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:493)
at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:466)
at
org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:337)
at
org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:156)
at
org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:956)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:648)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:556)
at java.lang.Thread.run(Thread.java:877)
{code}
> JoinReorderITCase.testBushyTreeJoinReorder failed due to IOException
> --------------------------------------------------------------------
>
> Key: FLINK-30727
> URL: https://issues.apache.org/jira/browse/FLINK-30727
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network, Table SQL / Planner
> Affects Versions: 1.17.0
> Reporter: Matthias Pohl
> Priority: Blocker
> Labels: pull-request-available, test-stability
>
> IOException due to timeout occurring while requesting exclusive NetworkBuffer
> caused JoinReorderITCase.testBushyTreeJoinReorder to fail:
> {code}
> [...]
> Jan 18 01:11:27 Caused by: java.io.IOException: Timeout triggered when
> requesting exclusive buffers: The total number of network buffers is
> currently set to 2048 of 32768 bytes each. You can increase this number by
> setting the configuration keys 'taskmanager.memory.network.fraction',
> 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max', or
> you may increase the timeout which is 30000ms by setting the key
> 'taskmanager.network.memory.exclusive-buffers-request-timeout-ms'.
> Jan 18 01:11:27 at
> org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalRequestMemorySegments(NetworkBufferPool.java:256)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.requestPooledMemorySegmentsBlocking(NetworkBufferPool.java:179)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.io.network.buffer.LocalBufferPool.reserveSegments(LocalBufferPool.java:262)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.setupChannels(SingleInputGate.java:517)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.setup(SingleInputGate.java:277)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.taskmanager.InputGateWithMetrics.setup(InputGateWithMetrics.java:105)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:962)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:648)
> Jan 18 01:11:27 at
> org.apache.flink.runtime.taskmanager.Task.run(Task.java:556)
> Jan 18 01:11:27 at java.lang.Thread.run(Thread.java:748)
> {code}
> Same build, 2 failures:
> *
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=44987&view=logs&j=0c940707-2659-5648-cbe6-a1ad63045f0a&t=075c2716-8010-5565-fe08-3c4bb45824a4&l=14300
> *
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=44987&view=logs&j=ce3801ad-3bd5-5f06-d165-34d37e757d90&t=5e4d9387-1dcc-5885-a901-90469b7e6d2f&l=14362
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
