Hi,
I am using Flink version: 1.7.1
I have a flink job that gets the execution environment as below and
executes the job.
StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
When I run the code in cluster, it runs fine. But on local machine while
running the job via IntelliJ I get below error:
org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
at
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
at
org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647)
at
org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123)
<stack trace truncated >
Caused by: java.io.IOException: Insufficient number of network buffers:
required 8, but only 3 available. The total number of network buffers is
currently set to 12851 of 32768 bytes each. You can increase this number by
setting the configuration keys 'taskmanager.network.memory.fraction',
'taskmanager.network.memory.min', and 'taskmanager.network.memory.max'.
at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:272)
at
org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:257)
at
org.apache.flink.runtime.io.network.NetworkEnvironment.setupInputGate(NetworkEnvironment.java:278)
at
org.apache.flink.runtime.io.network.NetworkEnvironment.registerTask(NetworkEnvironment.java:224)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:608)
at java.lang.Thread.run(Thread.java:748)
Workaround that I tried to make it run on local is to use
StreamExecutionEnvironment env =
StreamExecutionEnvironment.createLocalEnvironment(2);
instead of StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment();
With Flink 1.4.2, StreamExecutionEnvironment env =
StreamExecutionEnvironment.getExecutionEnvironment(); used to work on both
cluster as well as local environment.
Is there any way to make
StreamExecutionEnvironment.getExecutionEnvironment(); work in both cluster
and local mode in flink 1.7.1? Specifically how to make it work locally via
IntelliJ.
--------
Thanks & Regards,
Vinayak
