Hi Vinayak, the error message provides a hint about changing config options, you could try to use StreamExecutionEnvironment.createLocalEnvironment(2, customConfig); to increase resources. this issue might also address the problem, it will be part of 1.9 release: https://issues.apache.org/jira/browse/FLINK-12852
Best, Andrey On Tue, Jul 30, 2019 at 5:42 PM Vinayak Magadum <[email protected]> wrote: > Hi, > > I am using Flink version: 1.7.1 > > I have a flink job that gets the execution environment as below and > executes the job. > > StreamExecutionEnvironment env = > StreamExecutionEnvironment.getExecutionEnvironment(); > > When I run the code in cluster, it runs fine. But on local machine while > running the job via IntelliJ I get below error: > > org.apache.flink.runtime.client.JobExecutionException: Job execution > failed. > at > org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146) > at > org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:647) > at > org.apache.flink.streaming.api.environment.LocalStreamEnvironment.execute(LocalStreamEnvironment.java:123) > <stack trace truncated > > Caused by: java.io.IOException: Insufficient number of network buffers: > required 8, but only 3 available. The total number of network buffers is > currently set to 12851 of 32768 bytes each. You can increase this number by > setting the configuration keys 'taskmanager.network.memory.fraction', > 'taskmanager.network.memory.min', and 'taskmanager.network.memory.max'. > at > org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:272) > at > org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:257) > at > org.apache.flink.runtime.io.network.NetworkEnvironment.setupInputGate(NetworkEnvironment.java:278) > at > org.apache.flink.runtime.io.network.NetworkEnvironment.registerTask(NetworkEnvironment.java:224) > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:608) > at java.lang.Thread.run(Thread.java:748) > > Workaround that I tried to make it run on local is to use > StreamExecutionEnvironment env = > StreamExecutionEnvironment.createLocalEnvironment(2); > > instead of StreamExecutionEnvironment env = > StreamExecutionEnvironment.getExecutionEnvironment(); > > With Flink 1.4.2, StreamExecutionEnvironment env = > StreamExecutionEnvironment.getExecutionEnvironment(); used to work on both > cluster as well as local environment. > > Is there any way to make > StreamExecutionEnvironment.getExecutionEnvironment(); work in both cluster > and local mode in flink 1.7.1? Specifically how to make it work locally via > IntelliJ. > -------- > Thanks & Regards, > Vinayak >
