Re: Unable to create new native thread error

2021-12-13 Thread David Morávek
at 16:25 > *To: *Ilan Huchansky > *Cc: *user@flink.apache.org , Start.io SDP < > s...@start.io> > *Subject: *Re: Unable to create new native thread error > > Hi Ilan, can you please check number of threads on the task-managers / OS? > As far as I remember this happens

Re: Unable to create new native thread error

2021-12-13 Thread Ilan Huchansky
configured on the task and job managers. Kind regards, Ilan From: David Morávek Date: Monday, 13 December 2021 at 16:25 To: Ilan Huchansky Cc: user@flink.apache.org , Start.io SDP Subject: Re: Unable to create new native thread error Hi Ilan, can you please check number of threads on the task

Re: Unable to create new native thread error

2021-12-13 Thread David Morávek
ent.(BlobClient.java:96)\n', > > \t... 14 more\n', > > ]\n', > > > org.apache.flink.runtime.rest.RestClient.parseResponse(RestClient.java:486)\n', > > > > org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$3(RestClient.java:466)\n', > &

Re: Unable to create new native thread error

2021-12-12 Thread Ilan Huchansky
966)\n', java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)\n', \t... 4 more\n'] Could the blob error lead to the native thread error? Is there any changes on the configuration that we can make to avoid the blob related errors?

Re: Unable to create new native thread error

2021-12-12 Thread Ilan Huchansky
mbda$submitRequest$3(RestClient.java:466)\n', java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:966)\n', java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940)\n', \t... 4 more\n'] [cidimage001.

Re: Unable to create new native thread error

2021-12-07 Thread Ilan Huchansky
: Unable to create new native thread error Hi Ilan, I think so, using CLI instead of REST API should solve this, as the user code execution would be pulled out to a separate JVM. If you're going to try that, it would be great to hear back whether it has solved your issue. As for 1.13.4, the

Re: Unable to create new native thread error

2021-12-06 Thread David Morávek
Morávek > *Date: *Thursday, 2 December 2021 at 17:25 > *To: *Ilan Huchansky > *Cc: *user@flink.apache.org , Start.io SDP < > s...@start.io> > *Subject: *Re: Unable to create new native thread error > > Hi Ilan, > > > > we are aware of multiple issues whe

Re: Unable to create new native thread error

2021-12-05 Thread Ilan Huchansky
know when this version is planned to be released? Thanks again, Ilan. From: David Morávek Date: Thursday, 2 December 2021 at 17:25 To: Ilan Huchansky Cc: user@flink.apache.org , Start.io SDP Subject: Re: Unable to create new native thread error Hi Ilan, we are aware of multiple issues when web

Re: Unable to create new native thread error

2021-12-02 Thread David Morávek
Hi Ilan, we are aware of multiple issues when web-submission can result in classloader / thread local leaks, which could potentially result in the behavior you're describing. We're working on addressing them. FLINK-25022 [1]: The most critical one leaking thread locals. FLINK-25027 [2]: Is only a

Unable to create new native thread error

2021-12-02 Thread Ilan Huchansky
Hi Flink mailing list, I am Ilan from Start.io data platform team, need some guidance. We have a flow with the following use case: * We read files from AWS S3 buckets process them on our cluster and sink the data into files using Flink file sink. * The jobs use always the same jar, we