suggestion of FLINK-10868

Hi Peter&Till: As commented in the issue ，We have introduced the FLINK-10868 patch (mainly batch tasks) online, what do you think of the following two suggestions: 1) Parameter control time int

Re: suggestion of FLINK-10868

gt; > Best Regards > Peter Huang > > On Thu, Sep 5, 2019 at 7:02 AM Anyang Hu wrote: > >> Hi Peter&Till: >> >> As commented in the issue >> <https://issues.apache.org/jira/browse/FLINK-10868#>，We have introduced >> the FLINK-10868 <https://i

Re: suggestion of FLINK-10868

o create a follow up issue once > FLINK-10868 has been merged. > > Cheers, > Till > > On Fri, Sep 6, 2019 at 11:42 AM Anyang Hu wrote: > >> Thank you for the reply and look forward to the advice of Till. >> >> Anyang >> >> Peter Huang 于2019年9月5日周四

Re: suggestion of FLINK-10868

Hi Peter, For our online batch task, there is a scene where the failed Container reaches MAXIMUM_WORKERS_FAILURE_RATE but the client will not immediately exit (the probability of JM loss is greatly improved when thousands of Containers is to be started). It is found that the JM disconnection (the

[flink-1.9] how to read local json file through Flink SQL

Hi guys, In flink1.9, is there a way to read local json file in Flink SQL like the reading of csv file? Now we can read local csv file like the following, replacing of 'csv' to 'json' can not work: create table source ( first varchar, id int ) with ( 'connector.type' = 'filesystem', 'connector.p

Re: [flink-1.9] how to read local json file through Flink SQL

Hi Wesley, This is not the way I want, I want to read local json data in Flink SQL by defining DDL. Best regards, Anyang Wesley Peng 于2019年9月8日周日 下午6:14写道： > On 2019/9/8 5:40 下午, Anyang Hu wrote: > > In flink1.9, is there a way to read local json file in Flink SQL like > > the

Re: suggestion of FLINK-10868

fully. Instead if one > deems the notifyAllocationFailure message to be very important, then one > would need to keep it and tell the JM once it has connected back. > > Cheers, > Till > > On Sun, Sep 8, 2019 at 11:26 AM Anyang Hu wrote: > >> Hi Peter, >> >&g

Re: suggestion of FLINK-10868

> SLA requirements. > > Cheers, > Till > > On Wed, Sep 11, 2019 at 11:11 AM Anyang Hu wrote: > >> Hi Till, >> >> Some of our online batch tasks have strict SLA requirements, and they are >> not allowed to be stuck for a long time. Therefore, we take a rude

[FlinkSQL] is there a way to read/write local json data in Flink SQL like that of kafka?

Hi guys, In flink1.9, we can set `connector.type` to `kafka` and `format.type` to json to read/write json data from kafka or write json data to kafka. In my scenario, I wish to read local json data as a souce table, since I need to do local debug and don't consume online kafka data. For example:

Re: [FlinkSQL] is there a way to read/write local json data in Flink SQL like that of kafka?

a stream > (kafka). > I had this kind of issue when some CEP functionalities. > I hope it helps. > Regards, > Florin > > > On Tue, Oct 29, 2019 at 12:00 PM Anyang Hu wrote: > >> Hi guys, >> >> In flink1.9, we can set `connector.type` to `kafka` and `

[FLINK-10868] job cannot be exited immediately if job manager is timed out for some reason

Hi ZhenQiu && Rohrmann: Currently I backport the FLINK-10868 to flink-1.5, most of my jobs (all batch jobs) can be exited immediately after applying for the failed container to the upper limit, but there are still some jobs cannot be exited immediately. Through the log, it is observed that these j

Re: [FLINK-10868] job cannot be exited immediately if job manager is timed out for some reason

red slot >> requests on the RM. But this should be a follow up issue to FLINK-10868, >> because it would widen the scope too much. >> >> Cheers, >> Till >> >> On Wed, Jun 26, 2019 at 10:52 AM Anyang Hu >> wrote: >> >>> Hi ZhenQiu &a