Re: hadoopInputFormat and elasticsearch

2018-10-04 Thread Andrey Zagrebin
Hi, At the moment if the processing of any data input split fails, Flink will restart the batch job completely from scratch. There is an ongoing effort to improve fine-grained recovery in FLINK-4256. Best, Andrey > On 2 Oct 2018, at 13:52, aviad wrote: > > Hi, > > I want to write batch job w

hadoopInputFormat and elasticsearch

2018-10-02 Thread aviad
Hi, I want to write batch job which reads data from *elasticsearch* using *elasticsearch-hadoop* (https://github.com/elastic/elasticsearch-hadoop/) and *hadoopInputFormat* example code (from https://github.com/genged/flink-playground/blob/master/src/main/java/com/mic/flink/FlinkMain.java): ela