Re: Elasticsearch InputFormat

2018-09-11 Thread Michael Gendelman
ch > input format would definitely be helpful. > > [1] https://github.com/elastic/elasticsearch-hadoop > > On Sat, Sep 8, 2018 at 11:48 PM Michael Gendelman > wrote: > > > Hi all, > > > > I have a workload where I need to read and transform large amounts of > da

Elasticsearch InputFormat

2018-09-08 Thread Michael Gendelman
Hi all, I have a workload where I need to read and transform large amounts of data from Elasticsearch. I'm currently using Flink only for streaming but I though that it can also be a good fit for this kind of batch job. However, I did not find a way to load data from Elasticsearch in parallel to F