Hey Niels,
For the OOM problem: Did you try RocksDB?
I don't think there's an ES OutputFormat.
I guess there's no way around implementing your own OutputFormat for ES, if
you want to use the DataSet API. It should not be too hard to implement.
On Sun, Mar 1, 2020 at 1:42 PM Niels Basjes wrote
Hi,
I have a job in Flink 1.10.0 which creates data that I need to write to
ElasticSearch.
Because it really is a Batch (and doing it as a stream keeps giving OOM
problems: big + unordered + groupby) I'm trying to do it as a real batch.
To write a DataSet to some output (that is not a file) an Ou
