Hi Oran,
could you check if smaller batches improve the situation?
On Sat, Oct 16, 2021 at 2:15 AM Oran Shuster wrote:
> The cluster is not really overloaded and also couldn't find some ES errors
> logs (atleast something that is repeating)
> The job IS very busy (100% on the sink and backpress
The cluster is not really overloaded and also couldn't find some ES errors logs
(atleast something that is repeating)
The job IS very busy (100% on the sink and backpressure) but I think its due to
the reactor exceptions being thrown
what do you mean by incorrect batching?
On 2021/10/13 07:43:3
Hi Oran, can you check your ES logs / metrics?
Most issues we see with the ES sink are around incorrect batching and/or
overloaded clusters. Could it be your ES write queue is building up?
On Wed, Oct 13, 2021 at 1:06 AM Oran Shuster wrote:
> Flink version 1.13.1
> ES Version 7.12.0
> Flink dep
