Hi Martin,
Rebalance and Rescale use round robin and are deterministic in your case
(assuming same task manager / slots). You just need to stay clear of
ShufflePartitioner.
If you are seeing something non-deterministic, could you please share an
example?
On Fri, Jan 15, 2021 at 7:19 AM Martin Fr
Hi Jaffe,
Thanks for your reply, I will try to use a Custom Partioner.
Den tor. 14. jan. 2021 kl. 19.39 skrev Jaffe, Julian <
julianja...@activision.com>:
> Martin,
>
>
>
> You can use `.partitionCustom` and provide a partitioner if you want to
> control explicitly how elements are distributed t
Martin,
You can use `.partitionCustom` and provide a partitioner if you want to control
explicitly how elements are distributed to downstream tasks.
From: Martin Frank Hansen
Reply-To: "m...@berlingskemedia.dk"
Date: Thursday, January 14, 2021 at 1:48 AM
To: user
Subject: Deterministic rescal
