What do you consider a lot of latency? The rebalance will require serializing / deserializing the data as it gets distributed. Depending on the complexity of your records and the efficiency of your serializers, that could have a significant impact on your performance.
On Thu, Aug 9, 2018 at 2:14 PM antonio saldivar <ansal...@gmail.com> wrote: > Hello > > Does anyone know why when I add "rebalance()" to my .map steps is adding a > lot of latency rather than not having rebalance. > > > I have kafka partitions in my topic 44 and 44 flink task manager > > execution plan looks like this when I add rebalance but it is adding a lot > of latency > > kafka-src -> rebalance -> step1 -> rebalance ->step2->rebalance -> > kafka-sink > > Thank you > regards > >
