Hong Liang Teoh created FLINK-36187:
---------------------------------------

             Summary: Reimplement UniformShardAssigner using Kinesis shard 
hashes
                 Key: FLINK-36187
                 URL: https://issues.apache.org/jira/browse/FLINK-36187
             Project: Flink
          Issue Type: Sub-task
            Reporter: Hong Liang Teoh


Currently, the UniformShardAssigner on the new KDS source follows a RoundRobin 
assignment strategy. This has problems assigning shards evenly if there is a 
resharding operation (some shards will have less records than others).

Instead, we will use a deterministic distribution strategy that accounts for 
the shard hashes, which will ensure that we have a more uniform shard 
assignment.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to