Re: FlinkKinesis consumer

2021-07-26 Thread Danny Cranmer
Hello, If you are consuming from a single stream, you can use the shard ID to achieve a better distribution. Since the shard IDs are assigned incrementally like so: - shardId- - shardId-0001 - shardId-0002 - etc You can substring the prefix and convert

Re: FlinkKinesis consumer

2021-07-25 Thread Caizhi Weng
Hi! It's stated on the line just below that in the document. It is recommended to monitor the shard distribution and adjust assignment > appropriately. A custom assigner implementation can be set via > setShardAssigner(KinesisShardAssigner) to optimize the hash function or use > static overrides