Hi, If you are using HashMapStateBackend, there may be some noticeable overhead. If RocksDBStateBackend, I think the overhead may be minor.
As we know, Flink will write the key group as the prefix of the key to speed up rescaling. So the format will be like: key group | key len | key | ...... You could check the relationship between max parallelism and bytes of key group as below: ------------------------------------------ max parallelism | bytes of key group 128 | 1 32768 | 2 ----------------------------------------- So I think the cost will be very small if the real key length is >> 2 bytes. On Tue, Jul 11, 2023 at 8:21 PM 湘晗刚 <1016465...@qq.com> wrote: > How to set the max parallelism , if I set it to 200 or 2000 ,the > performance will be the same? > -- Best, Hangxiang.
