Hi Vinay, @Vinay : I am setting RocksDBStateBackend from the code, not from flink-conf.yaml. I am currently trying out the configurations that you have shared. I’ll let you know how they perform. Thank you so much for your help.
However, were you able to figure out what exactly is going wrong with the RocksDb setup? And, while making these modifications did you notice any significant drop in RocksDb performance. Overall, how do you think we should configure memory for the TaskManager? Is there a way to estimate how much memory is sufficient for task manager heap and RocksDBStateBackend? Thank you Best, Shashwat