I have a use case where it requires a huge number of keys' state to be stored and updated with the latest values from the stream. I am planning to use updateStateByKey with checkpointing. I would like to know the performance implication on updateStateByKey as the keys stored in the state grows rapidly. Please share your thoughts/experience.
Thanks, Sunil.