I am using *updateStateByKey *to maintain state in my streaming
application, the state gets accumulated over time.
Is there a way i can delete the old state data or put a limit on the amount
of state the State Dstream can keep in the system.
Thanks,
Sunil.
I have a use case where it requires a huge number of keys' state to be
stored and updated with the latest values from the stream. I am planning to
use updateStateByKey with checkpointing.
I would like to know the performance implication on updateStateByKey as the
keys stored in the state grows rapi
