If you no longer need to maintain state for a key, just return None for that 
value and it gets removed.

From: Sunil Yarram <[email protected]<mailto:[email protected]>>
Date: Friday, December 12, 2014 at 9:44 PM
To: "[email protected]<mailto:[email protected]>" 
<[email protected]<mailto:[email protected]>>
Subject: clean up of state in State Dstream

I am using updateStateByKey to maintain state in my streaming application, the 
state gets accumulated over time.
Is there a way i can delete the old state data or put a limit on the amount of 
state the State Dstream can keep in the system.

Thanks,
Sunil.

Reply via email to