Re: Local State Storage

2023-07-11 Thread Shammon FY
Hi amenreet, I think there are two ways to clean up state data in the flink job automatically: 1. State TTL. You can configure the ttl [1] for state according to your requirements, and flink job will clean the data when they are out of date. For flink SQL jobs you can set a global ttl for all ope

Local State Storage

2023-07-11 Thread amenreet sodhi
Hi Team, I wanted to confirm, the local state which TM stores in the directory either we provide through config or default i.e. /tmp folder, does it clear itself from time to time or the size just keeps on increasing? Thanks Regards Amenreet Singh Sodhi