Re: RocksDB Compaction filter to clean up state with TTL

2020-02-03 Thread Yu Li
Hi Abhilasha, We were conservative about enabling this by default to prevent any unexpected problems. However, since there has been no reported issues so far, we will enable this by default in 1.10.0 release. Please refer to FLINK-14898 [1], FLINK-15506 [2] and (currently drafted) 1.10.0 release n

RocksDB Compaction filter to clean up state with TTL

2020-02-03 Thread Seth, Abhilasha
Hello, Flink 1.8 introduces the config ‘state.backend.rocksdb.ttl.compaction.filter.enabled’ to enable or disable the compaction filter to cleanup state with TTL. I was curious why its disabled by default. Are there any performance implications of turning it ON by default? Thanks, Abhilasha