rkhachatryan opened a new pull request, #24880: URL: https://github.com/apache/flink/pull/24880
In some cases, the number of files produced by RocksDB state backend grows indefinitely. This might cause task state info (TDD and checkpoint ACK) to exceed RPC message size and fail recovery/checkpoint in addition to having lots of small files. With this change, such files are merged in the background using RocksDB API. ## Verifying this change Added tests: - `CompactionSchedulerTest` - `CompactionTaskProducerTest` - `EmbeddedRocksDBStateBackendTest#testSmallFilesCompaction` Verified manually, deployed to Production internally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
