Hello all, I wanted to ask if this property is still active? I can't find it in the doc https://spark.apache.org/docs/latest/configuration.html or anywhere in the code(only in Tests).
If so, should we remove it? val MIN_BATCHES_TO_RETAIN = buildConf("spark.sql.streaming.minBatchesToRetain") .internal() .doc("The minimum number of batches that must be retained and made recoverable.") .version("2.1.1") .intConf .createWithDefault(100)