Hello In a discussion yesterday the question came up if an internal changelog topic can be enabled for compaction and deletion.
https://stackoverflow.com/questions/50622369/kafka-streams-is-it-possible-to-have-compact-delete-policy-on-state-stores and https://issues.apache.org/jira/browse/KAFKA-4015 say yes. https://kafka.apache.org/documentation/ says yes for log.cleanup.policy on broker level The default cleanup policy for segments beyond the retention window. A comma separated list of valid policies. Valid policies are: "delete" and "compact" but no for cleanup.policy on topic level A string that is either "delete" or "compact". My command line on 1.1 seems to agree with the last part: ./kafka-configs --zookeeper broker0:2181 --alter --entity-type topics --entity-name test --add-config log.cleanup.policy=compact,delete requirement failed: Invalid entity config: all configs to be added must be in the format "key=val". ./kafka-configs --zookeeper broker0:2181 --alter --entity-type topics --entity-name test --add-config cleanup.policy=compact,delete requirement failed: Invalid entity config: all configs to be added must be in the format "key=val". ./kafka-configs --zookeeper broker0:2181 --alter --entity-type topics --entity-name test --add-config cleanup.policy="compact,delete" requirement failed: Invalid entity config: all configs to be added must be in the format "key=val". ./kafka-configs --zookeeper broker0:2181 --alter --entity-type topics --entity-name test --add-config cleanup.policy='compact,delete' requirement failed: Invalid entity config: all configs to be added must be in the format "key=val". Is this missing for the client and/or the topic-level configuration options? Does anyone know if/how this is supposed to work? Side-note: Our use-case (KTable with cleanup after some time) should be covered with WindowKTables as far as I understand, but the documentation for the cleanup.policy seems inconsistent. best regards Patrik
