Given

https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka-base/src/main/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaConsumerBase.java#L471

it seems that if

*  I have a regex pattern for consuming a bunch of topics
* auto create is turned on

then even if I do this

* suspend the pipe with SP
* delete the topic
* start the pipe

It will recreate the topic, b'coz the state has it and the check is against
the pattern rather then against the cluster metadata....in case  auto
create is turned off it will throw an exception ( I think )


The question thus is, as to how can we safely delete a topic from our kafka
cluster without either a recreation ( auto create on ) or exception ( auto
create off ) when restarting from a SP, where the restore  state had that
topic..

Thanks much,

Visha.

Reply via email to