Flink 1.4 added regex pattern matching for FlinkKafkaConsumer's which is a
neat feature. I would like to use this feature, but I'm wondering how that
impacts the FsStateBackend checkpointing mechanism. Before I would
subscribe to one topic and set a checkpoint path specific to that topic for
example if the Kafka topic name was *foo*:
val env = StreamExecutionEnvironment.getExecutionEnvironment
env.setStateBackend(new FsStateBackend("s3://checkpoints/*foo*/"))
How does one dynamically set these checkpoint paths? Is it even necessary
to do so, should I have one checkpoint path for all the possible topics the
regex pattern could pick up?
