Re: Kafka Streams Dynamic Topic consumer

2016-07-19 Thread Guozhang Wang
Hello David, Regex subscription is already added in trunk as per https://issues.apache.org/jira/browse/KAFKA-3443 and will be available in the 0.10.1.0 release. If you want to try it out and experiment you can just build from current trunk directly. Regarding automatic checkpointing / load bala

Kafka Streams Dynamic Topic consumer

2016-07-18 Thread David Garcia
Is there any way to specify a dynamic topic list (e.g. like a regex whitelist filter…like in the consumer API) with kafka streams? We would like to get the benefit of automatic checkpointing and load balancing if possible. -David