Re: expected behavior of Kafka dynamic topic subscription

2016-11-07 Thread Cody Koeninger
opu Wang > Cc: user@spark.apache.org > Subject: Re: expected behavior of Kafka dynamic topic subscription > > That's not what I would expect from the underlying kafka consumer, no. > > But this particular case (no matching topics, then add a topic after > SubscribePattern s

RE: expected behavior of Kafka dynamic topic subscription

2016-11-06 Thread Haopu Wang
ected behavior of Kafka dynamic topic subscription That's not what I would expect from the underlying kafka consumer, no. But this particular case (no matching topics, then add a topic after SubscribePattern stream starts) actually isn't part of unit tests for either the DStream or the st

Re: expected behavior of Kafka dynamic topic subscription

2016-11-04 Thread Cody Koeninger
That's not what I would expect from the underlying kafka consumer, no. But this particular case (no matching topics, then add a topic after SubscribePattern stream starts) actually isn't part of unit tests for either the DStream or the structured stream. I'll make a jira ticket. On Thu, Nov 3, 2