That's not what I would expect from the underlying kafka consumer, no. But this particular case (no matching topics, then add a topic after SubscribePattern stream starts) actually isn't part of unit tests for either the DStream or the structured stream.
I'll make a jira ticket. On Thu, Nov 3, 2016 at 9:43 PM, Haopu Wang <hw...@qilinsoft.com> wrote: > I'm using Kafka010 integration API to create a DStream using > SubscriberPattern ConsumerStrategy. > > The specified topic doesn't exist when I start the application. > > Then I create the topic and publish some test messages. I can see them in > the console subscriber. > > But the spark application doesn't seem to get the messages. > > I think this is not expected, right? What should I check to resolve it? > > Thank you very much! --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
