Re: Kafka stream error - Consumer is not subscribed to any topics or assigned any partitions

2020-09-14 Thread Pushkar Deole
Thanks Sophie... if we are just creating a global state store (GlobalKTable for instance) from a topic, then that is what you are calling as global-only topology. In our application that is what we are doing and there is no source topic for the stream to process data from, i mean there is however i

Wikimedia's Event Data Platform

2020-09-14 Thread Andrew Otto
Hi all! I've recently written a blog post about Wikimedia's Event Data Platform. We use JSON, and do things a little bit differently than Confluent's Stream Data Platform. https://techblog.wikimedia.org/2020/09/10/wikimedias-event-data-platform-or-json-is-ok-too/ There will be 2 more posts comin

Re: Kafka stream error - Consumer is not subscribed to any topics or assigned any partitions

2020-09-14 Thread Pushkar Deole
Sophie, one more question: will just upgrading kafka-streams jar to 2.5.1 will work or we need to other jars also to be upgraded to 2.5.1 e.g. kafka-clients etc. ? On Mon, Sep 14, 2020 at 7:16 PM Pushkar Deole wrote: > Thanks Sophie... if we are just creating a global state store > (GlobalKTable

Re: Kafka stream error - Consumer is not subscribed to any topics or assigned any partitions

2020-09-14 Thread John Roesler
Hi Pushkar, I'd recommend always keeping Streams and the Clients at the same version, since we build, test, and release them together. FWIW, I think there were some bugfixes for the clients in 2.5.1 anyway. Thanks, -John On Mon, 2020-09-14 at 20:08 +0530, Pushkar Deole wrote: > Sophie, one more

Re: Kafka stream error - Consumer is not subscribed to any topics or assigned any partitions

2020-09-14 Thread Sophie Blee-Goldman
> > if we are just creating a global state store (GlobalKTable > for instance) from a topic, then that is what you are calling as > global-only topology. Exactly. If there is no KStream or KTable in your Streams topology, just a GlobalKTable, then that would be a "global-only" topology On Mon, S

Re: MirrorMaker 2 - is starting mirroring from latest possible?

2020-09-14 Thread Ning Zhang
That is possible, please check out this thread: https://lists.apache.org/thread.html/r978775b2dbdf34a5c6c40105e2e69ad205fa94e33cef08e8519389c9%40%3Cusers.kafka.apache.org%3E On 2020/09/02 07:10:45, Iftach Ben-Yosef wrote: > Hello, > > Whenever we add a new topic to the mirroring whitelist it s

Re: MirrorMaker 2 - Can we start mirroring from latest?

2020-09-14 Thread Ning Zhang
Hello Samuel, I guess you are talking about the case where you start to mirror a new topic? If yes, I think the config should be `source-cluster-alias.consumer.auto.offset.reset`, instead of `target`, because `target` is where the producer of MM2 replicates the messages towards, right? If MM2

Request for joining the contributor list

2020-09-14 Thread Shaohan Yin
Hi, I am interested in participating in the project. It would be appreciated if you could add me to the contributors list. Cheers