Hi,
We have a use case where we need to start kafka consumer with a fixed list
of kafka topics and add more topics on the fly. Since there is no pattern
in names of topics, using pattern for dynamic subscriptions of topics is
not feasible.
Is it a good practice to subscribe to topics on given kaf
wrote:
> Did you want to subscribe to all topics as they are created, or to exclude
> some of them?
> If the latter, is there a pattern in the names of the topics you wish to
> exclude?
>
> - Jordan Pilat
>
> On 2018-01-03 23:39, chintan mavawala wrote:
> > Hi,
>
r as they are created.
Regards,
Chintan
On 04-Jan-2018 11:02 PM, "Jordan Pilat" wrote:
> Did you want to subscribe to all topics as they are created, or to exclude
> some of them?
> If the latter, is there a pattern in the names of the topics you wish to
> exclude?
>
>
ame you'd need some external information (database query?) to decide if
you wanted to subscribe to it.
Skip
On Jan 6, 2018 10:43 AM, "chintan mavawala" wrote:
> In theory pattern "." would work. But that would mean subscribing on all
> topics which I don't want.
&g
subscribed topic list, then
spend to it and subscribe to the extended list when you receive an update?
On Jan 6, 2018 9:37 PM, "chintan mavawala" wrote:
> Discovery of new topic is not a concern. Clients who creates a new topic
> sends my process the topic name. In simpler words
You may want to check replication factor of _consumer_offsets topic. By
default, it is 1. It should be increased to 3 in your case.
Regards,
Chintan
On 25-Jan-2018 12:24 PM, "Siva A" wrote:
> Kafka version i am using is 0.10.0.1
>
> On Thu, Jan 25, 2018 at 12:23 PM, Siva A wrote:
>
> > Hi All,
Hi,
We have a use case to capture number of unique users per month. We planned
to use windowing concept for this.
For example, group events from input topic by user name and later sub group
them based on time window. However i don't see how i can sub group the
results based on particular month, s
