I am not surprised to hear it is outside the norm.
There is really one main use-case for this, and it’s for processing
messaging in an ordered manner with http post delivery for a logic group
of recipients.
But actually, I have some questions about normal use because I do want to
assess if the r
Glad to help. I will say, as you probably got from my interest/questions,
that is definitely outside of normal use (that I have seen). Why do you
need dynamic logical partitioning?
On Fri, Aug 7, 2015 at 1:20 PM, Gelinas, Chiara
wrote:
> Thank you! We are new to Kafka, so this makes complete sen
Thank you! We are new to Kafka, so this makes complete sense - the
metadata refresh age.
Yes, incrementally assigning 1 partitioner key - we are tracking it in a
relational DB along with offset, etc, for the consumers.
We haven¹t yet implemented the dynamic consumer side but there are several
app
Interesting use case. I would be interested to hear more. Are you assigning
1 partition per key incrementally? How does your consumer know which
partition has which key?
I don't think there is a way to manually invalidate the cached metadata in
the public producer api (I could be wrong), but the l
Hi All,
We are looking to dynamically create partitions when we see a new piece of data
that requires logical partitioning (so partitioning from a logical perspective
rather than partitioning solely for load-based reasons). I noticed that when I
create a partition via AdminUtils.addPartition, a
