4 12:55 PM
Subject: Re: Kafka design pattern question - multiple user ids
AFAIK, you can have as many keys as you want - but if you are looking
to have a separate partition for each key, you are more limited. I
can't give an exact limit since it depends on multiple factors, but
probably
AFAIK, you can have as many keys as you want - but if you are looking
to have a separate partition for each key, you are more limited. I
can't give an exact limit since it depends on multiple factors, but
probably not over 10,000 (and even 1000 for a single topic can be
"pushing it" in some cases).
Hi Gwen,
Thanks for the great and fast reply! How many different keys can Kafka
support ?
Harold
On Mon, Dec 15, 2014 at 10:46 AM, Gwen Shapira
wrote:
>
> When you send messages to Kafka you send a pair. The key
> can include the user id.
>
> Here's how:
>
> KeyedMessage data = new KeyedMessag
When you send messages to Kafka you send a pair. The key
can include the user id.
Here's how:
KeyedMessage data = new KeyedMessage
(user_id, user_id, event);
producer.send(data);
Hope this helps,
Gwen
On Mon, Dec 15, 2014 at 10:29 AM, Harold Nguyen wrote:
> Hello Kafka Experts!
>
>
Hello Kafka Experts!
Sorry if this has been answered before - I was hoping for a quick response
to a naive questions for a newbie like myself!
If I have multiple users, how do I split the streams so that they
correspond with different user ids ?
Suppose I have tens of thousands of user ids that
