Re: Kafka Topic Volume and (possibly ACL) question

2019-02-24 Thread Pere Urbón Bayes
Hi, as Evelin has already said, I would recommend you to think about your topic / data modeling, from your email > We have a requirement where, based on business requirementes, we need to publish data only for a specific set of clients. For example, an invoice update shouldn't go to all clients,

Re: Kafka Topic Volume and (possibly ACL) question

2019-02-19 Thread Evelyn Bayes
Hi, I would use ACLs or something similar. For instance, you might assign the records which are limited to a subset of clients to a specific topic with an associated ACL. I expect you’ll find having 8k extra topics very problematic in a range of ways, such as: * Replication issues; * Poor bat

Kafka Topic Volume and (possibly ACL) question

2019-02-18 Thread M. Manna
Hello, We have a requirement where, based on business requirementes, we need to publish data only for a specific set of clients. For example, an invoice update shouldn't go to all clients, only the specific client. But a company remittance info should be published to all clients. Also, in some cas