Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Adrian Preston
s, one tenant, or one tenant's topics. So in summary: I think that namespaces can be usefully implemented independently of topic-hierarchies, and when topic-hierarchies are implemented would be easily integrated. Regards - Adrian -Gwen Shapira > wrote: - To: "dev@kafka.apa

Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Adrian Preston
s, one tenant, or one tenant's topics. So in summary: I think that namespaces can be usefully implemented independently of topic-hierarchies, and when topic-hierarchies are implemented would be easily integrated. Regards - Adrian -Gwen Shapira > wrote: - To: "dev@kafka.apa

Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Gari Singh
t; > > > I guess that topic-hierarchies might result in the possibility for > > > > even finer grain topic configuration - e.g. a ZNode structure of: > > > > '/config/topics///...'. This would work > > > > best with an implementation of namespaces t

Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Ashish Singh
t; '/config/topics///...'. This would work > > > best with an implementation of namespaces that was based on-top of > > > topic-hierarchies, allowing configuration to be applied at the scope > > > of: all tenants, one tenant, or one tenant's topics. > > > &

Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Jay Kreps
mary: I think that namespaces can be usefully implemented > > independently of topic-hierarchies, and when topic-hierarchies are > > implemented would be easily integrated. > > > > Regards > > - Adrian > > > > -Gwen Shapira wrote: - > > To:

Re: Adding multi-tenancy capabilities to Kafka

2015-05-05 Thread Ashish Singh
ted would be easily integrated. > > Regards > - Adrian > > -Gwen Shapira wrote: - > To: "dev@kafka.apache.org" > From: Gwen Shapira > Date: 04/28/2015 06:54PM > Subject: Re: Adding multi-tenancy capabilities to Kafka > > I think recent discussio

Re: Adding multi-tenancy capabilities to Kafka

2015-04-29 Thread Adrian Preston
r one tenant's topics. So in summary: I think that namespaces can be usefully implemented independently of topic-hierarchies, and when topic-hierarchies are implemented would be easily integrated. Regards - Adrian -Gwen Shapira wrote: ----- To: "dev@kafka.apache.org" From: Gwen

Re: Adding multi-tenancy capabilities to Kafka

2015-04-28 Thread Gwen Shapira
I think recent discussion showed some need for topic namespaces - for example, Jun's use case for reserving topic names for specific users discussed under authorization. I think some discussion should happen on namespaces vs more full-fledged topic-hierarchy. I like the simplicity of namespaces, b

Adding multi-tenancy capabilities to Kafka

2015-04-28 Thread Adrian Preston
Hi all, I've been looking at how a Kafka cluster could be used be deployed so that it can be used by multiple tenants. Specifically: a scheme where the clients belonging to each tenant receive the impression they are operating against their own cluster. The ongoing security and quota work loo