Re: Support for topics+streams at class WildcardStreamsHandler

2014-11-17 Thread Guozhang Wang
Just added an entry in the FAQ page: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whycan%27tIspecifythenumberofstreamsparallelismpertopicmapusingwildcardstreamasIusestaticstreamhandler ? On Mon, Nov 10, 2014 at 7:56 AM, Guozhang Wang wrote: > Hi Alan, > > The reason we do not have

Re: Support for topics+streams at class WildcardStreamsHandler

2014-11-10 Thread Guozhang Wang
Hi Alan, The reason we do not have per-topic parallelism spec in wildcard is two folds: 1) we use a per-topic hash-based partition algorithm, and hence having each topic with the same num. of streams may give us better load balance, 2) with the topicFilter we will not know exactly which topics to

Support for topics+streams at class WildcardStreamsHandler

2014-11-09 Thread Alan Lavintman
Hi guys, i have seen that if create a message stream by using: createMessageStreams I can define a map with Topic->#Streams Is there a reason why createMessageStreamsByFilter us not giving the same support? I have only a TopicFilter and numStreams interface such as: public List> createMessageSt