Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread Guozhang Wang
Since 0.8, broker discovery is not through zk anymore. Guozhang On Thu, Dec 19, 2013 at 8:45 AM, pushkar priyadarshi < priyadarshi.push...@gmail.com> wrote: > is the auto broker discovery not possible through zk.connect? > > Regards, > Pushkar > > > On Thu, Dec 19, 2013 at 9:29 PM, Jun Rao wro

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread pushkar priyadarshi
is the auto broker discovery not possible through zk.connect? Regards, Pushkar On Thu, Dec 19, 2013 at 9:29 PM, Jun Rao wrote: > metadata.broker.list is also used when there are leader failures. Could you > get a vip in ec2 and put the brokers' ip behind the vip? > > Thanks, > > Jun > > > On T

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread Jun Rao
metadata.broker.list is also used when there are leader failures. Could you get a vip in ec2 and put the brokers' ip behind the vip? Thanks, Jun On Thu, Dec 19, 2013 at 4:07 AM, Arjun wrote: > So from your reply what i understood is this particular property iis used > only when starting the p

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread Guozhang Wang
metadata.broker.list is used to discover brokers within the kafka cluster on producer startup and on produce request gets error responses (that is when the producer needs to refresh its memory of the available brokers). While the real broker list discovered is a list of host:port, this list used fo

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread pushkar priyadarshi
correct On Thu, Dec 19, 2013 at 5:37 PM, Arjun wrote: > So from your reply what i understood is this particular property iis used > only when starting the producers. > > is that right? can you please confirm. > > Thanks > Arjun Narasimha Kota > > > On Thursday 19 December 2013 05:33 PM, pushkar

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread Arjun
So from your reply what i understood is this particular property iis used only when starting the producers. is that right? can you please confirm. Thanks Arjun Narasimha Kota On Thursday 19 December 2013 05:33 PM, pushkar priyadarshi wrote: 1.When you start producing : at this time if any of

Re: doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread pushkar priyadarshi
1.When you start producing : at this time if any of your supplied broker is alive system will continue to work. 2.Broker going down and coming up with new IP : producer API refreshes metadata information on failures(configurable) so they should be able to detect new brokers. But i dont think it's p

doubt regarding the metadata.brokers.list parameter in producer properties

2013-12-19 Thread Arjun
Hi, I am running kafka 0.8 and zoo keeper along with it. The problem i have is with the metadata.broker.list which is present in the producer properties. As i am using the zookeeper can i just ignore this property and kafka will work fine? We run kafka on the ec2 nodes, lets say we are running