Sorry for the confusion. We implemented this by re-mapping the hostname to the ip on eth1 on our consumers; zookeeper can keep publishing the same hostname while different clients (producers / brokers / consumers) can map that hostname to different physical interfaces. This allows us to have separate physical networks protecting our producers from consumers that every now and then hog bandwidth catching up.
We also left the brokers themselves talking over eth0 as this protects their replication traffic from our consumers as well. Summary: We are using: - eth0 for producer / broker traffic - bonded eth1 -> eth* for consumer traffic - consumers have their hostname file modified to point to the eth1 ip. We are running this in production and it is working nicely! Joris On Thu, Jan 16, 2014 at 7:47 AM, Jun Rao <jun...@gmail.com> wrote: > Right, I don't think it's currently possible. > > Thanks, > > Jun > > > On Wed, Jan 15, 2014 at 10:50 PM, Vadim Keylis <vkeylis2...@gmail.com > >wrote: > > > Hi Jun. Just to be clear. Its not possible on single node that has two > NIC > > cards(each NIC card assign its own ip address) to route traffic for > > producer through one NIC card and consumer through the other one while > > having kafka listening on the same port for both consumer and producer, > > correct? > > > > Thanks, > > Vadim > > > > > > On Wed, Jan 15, 2014 at 9:33 PM, Jun Rao <jun...@gmail.com> wrote: > > > > > Currently, Kafka broker only supports one port for both the produce and > > the > > > consumer clients. > > > > > > Thanks, > > > > > > Jun > > > > > > > > > On Wed, Jan 15, 2014 at 4:15 PM, Vadim Keylis <vkeylis2...@gmail.com> > > > wrote: > > > > > > > Hi. We have kafka setup on server that has two Ethernet cards. Each > > > > Ethernet port has its own ip address. We would like to separate > traffic > > > and > > > > setup producers to communicate through one card and consumers that > use > > > high > > > > level client through the other card. Would you advise if that > > > configuration > > > > possible? How to configure both producer and consumer that uses kafka > > > high > > > > level client to use different ip addresses to access same kafka node? > > > > > > > > Thanks so much in advance, > > > > Vadim > > > > > > > > > >
