Re: How produce to remote Kafka Cluster over ssh tunneling

2014-04-09 Thread Sotaro Kimura
Thanks for reply. That is certainly not good idea. Other clients can't kafka cluster with these settings. advertised.host.name=localhost advertised.port=19092 When staging environment, I will construct proxy commented configuration. Temporary, I succeeded message produce over ssh tunnel. Settin

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-04-09 Thread Roger Hoover
I think setting these is not a good idea b/c only apply to the specific client where you've setup the tunnel. Other clients cannot use these settings advertised.host.name=localhost advertised.port=19092 You probably need to figure out another way such as 1) Setting up a local mapping on your pro

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-04-09 Thread Sotaro Kimura
I confirmed. - Controller.log After kafka broker stated. Kafka broker continues outputting below log. Error is continued. === [2014-04-09 23:55:07,709] ERROR [Controller-0-to-broker-0-send-thread], Controller 0's connection to broker id:0,host:localhost,port:19092 was unsuccessful (kafka.contr

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-04-08 Thread Jun Rao
Any error in the broker, controller and state change log? Thanks, Jun On Tue, Apr 8, 2014 at 3:08 PM, Sotaro Kimura wrote: > Hi, all. > > Sorry for my late reply. > > I tried advertised.host.name/advertised.port. > But producer failed fetching metadata from kafka broker. > > Configuration is

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-04-08 Thread Sotaro Kimura
Hi, all. Sorry for my late reply. I tried advertised.host.name/advertised.port. But producer failed fetching metadata from kafka broker. Configuration is below. - Kafka cluster in DataCenter(each machine has Grobal IP Address). Firewall allows only ssh port(22). ex) 192.168.100.100 - Kafka produ

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-03-19 Thread Sotaro Kimura
Thanks for quick reply. advertised.host.name/advertised.port setting is this. I confirmed only producer setting, so I couldn't find these properties. I will try it. Thank you. 2014-03-20 7:50 GMT+09:00 Joe Stein : > With 0.8.1 update these two properties in the server.properties config of > t

Re: How produce to remote Kafka Cluster over ssh tunneling

2014-03-19 Thread Joe Stein
With 0.8.1 update these two properties in the server.properties config of the broker to be 172.16.0.100 and 19092 respectively # Hostname the broker will advertise to producers and consumers. If not set, it uses the # value for "host.name" if configured. Otherwise, it will use the value returned

How produce to remote Kafka Cluster over ssh tunneling

2014-03-19 Thread Sotaro Kimura
Hi, all. I'm trying Log produce to Remote Kafka Cluster over SSH Tunneling. Configuration is below. - Kafka cluster in DataCenter(each machine has Grobal IP Address). Firewall allows only ssh port(22). ex) 192.168.100.100 - Kafka producer exists out of DataCenter. ex) 172.16.0.100 I tried produc