Re: remote Kafka producer configuration and kafka.common.FailedToSendMessageException

2015-08-17 Thread Job-Selina Wu
Hi, Hawin: You are right. The main problem is my advertised.host.name at config/server.properites was wrong. I followed your instruction. And also http://edbaker.weebly.com/blog/installing-kafka-on-amazons-ec2 this instruction helped me a lot. Thanks a lot. Sincerely, Selina O

Re: remote Kafka producer configuration and kafka.common.FailedToSendMessageException

2015-08-17 Thread Job-Selina Wu
Hi, All: Thanks so much. Finally I fixed this bug. 1. set advertised.host.name at config/server.properites as AWS *private IP* address (not public *DNS*) 2. comment host.name at config/server.properites 3. In remote java producer: props.put("metadata.broker.list", borkerPrivateIp+ ":9092");

Re: remote Kafka producer configuration and kafka.common.FailedToSendMessageException

2015-08-17 Thread Hawin Jiang
if you want to connect remote kafka producer. Maybe you can try to use IP to start your producer. Making sure your producer and consumer are working fine. Then trying advertised host name to connect it. props.put("*metadata.broker.list", "I P to start your producer")

Re: remote Kafka producer configuration and kafka.common.FailedToSendMessageException

2015-08-17 Thread Job-Selina Wu
Hi, All: When I tried find the bug in previous email, I tried to produce message on Kafka broker server on AWS instance by command line below: *$** bin/kafka-console-producer.sh --broker-list localhost:9092 --topic temp1* [2015-08-17 21:42:59,468] WARN Property topic is not valid (kafka.utils.

remote Kafka producer configuration and kafka.common.FailedToSendMessageException

2015-08-17 Thread Job-Selina Wu
Dear All: I am looking for experts on Kafka to help me on remote Kafka java producer configuration . My Kafka java broker and producer are at different *AWS* instances. How should I set "metadata.broker.list" value. According to https://kafka.apache.org/08/configuration.html, The form