producer can't push msg sometimes with 1 broker recoved

2016-09-21 Thread FEI Aggie
Hi, I am testing with kafka 0.10.0 version. I set up 2 broker nodes. I shutdown 2 nodes and later bring up one of them, for sometimes producer can't push message to the live broker, though the live node does have lead partition for the specified topic. Log shows producer always try to connect the

RE: producer can't push msg sometimes with 1 broker recoved

2016-09-25 Thread FEI Aggie
Kamal, Thanks for your response. I tried testing with metadata.max.age.ms reduced to 10s, but the behavior not changed, and producer still can't find the live broker. I did more testing and find the rule (Topic is created with "--replication-factor 2 --partitions 1" in following case): node 1

RE: producer can't push msg sometimes with 1 broker recoved

2016-09-25 Thread FEI Aggie
@kant, we also use 3rd party software when needed. -Original Message- From: kant kodali [mailto:kanth...@gmail.com] Sent: Saturday, September 24, 2016 1:50 PM To: users@kafka.apache.org Subject: Re: producer can't push msg sometimes with 1 broker recoved @Fei Just curious why you guys ar

RE: producer can't push msg sometimes with 1 broker recoved

2016-09-28 Thread FEI Aggie
: 5, Sending the record with key : 0 - Kamal On Mon, Sep 26, 2016 at 8:53 AM, FEI Aggie wrote: > Kamal, > Thanks for your response. I tried testing with metadata.max.age.ms > reduced to 10s, but the behavior not changed, and producer still can't > find the live broker. > >

offset.storage.filename configuration in kafka-connect-hdfs

2017-03-08 Thread FEI Aggie
Hi, I'm running kafka-connect-hdfs 3.1.1. offset.storage.filename is a required configuration for standalone connector. But when I set this parameter in worker configuration file for kafka-connect-hdfs with standlone mode: offset.storage.file.filename=/mnt/data/connect.offsets It never works. Th