回复: Kafka broker failed to work when migrating the broker to another machine

Zhongjing， can you show some server.log ? ie:broker 4 or the leader of topic "log_error". 发件人： 俞忠静 发送时间： 2015-03-02 18:37 收件人： users@kafka.apache.org 抄送： 吴红芳; 邵宏亮; 方超超 主题： Kafka broker failed to work when migrating the broker to another machine Hi, I set up a Kafka cluster with 5 brokers, with

Re: Re: delete log file

. Thanks & Regards YuanJia Li From: Yang Fang Date: 2015-01-23 12:15 To: users Subject: Re: delete log file YuanJia, I want to know why your broker's disk is almost full . Maybe your issue is the same with mine. Is it one broker out of service for a long time, then it fails back, at first it l

delete log file

a? Thanks & Regards YuanJia Li

how to order message between different partition

Hi all, I have a topic with 3 partitions, and each partion has its sequency in kafka. How to order message between different partion? Anyone has experiences about that, thanks. Thanks & Regards YuanJia Li

Re: kafka monitoring system

Hi Sa Li, You can try to use jmxtrans+opentsdb to monitor kafka. Jmxtrans is collecting data with JMX and sending to opentsdb. Opentsdb is graphing and alerting. YuanJia Li From: Sa Li Date: 2014-12-23 08:41 To: users Subject: kafka monitoring system Hi, all I am thinking to make a

Re: Reuse ConsumerConnector

hi Chen, Maybe you can take some tips from kafka.tools.KafkaMigrationTool.java, it's also a multi-threads using case. Reusing the same ConsumerConnector every time is ok. If you create ConsumerConnector repeatedly with the same consumer.id, the conflict will happen in ZK. Yuanjia Li

Re: Re: How to push metrics to graphite - jmxtrans does not work

Hi David， Just edit "kafka-server-start.sh", and add "export JMX_PORT=",it will work. Yuanjia From: David Montgomery Date: 2014-12-03 04:47 To:users Subject: Re: How to push metrics to graphite - jmxtrans does not work Hi, I am seeing this in the logs and wondering what "jmx_port":-1

Re: Re: Pagecache cause OffsetOutOfRangeException

Hi Guozhang, My kafka works in product environment, a large messages are produced or consumed. So it is not easy to get the accurate offset through the GetOffset tool when an OffsetOutOfRangeException happens.But in my application, I have coded comparing the consuming offset with the latest

Re: Re: How to push metrics to graphite - jmxtrans does not work

Jmxtrans should connect to the jmxremote port. Try to run "ps -aux |grep kafka", and find the process contain -Dcom.sun.management.jmxremote.port or not. If not, try to edit "kafka-server-start.sh", add "export JMX_PORT=".

Pagecache cause OffsetOutOfRangeException

e wrote to kernel's pagecache and not flush to the file yet,while I'm consuming new messages from the file? How to fix it? Thanks, Yuanjia Li