Re: what response does broker send when there is not message on the partition

2015-04-17 Thread Gwen Shapira
You should receive OffsetOutOfRange code (1) for the partition. You can also send a FetchOffsetRequest and check for the last available offset (log end offset) - this way you won't have to send a fetch request that is likely to fail. Are you implementing your own consumer from scatch? or using on

Re: offset value problem

2015-04-17 Thread Alexander Mudryk
2015-04-17 14:27 GMT+03:00 Victor L : > Thank you, it is very helpful. I am using zookeeper. Does "rmr /kafka" > remove zookeeper record associated with topic "kafka"? > Yes. But anything will be good if you recreate in some way (manually or by script) all topics after kafka restart. > On Fr

what response does broker send when there is not message on the partition

2015-04-17 Thread Ganesh Nikam
Hi All, I have the kafka client which is fetching data from particular partition. On the broker there are there are some messages (say 100) on this partition and producers has stop producing the messages. Now my consumer consumers these 100 messages and the next fetch offset is set to 101. wh

Re: offset value problem

2015-04-17 Thread Victor L
Thank you, it is very helpful. I am using zookeeper. Does "rmr /kafka" remove zookeeper record associated with topic "kafka"? On Fri, Apr 17, 2015 at 2:50 AM, Alexander Mudryk wrote: > Hello! > > "Offsetvalue :1065377" likely is coming from Zookeeper. > Do you use it? > If so, when you delete/r

Re: offset value problem

2015-04-17 Thread Alexander Mudryk
Hello! "Offsetvalue :1065377" likely is coming from Zookeeper. Do you use it? If so, when you delete/re-create topics you should clean data in Zookeeper too. For example: run user@host:~$ KAFKA_PATH/bin/zookeeper-shell.sh 127.0.0.1:2181 and type theese commands: rmr /kafka create /kafka ''