Re: Is 0.9 new consumer API compatible with 0.8.x.x broker

2015-11-30 Thread Guozhang Wang
Siyuan, In general 0.9 new consumer API relies on the group coordinator on the broker side to manage consumer groups, so you would need to upgrade the brokers first. However if you are only using the assign() function to assign partitions, i.e. no subscribe() which will not need the group coordin

Re: Is 0.9 new consumer API compatible with 0.8.x.x broker

2015-11-30 Thread Wang, Howard
Thanks. I just found the new KafkaConsumer does have two API functions assignment() and committed(TopicPartition partition). With these 2 functions, we¹ll be able to retrieve the timestamp of last offset regardless whether offset storage is using ZK or offset topic. Howard -- Howard Wang Eng