Hi, fellow Kafka users, I have another question to ask. In Kafka 0.8.2.1, when we disable auto.commit and listen to data from a single partition, occasionally, we just get our offsets reset back to where we started. Therefore, we can never complete the reading of the data (about a million messages) in our batch process, and we don't want to commit until we're finished.
We know that offset commit is broken when auto.commit=false for more than one partition. We were just trying this with a single partition this time, however, in the hopes we would have some luck. Although, the offsets resetting themselves is concerning, and we don't know if that'll happen in the 0.9 release or not. We also haven't been able to figure out how to get logging from the kafka API working so that we can see what's happening. Although, we do use log4j in our own code, and that works fine. Thanks again! -- *William GrimSr. Software Engineerm: 914 418 4115 <914%20418%204115>e: wg...@signal.co <wg...@signal.co>signal.co <http://www.google.com/url?q=http%3A%2F%2Fsignal.co%2F&sa=D&sntz=1&usg=AFrqEzf9BbOBbhu7G5O2liTp3wXdU2t6FA>________________________Cut Through the NoiseThis e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized use of this email is strictly prohibited. ©2015 Signal. All rights reserved.*
