Re: Read all record from a Topic.

2016-07-14 Thread Jean-Baptiste Silvy
Thanks a lot James for the detailed article. This is exactly what I was looking for! This confirm me to use the seekToEnd method (option #5 in your post), as I'm using Kafka 0.10. Jean-Baptiste On 16-07-13 05:45 PM, James Cheng wrote: Jean-Baptiste, I wrote a blog post recently on this exa

Re: Read all record from a Topic.

2016-07-13 Thread James Cheng
Jean-Baptiste, I wrote a blog post recently on this exact subject. https://logallthethings.com/2016/06/28/how-to-read-to-the-end-of-a-kafka-topic/ Let me know if you find it useful. -James Sent from my iPhone > On Jul 13, 2016, at 7:16 AM, g...@netcourrier.com wrote: > > Hi, > > > I'm usin

Read all record from a Topic.

2016-07-13 Thread gibe
Hi, I'm using a compacted Kafka Topic to save the state of my application. When the application crashes/restarts I can restore its state by reading the Kafka topic. However I need to read it completely, especially up to most recent record, to be sure to restore all data. Is there a standa