Re: Kafka-Streams Offsets Commit - Reprocessing Very Old Messages

2017-05-03 Thread Matthias J. Sax
Hard to say. Couple of things you could try: upgrade to 0.10.2.1 (got released last week) -- it contains a couple of bug fixed with regard to rebalancing and state store locks. Also, when you application "jumps back", is this somewhere in the middle of your input topic or is it "earliest" -- if i

Kafka-Streams Offsets Commit - Reprocessing Very Old Messages

2017-05-03 Thread Khatri, Alpa
Hi, We are using apache kafka-streams 0.10.2.0 in an application. We are leveraging kafka-streams topology for passing the processed data on to the next topic till the end of processing. Also, We use AWS ECS container to deploy Consumer Application. We observed consumer is picking up very old me