Thanks Matthias!
My comments below.
Regards,
Jorge.
El lun., 30 ene. 2017 a las 18:40, Matthias J. Sax ()
escribió:
> It would be enough, IMHO :)
>
> However, we need to discuss some details about this.
>
> 1) we could extend the reset tool with an flag --start-from-offsets and
> the user can s
It would be enough, IMHO :)
However, we need to discuss some details about this.
1) we could extend the reset tool with an flag --start-from-offsets and
the user can specify an offset per partition
This would give the most flexibility, but it is hard to use. Especially
if you have many partition
Thanks Eno and Matthias for your feedback!
I've check KIP-95 and Matthias blog post (
https://www.confluent.io/blog/data-reprocessing-with-kafka-streams-resetting-a-streams-application/)
and I have a clearer idea on how stream internals work.
In a general use-case, following Application Reset Too
You can always built you own little tool similar to StreamsResetter.java
to get this done. Ie, you set the committed offset "manually" based on
timestamps before you start your application.
But as Eno mentioned, you need to think carefully about what a
consistent reset point would be because you c
Hi Jorge,
This is currently not possible, but it is likely to be considered for
discussion. One challenge is that, if you have multiple topics, it is difficult
to rewind them all back to a consistent point in time. KIP-95, currently under
discussion, is handling the slightly different issue, of
Hi everyone,
I was wondering if its possible to rewind consumers offset in Kafka Stream
using timestamp as with `offsetsForTimes(Map
timestampsToSearch)` in KafkaConsumer.
I know its possible to go back to `earliest` offset in topic or `latest`,
but would be useful to go back using timestamp as w