Re: How to properly use a clean a TimestampedKeyValueStore

2022-01-04 Thread Matthias J. Sax
Not 100% sure. From what you describe it should work as expected. It seems `delete()` does not delete the key from the store (ie, RocksDB) itself (for unknown reasons)? Are you closing all your iterators correctly? (More or less a wild guess at the moment.) Did you enable caching for the st

Re: Kafka Streams - one topic moves faster the other one

2022-01-04 Thread Matthias J. Sax
If you observer timestamps based synchronization issues, you might also consider to switch to 3.0 release, that closes a few more gaps to this end. Cf https://cwiki.apache.org/confluence/display/KAFKA/KIP-695%3A+Further+Improve+Kafka+Streams+Timestamp+Synchronization -Matthias On 12/29/21 7

Re: How to properly use a clean a TimestampedKeyValueStore

2022-01-04 Thread Guozhang Wang
Hi Miguel, How is your kvStore being constructed? Could you paste the snippet of the related construction code, as well as the related iterating / deletion code here? On Tue, Jan 4, 2022 at 2:25 PM Matthias J. Sax wrote: > Not 100% sure. From what you describe it should work as expected. > > It

Re: How to properly use a clean a TimestampedKeyValueStore

2022-01-04 Thread Miguel González
Hello Here's my store definition and my transformer with the whole logic (I included the transformer with issues and another version (V2) of the transformer with some improvements that I believe are necessary) https://gist.github.com/magg/576bf3381c9c0501b9761b54e9d86375 Thanks - Miguel On