Re: kafka streams locking issue in 0.10.20.0

Hi Ara, There are some instructions here for monitoring whether RocksDb is having its writes stalled: https://github.com/facebook/rocksdb/wiki/Write-Stalls , together with some instructions for tuning. Could you share RocksDb's LOG file?

Re: kafka streams locking issue in 0.10.20.0

Hi, Thanks for the reply. Let me give you more information: - we have a group by + aggregate. The hopping time window is 10 minutes but the maintainMs is 180 days (we’re trying to reprocess the entire data set of billions of records). - Over time, after just a few hours, the aggregate slows d

Re: kafka streams locking issue in 0.10.20.0

Hi Ara, This usually means that one, or more, of your StreamThreads is taking a long time during recovery or processing. So the rebalance times out and you get another rebalance. The second exception, i.e., 2017-02-22 20:12:48 WARN StreamThread:1184 - Could not create task 3_0. Will retry. org.ap