Re: Kafka Stream stops polling new messages

I would be great if we could help to simplify debugging. Any ideas? -Matthias On 5/9/17 7:11 AM, João Peixoto wrote: > I'll leave it to your discretion, after realizing the problem it was an > easy work around, the bad experience was debugging and figuring out what > was going on. > > Thanks f

Re: Kafka Stream stops polling new messages

I'll leave it to your discretion, after realizing the problem it was an easy work around, the bad experience was debugging and figuring out what was going on. Thanks for the help once again JP On Tue, May 9, 2017 at 4:36 AM Eno Thereska wrote: > Yeah that's a good point, I'm not taking action t

Re: Kafka Stream stops polling new messages

Yeah that's a good point, I'm not taking action then. Eno On Mon, May 8, 2017 at 10:38 PM, Matthias J. Sax wrote: > Hey, > > I am not against opening a JIRA, but I am wondering what we should > describe/report there. If I understand the scenario correctly, João uses > a custom RocksDB store and

Re: Kafka Stream stops polling new messages

Hey, I am not against opening a JIRA, but I am wondering what we should describe/report there. If I understand the scenario correctly, João uses a custom RocksDB store and calls seek() in user code land. As it is a bug in RocksDB that seek takes so long, I am not sure what we could improve within

Re: Kafka Stream stops polling new messages

That'd be great as I'm not familiar with the protocol there On Wed, May 3, 2017 at 8:41 AM Eno Thereska wrote: > Cool, thanks, shall we open a JIRA? > > Eno > > On 3 May 2017, at 16:16, João Peixoto wrote: > > > > Actually I need to apologize, I pasted the wrong issue, I meant to paste > > https

Re: Kafka Stream stops polling new messages

Cool, thanks, shall we open a JIRA? Eno > On 3 May 2017, at 16:16, João Peixoto wrote: > > Actually I need to apologize, I pasted the wrong issue, I meant to paste > https://github.com/facebook/rocksdb/issues/261. > > RocksDB did not produce a crash report since it didn't actually crash. I > pe

Re: Kafka Stream stops polling new messages

Actually I need to apologize, I pasted the wrong issue, I meant to paste https://github.com/facebook/rocksdb/issues/261. RocksDB did not produce a crash report since it didn't actually crash. I performed thread dumps on stale and not-stale instances which revealed the common behavior and I collect

Re: Kafka Stream stops polling new messages

Hi there, Thanks for double checking. Does RocksDB actually crash or produce a crash dump? I’m curious how you know that the issue is https://github.com/facebook/rocksdb/issues/1121 , so just double checking with you. If that’s indeed the case,

Re: Kafka Stream stops polling new messages

I believe I found the root cause of my problem. I seem to have hit this RocksDB bug https://github.com/facebook/rocksdb/issues/1121 On my stream configuration I have a custom transformer used for deduplicating records, highly inspired in the EventDeduplicationLambdaIntegrationTest

Re: Kafka Stream stops polling new messages

Did you check the logs? Maybe you need to increase log level to DEBUG to get some more information. Did you double check committed offsets via bin/kafka-consumer-groups.sh? -Matthias On 4/28/17 9:22 AM, João Peixoto wrote: > My stream gets stale after a while and it simply does not receive any n