Hi Bill, 1. sure, can extract some logs, what exactly to look for? There are 11 hours of logs and most of them looks like:
[2017-06-27 03:30:50,553] [] [INFO ] [StreamThread-1] [org.apache.kafka.streams.processor.internals.StreamThread] [stream-thread [StreamThread-1] Committing all tasks because the commit interval 5000ms has elapsed] [2017-06-27 03:30:50,553] [] [INFO ] [StreamThread-1] [org.apache.kafka.streams.processor.internals.StreamThread] [stream-thread [StreamThread-1] Committing task StreamTask 0_0] [2017-06-27 03:30:50,554] [] [INFO ] [StreamThread-1] [org.apache.kafka.streams.processor.internals.StreamThread] [stream-thread [StreamThread-1] Committing task StreamTask 2_0] Something specific to search for? 2. Yes, there are more messages coming to topic. On Wed, Jun 28, 2017 at 3:43 PM, Bill Bejeck <b...@confluent.io> wrote: > Hi Dimitry, > > I'm happy to help, but I could use more information. Can you share the > streams logs and broker logs? > > Have you confirmed messages are still being delivered to topics (via > console consumer)? > > Thanks, > Bill > > On Wed, Jun 28, 2017 at 8:24 AM, Dmitriy Vsekhvalnov < > dvsekhval...@gmail.com > > wrote: > > > Hi all, > > > > looking for some assistance in debugging kafka-streams application. > > > > Kafka broker 0.10.2.1 - x3 Node cluster > > kafka-streams 0.10.2.1 - x2 application nodes x 1 stream thread each. > > > > In streams configuration only: > > - SSL transport > > - kafka.streams.commitIntervalMs set to 5000 (instead of default 30s). > > > > We running simple aggregation app with several grouping streams. Running > 2 > > instances of an app for redundancy. Both instances were working pretty > fine > > for 11 hours 15 minutes then stopped consuming new events from topic. > > > > Hosting JVM processes were working fine, just streams stopped reacting to > > new data. No exceptions, errors, e.t.c. in logs. After restart streams > > still not consuming new messages. > > > > Below is 2 last entries from kafka-streams logs from both hosts: > > > > [2017-06-27 14:45:09,663] [] [INFO ] [StreamThread-1] > > [org.apache.kafka.streams.processor.internals.StreamThread] > [stream-thread > > [StreamThread-1] Committing task StreamTask 4_2] > > > > [2017-06-27 14:45:09,723] [] [INFO ] [StreamThread-1] > > [org.apache.kafka.streams.processor.internals.StreamThread] > [stream-thread > > [StreamThread-1] Committing task StreamTask 2_1] > > > > Pretty puzzling why they stopped exactly same moment (with respect to > > millis). > > > > Really appreciate any ideas where to dig to. > > > > Thank you. > > >
