Hi - I have been running a streaming application on some data set. Things usually run ok. Today I was trying to run the same application on Kafka (ver 0.10.2.1 on Scala 2.12) installed in a Mesos DC/OS cluster. After running for quite some time, I got the following exception ..
Exception in thread "StreamThread-1" java.lang.IllegalStateException: > Attempt to retrieve exception from future which hasn't failed > at > org.apache.kafka.clients.consumer.internals.RequestFuture.exception(RequestFuture.java:99) > at > org.apache.kafka.clients.consumer.internals.RequestFuture.isRetriable(RequestFuture.java:89) > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:590) > at > org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1124) > at > org.apache.kafka.streams.processor.internals.StreamTask.commitOffsets(StreamTask.java:296) > at > org.apache.kafka.streams.processor.internals.StreamTask$1.run(StreamTask.java:79) > at > org.apache.kafka.streams.processor.internals.StreamsMetricsImpl.measureLatencyNs(StreamsMetricsImpl.java:188) > at > org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:280) > at > org.apache.kafka.streams.processor.internals.StreamThread.commitOne(StreamThread.java:807) > at > org.apache.kafka.streams.processor.internals.StreamThread.commitAll(StreamThread.java:794) > at > org.apache.kafka.streams.processor.internals.StreamThread.maybeCommit(StreamThread.java:769) > at > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:647) > at > org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) Looks like some internal processing failed and control went to an unexpected path. I have 2 questions .. 1. any idea why this could happen ? I don't think it's related to Mesos DC/OS though - may be some concurrency issue ? 2. how do I recover from such errors ? The stream processor has stopped and the only way out is to restart the application. regards. -- Debasish Ghosh http://manning.com/ghosh2 http://manning.com/ghosh Twttr: @debasishg Blog: http://debasishg.blogspot.com Code: http://github.com/debasishg
