Hi Damian, Sorry for the delayed reply have been out of office.
I'm afraid I cannot check. We have alarms on our auto scaling groups for stream instances to kill them should the CPU utilization be < 1 for 30 mins. On Fri 30 Jun 2017 at 5:05 p.m., Damian Guy <damian....@gmail.com> wrote: > Hi Ian, > > Can you check if the file exists and it is indeed a file rather then a > directory? > > Thanks, > Damian > > On Fri, 30 Jun 2017 at 16:45 Damian Guy <damian....@gmail.com> wrote: > > > Hi Ian, > > > > We had another report of what looks like the same issue. Will look into > it. > > > > Thanks, > > Damian > > > > On Fri, 30 Jun 2017 at 16:38 Ian Duffy <i...@ianduffy.ie> wrote: > > > >> Hi All, > >> > >> I was wondering if any of those who know stream internals should shed > any > >> light on the following exception: > >> > >> org.apache.kafka.streams.errors.ProcessorStateException: Error while > >> closing the state manager at > >> > >> > org.apache.kafka.streams.processor.internals.AbstractTask.closeStateManager(AbstractTask.java:133) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.StreamThread.closeNonAssignedSuspendedTasks(StreamThread.java:898) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.StreamThread.access$500(StreamThread.java:69) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:233) > >> at > >> > >> > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) > >> at > >> > >> > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) > >> at > >> > >> > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) > >> at > >> > >> > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) > >> at > >> > >> > org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) > >> at > >> > >> > org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) > >> Caused by: java.io.FileNotFoundException: > >> /data/kafka-streams-freshness/freshness-id-prod/2_46/.checkpoint.tmp (No > >> such file or directory) at java.io.FileOutputStream.open0(Native Method) > >> at > >> java.io.FileOutputStream.open(FileOutputStream.java:270) at > >> java.io.FileOutputStream.<init>(FileOutputStream.java:213) at > >> java.io.FileOutputStream.<init>(FileOutputStream.java:162) at > >> > >> > org.apache.kafka.streams.state.internals.OffsetCheckpoint.write(OffsetCheckpoint.java:71) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.ProcessorStateManager.close(ProcessorStateManager.java:386) > >> at > >> > >> > org.apache.kafka.streams.processor.internals.AbstractTask.closeStateManager(AbstractTask.java:131) > >> ... 11 common frames omitted > >> > >> Thanks, > >> Ian. > >> > > >
