I moved the state folder to a separate drive and linked out to it. I'll try your suggestion and point directly.
On Sun, Dec 11, 2016 at 2:20 PM, Matthias J. Sax <matth...@confluent.io> wrote: > I am not sure, but this might be related with your state directory. > > You use default directory that is located in /tmp -- could it be, that > /tmp gets clean up and thus you loose files/directories? > > Try to reconfigure your state directory via StreamsConfig: > http://docs.confluent.io/current/streams/developer-guide.html#optional- > configuration-parameters > > > -Matthias > > On 12/11/16 1:28 AM, Jon Yeargers wrote: > > Seeing this appearing somewhat frequently - > > > > org.apache.kafka.streams.errors.ProcessorStateException: Error opening > > store minute_agg_stream-201612100812 at location > > /tmp/kafka-streams/MinuteAgg/1_9/minute_agg_stream/minute_ > agg_stream-201612100812 > > > > at > > org.apache.kafka.streams.state.internals.RocksDBStore. > openDB(RocksDBStore.java:196) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBStore. > openDB(RocksDBStore.java:158) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore$Segment. > openDB(RocksDBWindowStore.java:72) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore. > getOrCreateSegment(RocksDBWindowStore.java:402) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore.putInternal( > RocksDBWindowStore.java:333) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore.access$100( > RocksDBWindowStore.java:51) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore$2.restore( > RocksDBWindowStore.java:212) > > > > at > > org.apache.kafka.streams.processor.internals.ProcessorStateManager. > restoreActiveState(ProcessorStateManager.java:235) > > > > at > > org.apache.kafka.streams.processor.internals.ProcessorStateManager. > register(ProcessorStateManager.java:198) > > > > at > > org.apache.kafka.streams.processor.internals. > ProcessorContextImpl.register(ProcessorContextImpl.java:123) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBWindowStore.init( > RocksDBWindowStore.java:206) > > > > at > > org.apache.kafka.streams.state.internals.MeteredWindowStore.init( > MeteredWindowStore.java:66) > > > > at > > org.apache.kafka.streams.state.internals.CachingWindowStore.init( > CachingWindowStore.java:64) > > > > at > > org.apache.kafka.streams.processor.internals.AbstractTask. > initializeStateStores(AbstractTask.java:81) > > > > at > > org.apache.kafka.streams.processor.internals. > StreamTask.<init>(StreamTask.java:120) > > > > at > > org.apache.kafka.streams.processor.internals. > StreamThread.createStreamTask(StreamThread.java:633) > > > > at > > org.apache.kafka.streams.processor.internals. > StreamThread.addStreamTasks(StreamThread.java:660) > > > > at > > org.apache.kafka.streams.processor.internals.StreamThread.access$100( > StreamThread.java:69) > > > > at > > org.apache.kafka.streams.processor.internals.StreamThread$1. > onPartitionsAssigned(StreamThread.java:124) > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator. > onJoinComplete(ConsumerCoordinator.java:228) > > > > at > > org.apache.kafka.clients.consumer.internals.AbstractCoordinator. > joinGroupIfNeeded(AbstractCoordinator.java:313) > > > > at > > org.apache.kafka.clients.consumer.internals.AbstractCoordinator. > ensureActiveGroup(AbstractCoordinator.java:277) > > > > at > > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll( > ConsumerCoordinator.java:259) > > > > at > > org.apache.kafka.clients.consumer.KafkaConsumer. > pollOnce(KafkaConsumer.java:1013) > > > > at > > org.apache.kafka.clients.consumer.KafkaConsumer.poll( > KafkaConsumer.java:979) > > > > at > > org.apache.kafka.streams.processor.internals.StreamThread.runLoop( > StreamThread.java:407) > > > > at > > org.apache.kafka.streams.processor.internals. > StreamThread.run(StreamThread.java:242) > > > > Caused by: org.rocksdb.RocksDBException: IO error: lock > > /tmp/kafka-streams/MinuteAgg/1_9/minute_agg_stream/minute_ > agg_stream-201612100812/LOCK: > > No locks available > > > > at org.rocksdb.RocksDB.open(Native Method) > > > > at org.rocksdb.RocksDB.open(RocksDB.java:184) > > > > at > > org.apache.kafka.streams.state.internals.RocksDBStore. > openDB(RocksDBStore.java:189) > > > > ... 26 common frames omitted > > > >
