Ara Ebrahimi created KAFKA-4392:
-----------------------------------
Summary: Failed to lock the state directory due to an unexpected
exception
Key: KAFKA-4392
URL: https://issues.apache.org/jira/browse/KAFKA-4392
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 0.10.1.0
Reporter: Ara Ebrahimi
Assignee: Guozhang Wang
This happened on streaming startup, on a clean installation, no existing
folder. Here I was starting 4 instances of our streaming app on 4 machines and
one threw this exception. Seems to me there’s a race condition somewhere when
instances discover others, or something like that.
2016-11-02 15:43:47 INFO StreamRunner:59 - Started http server successfully.
2016-11-02 15:44:50 ERROR StateDirectory:147 - Failed to lock the state
directory due to an unexpected exception
java.nio.file.NoSuchFileException:
/data/1/kafka-streams/myapp-streams/7_21/.lock
at
sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at
sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:177)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:335)
at
org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:176)
at
org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:90)
at
org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:140)
at
org.apache.kafka.streams.processor.internals.StreamThread.maybeClean(StreamThread.java:552)
at
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:459)
at
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242)
^C
[arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/7_21/
ls: cannot access /data/1/kafka-streams/myapp-streams/7_21/: No such file or
directory
[arae@a4 ~]$ ls -al /data/1/kafka-streams/myapp-streams/
total 4
drwxr-xr-x 74 root root 4096 Nov 2 15:44 .
drwxr-xr-x 3 root root 27 Nov 2 15:43 ..
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_1
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_13
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_14
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_16
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_2
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_22
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_28
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_3
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_31
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_5
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_7
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_8
drwxr-xr-x 3 root root 32 Nov 2 15:43 0_9
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_1
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_10
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_14
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_15
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_16
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_17
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_18
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_3
drwxr-xr-x 3 root root 32 Nov 2 15:43 1_5
drwxr-xr-x 3 root root 60 Nov 2 15:43 2_1
drwxr-xr-x 3 root root 60 Nov 2 15:43 2_10
drwxr-xr-x 3 root root 60 Nov 2 15:43 2_12
drwxr-xr-x 3 root root 60 Nov 2 15:43 2_20
drwxr-xr-x 3 root root 60 Nov 2 15:43 2_24
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_10
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_11
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_19
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_20
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_25
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_26
drwxr-xr-x 3 root root 61 Nov 2 15:43 3_3
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_11
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_12
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_18
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_19
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_24
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_25
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_26
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_4
drwxr-xr-x 3 root root 64 Nov 2 15:43 4_9
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_1
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_10
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_11
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_13
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_15
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_17
drwxr-xr-x 3 root root 58 Nov 2 15:43 5_18
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_13
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_15
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_18
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_19
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_20
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_21
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_24
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_4
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_7
drwxr-xr-x 2 root root 18 Nov 2 15:43 6_8
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_16
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_19
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_20
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_25
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_28
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_31
drwxr-xr-x 2 root root 18 Nov 2 15:43 7_7
drwxr-xr-x 2 root root 18 Nov 2 15:43 8_13
drwxr-xr-x 2 root root 18 Nov 2 15:43 8_21
drwxr-xr-x 2 root root 18 Nov 2 15:43 8_23
drwxr-xr-x 2 root root 18 Nov 2 15:43 8_26
drwxr-xr-x 2 root root 18 Nov 2 15:43 8_31
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
