Hello,
I have single node cluster with the default config. This kind of setup
works fine on windows and osx but on Ubutu, the supervisor nodes turns
itself off almost immediately after it is started.
I have deleted the local directory of the supervisor and restarted it but I
run into the same issue. The main issue seems to be that supervisor cannot
run the "kill" command. I have tried to launch the supervisor using sudo
but it still stops itself.
Any help will be greatly appreciated.
Here is the relevant part of the supervisor log file.
2015-01-28T13:15:37.228-0500 o.a.s.z.ClientCnxn [INFO] Session
establishment complete on server localhost/127.0.0.1:2181, sessionid =
0x14b31bc31d60005, negotiated timeout = 20000
2015-01-28T13:15:37.228-0500 o.a.s.c.f.s.ConnectionStateManager [INFO]
State change: CONNECTED
2015-01-28T13:15:37.320-0500 b.s.d.supervisor [INFO] Starting supervisor
with id c9d819d2-af1b-46d0-bf79-8a37b95ae0f3 at host fai-Virtual-Machine
2015-01-28T13:15:38.168-0500 b.s.d.supervisor [INFO] Shutting down and
clearing state for id 67806496-3654-431d-833d-9575e15c2bdb. Current
supervisor time: 1422468938. State: :disallowed, Heartbeat:
#backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1421553734,
:storm-id "OpenXCLive-1-1421553686", :executors #{[2 2] [3 3] [4 4] [-1 -1]
[1 1]}, :port 6703}
2015-01-28T13:15:38.168-0500 b.s.d.supervisor [INFO] Shutting down
c9d819d2-af1b-46d0-bf79-8a37b95ae0f3:67806496-3654-431d-833d-9575e15c2bdb
2015-01-28T13:15:38.179-0500 b.s.event [ERROR] Error when processing event
java.io.IOException: Cannot run program "kill" (in directory "."): error=2,
No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1047)
~[na:1.7.0_76]
at java.lang.Runtime.exec(Runtime.java:617) ~[na:1.7.0_76]
at
org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:58)
~[commons-exec-1.1.jar:1.1]
at
org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:254)
~[commons-exec-1.1.jar:1.1]
at
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:319)
~[commons-exec-1.1.jar:1.1]
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:160)
~[commons-exec-1.1.jar:1.1]
at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:147)
~[commons-exec-1.1.jar:1.1]
at backtype.storm.util$exec_command_BANG_.invoke(util.clj:386)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.util$send_signal_to_process.invoke(util.clj:415)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.util$kill_process_with_sig_term.invoke(util.clj:426)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.supervisor$shutdown_worker.invoke(supervisor.clj:194)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:261)
~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2467.invoke(event.clj:40)
~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_76]
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method) ~[na:1.7.0_76]
at java.lang.UNIXProcess.<init>(UNIXProcess.java:186) ~[na:1.7.0_76]
at java.lang.ProcessImpl.start(ProcessImpl.java:130) ~[na:1.7.0_76]
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1028)
~[na:1.7.0_76]
... 19 common frames omitted
2015-01-28T13:15:38.189-0500 b.s.util [ERROR] Halting process: ("Error when
processing an event")
java.lang.RuntimeException: ("Error when processing an event")
at backtype.storm.util$exit_process_BANG_.doInvoke(util.clj:325)
[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.RestFn.invoke(RestFn.java:423) [clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2467.invoke(event.clj:48)
[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_76]
2015-01-28T13:15:38.192-0500 b.s.d.supervisor [INFO] Shutting down
supervisor c9d819d2-af1b-46d0-bf79-8a37b95ae0f3
2015-01-28T13:15:38.193-0500 b.s.event [INFO] Event manager interrupted
Thanks,
Faisal
