Cool. I was thinking of waiting a second and doing ps aux | grep java | grep
jarname.jar, and I guess checking 4040 would work as as well. Thanks for the
input.
Regards,Ashic.
Date: Sat, 24 Jan 2015 13:00:13 +0530
Subject: Re: Starting a spark streaming app in init.d
From: ak
I'd do the same but put an extra condition to check whether the job has
successfully started or not by checking the application ui (port
availability 4040 would do, if you want more complex one then write a
parser for the same.) after putting the main script on sleep for some time
(say 2 minutes).
Hello,
I'm trying to kick off a spark streaming job to a stand alone master using
spark submit inside of init.d. This is what I have:
DAEMON="spark-submit --class Streamer --executor-memory 500M
--total-executor-cores 4 /path/to/assembly.jar"
start() {
$DAEMON -p /var/run/my_assembly.p
