Thanks Cody :) Regards,
Sivakumaran > On 22-Jul-2016, at 2:57 PM, Cody Koeninger <c...@koeninger.org> wrote: > > http://spark.apache.org/docs/latest/submitting-applications.html > > look at cluster mode, supervise > > On Fri, Jul 22, 2016 at 8:46 AM, Sivakumaran S <siva.kuma...@me.com> wrote: >> Hello, >> >> I have a spark streaming process on a cluster ingesting a realtime data >> stream from Kafka. The aggregated, processed output is written to Cassandra >> and also used for dashboard display. >> >> My question is - If the node running the driver program fails, I am guessing >> that the entire process fails and has to be restarted. Is there any way to >> obviate this? Is my understanding correct that the spark-submit in its >> current form is a Single Point of Vulnerability, much akin to the NameNode >> in HDFS? >> >> regards >> >> Sivakumaran S >> --------------------------------------------------------------------- >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
