Hi, I think it's cluster deploy mode.
spark-submit --deploy-mode cluster --master yarn myStreamingApp.jar Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Fri, Aug 12, 2016 at 4:38 PM, Shifeng Xiao <xiaoshife...@gmail.com> wrote: > Hi folks, > > I am using Spark streaming, and I am not clear if there is smart way to > restart the app once it fails, currently we just have one cron job to check > if the job is running every 2 or 5 minutes and restart the app when > necessary. > > According to spark streaming guide: > > YARN - Yarn supports a similar mechanism for automatically restarting an > application. Please refer to YARN documentation for more details. > > > Not sure how to achieve that with YARN, anyone can help me on it? > > Thanks --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
