Hi folks, I am using Spark streaming, and I am not clear if there is smart way to restart the app once it fails, currently we just have one cron job to check if the job is running every 2 or 5 minutes and restart the app when necessary.
According to spark streaming guide: - *YARN* - Yarn supports a similar mechanism for automatically restarting an application. Please refer to YARN documentation for more details. Not sure how to achieve that with YARN, anyone can help me on it? Thanks
