Thank you Tathagata, I will try it out later. -----原始邮件----- 发件人: "Tathagata Das" <[email protected]> 发送时间: 2014/2/22 11:12 收件人: "[email protected]" <[email protected]> 主题: Re: Can spark-streaming work with spark-on-yarn mode?
Yes, Spark and Spark Streaming programs can be deployed on YARN. Here is the documentation. TD On Thu, Feb 20, 2014 at 11:16 PM, 林武康 <[email protected]> wrote: hi all, I am a very newbie of apache spark, recently I have tried spark on yarn, it works for batch process. Now we want to try streaming process using spark-streaming, and still, use yarn for resource scheduler as we want to manager all the resource of the cluster used for computing tasks in a unified way. Can this works? any suggestions are welcome! -------------------------------------------------------------------------------- Best Regards！
