Re: spark with label nodes in yarn

2015-12-15 Thread Saisai Shao
时间:* 2015年12月16日 9:21 > *收件人:* 'Ted Yu' > *抄送:* 'Saisai Shao'; 'dev' > *主题:* Re: spark with label nodes in yarn > > > > Oops... > > > > I do use spark 1.5.0 and apache hadoop 2.6.0 (spark 1.4.1 + apache hadoop > 2.6.0 is a typo), sor

Re: spark with label nodes in yarn

2015-12-15 Thread 张志强(旺轩)
one more question , do I have to configure label for my capacity scheduler? is this mandatory? 发件人: AllenZ [mailto:zzq98...@alibaba-inc.com] 发送时间: 2015年12月16日 9:21 收件人: 'Ted Yu' 抄送: 'Saisai Shao'; 'dev' 主题: Re: spark with label nodes in yarn Oops... I

Re: spark with label nodes in yarn

2015-12-15 Thread 张志强(旺轩)
Oops... I do use spark 1.5.0 and apache hadoop 2.6.0 (spark 1.4.1 + apache hadoop 2.6.0 is a typo), sorry Thanks, Allen 发件人: Ted Yu [mailto:yuzhih...@gmail.com] 发送时间: 2015年12月15日 22:59 收件人: 张志强(旺轩) 抄送: Saisai Shao; dev 主题: Re: spark with label nodes in yarn Please upgrade to

Re: spark with label nodes in yarn

2015-12-15 Thread Ted Yu
feature with spark 1.5.0, what happened to me > was I was blocked to get the YARN containers by setting > spark.yarn.executor.nodeLabelExpression property. My question, > https://issues.apache.org/jira/browse/SPARK-7173 will fix this? > > > > Thanks > > Allen >

Re: spark with label nodes in yarn

2015-12-15 Thread Saisai Shao
Allen > > > > > > *发件人:* Ted Yu [mailto:yuzhih...@gmail.com] > *发送时间:* 2015年12月15日 17:39 > *收件人:* 张志强(旺轩) > *抄送:* dev@spark.apache.org > *主题:* Re: spark with label nodes in yarn > > > > Please take a look at: > > https://issues.apache.org/jira/browse

Re: spark with label nodes in yarn

2015-12-15 Thread Ted Yu
m] > *发送时间:* 2015年12月15日 17:39 > *收件人:* 张志强(旺轩) > *抄送:* dev@spark.apache.org > *主题:* Re: spark with label nodes in yarn > > > > Please take a look at: > > https://issues.apache.org/jira/browse/SPARK-7173 > > > > Cheers > > > On Dec 15, 2015, at

Re: spark with label nodes in yarn

2015-12-15 Thread 张志强(旺轩)
label nodes in yarn Please take a look at: https://issues.apache.org/jira/browse/SPARK-7173 Cheers On Dec 15, 2015, at 1:23 AM, 张志强(旺轩) wrote: Hi all, Has anyone tried label based scheduling via spark on yarn? I’ve tried that, it didn’t work, spark 1.4.1 + apache hadoop 2.6.0 Any

Re: spark with label nodes in yarn

2015-12-15 Thread Ted Yu
Please take a look at: https://issues.apache.org/jira/browse/SPARK-7173 Cheers > On Dec 15, 2015, at 1:23 AM, 张志强(旺轩) wrote: > > Hi all, > > Has anyone tried label based scheduling via spark on yarn? I’ve tried that, > it didn’t work, spark 1.4.1 + apache hadoop 2.6.0 > > Any feedbacks are