Hi jack,

Glad that you figured this out.

On Friday, February 26, 2016, Jack Huang <jackhu...@machinezone.com> wrote:

> Turns out that I need to set the environment variable
>
> export HADOOP_YARN_HOME=/etc/hadoop
>
> so that the *run-class.sh *script will pick up the right config file
>
> Jack Huang
>
> On Wed, Feb 24, 2016 at 5:56 PM, Jack Huang <jackhu...@machinezone.com
> <javascript:;>>
> wrote:
>
> > Hi all,
> >
> > I am having trouble running the hello-samza example (
> > http://samza.apache.org/learn/tutorials/0.10/run-in-multi-node-yarn.html
> )
> > on our HDP cluster, which is set up with Ambari.
> >
> > Upon running
> >
> > *deploy/samza/bin/run-job.sh
> >
> --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory
> > --config-path=file://$PWD/deploy/samza/config/wikipedia-feed.properties*
> >
> >
> > The output shows that Samza keeps trying to reach YARN's ResourceManager
> > at *0.0.0.0:8032 <http://0.0.0.0:8032>* but can't.
> >
> > *2016-02-25 01:28:00 ClientHelper [INFO] trying to connect to RM
> > 0.0.0.0:8032 <http://0.0.0.0:8032>*
> > *2016-02-25 01:28:00 RMProxy [INFO] Connecting to ResourceManager at
> > /0.0.0.0:8032 <http://0.0.0.0:8032>*
> > *2016-02-25 01:28:00 NativeCodeLoader [WARN] Unable to load native-hadoop
> > library for your platform... using builtin-java classes where applicable*
> > *2016-02-25 01:28:02 Client [INFO] Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 0
> > time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
> > sleepTime=1000 MILLISECONDS)*
> > *2016-02-25 01:28:03 Client [INFO] Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 1
> > time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
> > sleepTime=1000 MILLISECONDS)*
> > *2016-02-25 01:28:04 Client [INFO] Retrying connect to server:
> > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 2
> > time(s); retry policy is
> RetryUpToMaximumCountWithFixedSleep(maxRetries=10,
> > sleepTime=1000 MILLISECONDS)*
> >
> >
> > For our cluster ResourceManager is running on *node2*. Here are the
> > properties related to the ResourceManager address in *yarn-site.xml
> *(which
> > was generated by Ambari) on the machine I am running hello-samza:
> >
> > *<property>*
> > *  <name>yarn.resourcemanager.address</name>*
> > *  <value>node02:8050</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.admin.address</name>*
> > *  <value>node02:8141</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.bind-host</name>*
> > *  <value>0.0.0.0</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.resource-tracker.address</name>*
> > *  <value>node02:8025</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.scheduler.address</name>*
> > *  <value>node02:8030</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.webapp.https.address</name>*
> > *  <value>node02:8090</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.webapp.address</name>*
> > *  <value>node02:8088</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.hostname</name>*
> > *  <value>node02</value>*
> > *</property>*
> > *<property>*
> > *  <name>yarn.resourcemanager.zk-address</name>*
> > *  <value>node03:2181,node01:2181,node02:2181</value>*
> > *</property>*
> >
> >
> > I can't find any other place that specifies ResourceManager address. Can
> > anyone help?
> >
> >
> > Thanks,
> >
> > Jack Huang
> >
>


-- 
Sent from my iphone.

Reply via email to