Turns out that I need to set the environment variable export HADOOP_YARN_HOME=/etc/hadoop
so that the *run-class.sh *script will pick up the right config file Jack Huang On Wed, Feb 24, 2016 at 5:56 PM, Jack Huang <jackhu...@machinezone.com> wrote: > Hi all, > > I am having trouble running the hello-samza example ( > http://samza.apache.org/learn/tutorials/0.10/run-in-multi-node-yarn.html) > on our HDP cluster, which is set up with Ambari. > > Upon running > > *deploy/samza/bin/run-job.sh > --config-factory=org.apache.samza.config.factories.PropertiesConfigFactory > --config-path=file://$PWD/deploy/samza/config/wikipedia-feed.properties* > > > The output shows that Samza keeps trying to reach YARN's ResourceManager > at *0.0.0.0:8032 <http://0.0.0.0:8032>* but can't. > > *2016-02-25 01:28:00 ClientHelper [INFO] trying to connect to RM > 0.0.0.0:8032 <http://0.0.0.0:8032>* > *2016-02-25 01:28:00 RMProxy [INFO] Connecting to ResourceManager at > /0.0.0.0:8032 <http://0.0.0.0:8032>* > *2016-02-25 01:28:00 NativeCodeLoader [WARN] Unable to load native-hadoop > library for your platform... using builtin-java classes where applicable* > *2016-02-25 01:28:02 Client [INFO] Retrying connect to server: > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 0 > time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, > sleepTime=1000 MILLISECONDS)* > *2016-02-25 01:28:03 Client [INFO] Retrying connect to server: > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 1 > time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, > sleepTime=1000 MILLISECONDS)* > *2016-02-25 01:28:04 Client [INFO] Retrying connect to server: > 0.0.0.0/0.0.0.0:8032 <http://0.0.0.0/0.0.0.0:8032>. Already tried 2 > time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, > sleepTime=1000 MILLISECONDS)* > > > For our cluster ResourceManager is running on *node2*. Here are the > properties related to the ResourceManager address in *yarn-site.xml *(which > was generated by Ambari) on the machine I am running hello-samza: > > *<property>* > * <name>yarn.resourcemanager.address</name>* > * <value>node02:8050</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.admin.address</name>* > * <value>node02:8141</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.bind-host</name>* > * <value>0.0.0.0</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.resource-tracker.address</name>* > * <value>node02:8025</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.scheduler.address</name>* > * <value>node02:8030</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.webapp.https.address</name>* > * <value>node02:8090</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.webapp.address</name>* > * <value>node02:8088</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.hostname</name>* > * <value>node02</value>* > *</property>* > *<property>* > * <name>yarn.resourcemanager.zk-address</name>* > * <value>node03:2181,node01:2181,node02:2181</value>* > *</property>* > > > I can't find any other place that specifies ResourceManager address. Can > anyone help? > > > Thanks, > > Jack Huang >
