Re: rack-topology.sh no such file or directory

2014-11-25 Thread Arun Luthra
Problem was solved by having the admins put this file on the edge nodes. Thanks, Arun On Wed, Nov 19, 2014 at 12:27 PM, Matei Zaharia wrote: > Your Hadoop configuration is set to look for this file to determine racks. > Is the file present on cluster nodes? If not, look at your hdfs-site.xml >

Re: rack-topology.sh no such file or directory

2014-11-19 Thread Matei Zaharia
Your Hadoop configuration is set to look for this file to determine racks. Is the file present on cluster nodes? If not, look at your hdfs-site.xml and remove the setting for a rack topology script there (or it might be in core-site.xml). Matei > On Nov 19, 2014, at 12:13 PM, Arun Luthra wrot

rack-topology.sh no such file or directory

2014-11-19 Thread Arun Luthra
I'm trying to run Spark on Yarn on a hortonworks 2.1.5 cluster. I'm getting this error: 14/11/19 13:46:34 INFO cluster.YarnClientSchedulerBackend: Registered executor: Actor[akka.tcp://sparkExecutor@#/user/Executor#- 2027837001] with ID 42 14/11/19 13:46:34 WARN net.ScriptBasedMapping: