> -----Original Message-----
> From: Marcelo Vanzin [mailto:[email protected]]
> Hi Ken,
>
> On Mon, Apr 21, 2014 at 1:39 PM, Williams, Ken
> <[email protected]> wrote:
> > I haven't figured out how to let the hostname default to the host
> mentioned in our /etc/hadoop/conf/hdfs-site.xml like the Hadoop
> command-line tools do, but that's not so important.
>
> Try adding "/etc/hadoop/conf" to SPARK_CLASSPATH.
It looks like I already had my config set up properly, but I didn't understand
the URL syntax - the following works:
sc.textFile("hdfs:///user/kwilliams/dat/part-m-00000")
In other words, just omit the hostname between the 2nd and 3rd slash of the URL.
-Ken
________________________________
CONFIDENTIALITY NOTICE: This e-mail message is for the sole use of the intended
recipient(s) and may contain confidential and privileged information. Any
unauthorized review, use, disclosure or distribution of any kind is strictly
prohibited. If you are not the intended recipient, please contact the sender
via reply e-mail and destroy all copies of the original message. Thank you.
