Hi
We would like to do this in PySpark Environment
i.e something like
test = sc.textFile("maprfs:///user/root/test") or
test = sc.textFile("hdfs:///user/root/test") or
Currently when we try
test = sc.textFile("maprfs:///user/root/test")
It throws the error
No File-System for scheme: maprfs
Best Regards
Santosh
From: Vladimir Rodionov [mailto:[email protected]]
Sent: Wednesday, October 01, 2014 3:59 PM
To: Addanki, Santosh Kumar
Cc: [email protected]
Subject: Re: Spark And Mapr
There is doc on MapR:
http://doc.mapr.com/display/MapR/Accessing+MapR-FS+in+Java+Applications
-Vladimir Rodionov
On Wed, Oct 1, 2014 at 3:00 PM, Addanki, Santosh Kumar
<[email protected]<mailto:[email protected]>> wrote:
Hi
We were using Horton 2.4.1 as our Hadoop distribution and now switched to MapR
Previously to read a text file we would use :
test =
sc.textFile(\"hdfs://10.48.101.111:8020/user/hdfs/test\<http://10.48.101.111:8020/user/hdfs/test%5C>")"
What would be the equivalent of the same for Mapr.
Best Regards
Santosh
