I'm a little bit late but posting in case somebody googles this.
It seems saveAsTextFile requires chmod 777 but the local directory won't
default to give w to other users.
I've tried saving to a mounted drive and was able to save without an error.
Without the the "file", it won't save to the file
]
Sent: Tuesday, January 13, 2015 3:01 PM
To: user@spark.apache.org
Subject: Re: Failed to save RDD as text file to local file system
Hi,
Could you just trying one thing. Make a directory any where out side cloudera
and than try the same write.
Suppose the directory made is testWrite.
do
ubject.java:415)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
>
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
>
>
>
> Very frustrated. Please advise.
>
>
>
>
>
> Regards,
>
:so...@cloudera.com]
Sent: Monday, January 12, 2015 11:25 AM
To: Wang, Ningjun (LNG-NPV)
Cc: user@spark.apache.org
Subject: Re: Failed to save RDD as text file to local file system
I think you're confusing HDFS paths and local paths. You are cd'ing to a
directory and seem to want to wri
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
>
>
>
> Very frustrated. Please advise.
>
>
>
>
>
> Regards,
>
>
>
> Ningjun Wang
>
> Consulting Software Engineer
>
> LexisNexis
>
> 121 Chanlon Road
>
> New Provi
ovidence, NJ 07974-1541
From: Prannoy [via Apache Spark User List]
[mailto:ml-node+s1001560n21093...@n3.nabble.com]
Sent: Monday, January 12, 2015 4:18 AM
To: Wang, Ningjun (LNG-NPV)
Subject: Re: Failed to save RDD as text file to local file system
Have you tried simple giving the path where you wan
Regards,
>>
>>
>>
>> Ningjun Wang
>>
>> Consulting Software Engineer
>>
>> LexisNexis
>>
>> 121 Chanlon Road
>>
>> New Providence, NJ 07974-1541
>>
>>
>>
>> From: firemonk9 [via Apache Spark User List
>
> 121 Chanlon Road
>
> New Providence, NJ 07974-1541
>
>
>
> *From:* firemonk9 [via Apache Spark User List] [mailto:ml-node+[hidden
> email] <http:///user/SendEmail.jtp?type=node&node=21068&i=0>]
> *Sent:* Friday, January 09, 2015 2:56 PM
> *To:* Wang, Ni
)
Subject: Re: Failed to save RDD as text file to local file system
Have you found any resolution for this issue ?
If you reply to this email, your message will be added to the discussion below:
http://apache-spark-user-list.1001560.n3.nabble.com/Failed-to-save-RDD
Have you found any resolution for this issue ?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Failed-to-save-RDD-as-text-file-to-local-file-system-tp21050p21067.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
looks like it is trying to save the file in Hdfs.
Check if you have set any hadoop path in your system.
On Fri, Jan 9, 2015 at 12:14 PM, Raghavendra Pandey <
raghavendra.pan...@gmail.com> wrote:
> Can you check permissions etc as I am able to run
> r.saveAsTextFile("file:///home/cloudera/tmp/out
Can you check permissions etc as I am able to run
r.saveAsTextFile("file:///home/cloudera/tmp/out1")
successfully on my machine..
On Fri, Jan 9, 2015 at 10:25 AM, NingjunWang
wrote:
> I try to save RDD as text file to local file system (Linux) but it does not
> work
>
> Launch spark-shell and ru
12 matches
Mail list logo
