[
https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952201#comment-15952201
]
Steve Loughran commented on SPARK-6527:
---------------------------------------
Hadoop 2.8.0 is out the door, try against those JARs before filing bugreports
against the HADOOP- module. If you do find a problem, include as much as you
can, ideally logging {{org.apache.hadoop.fs.s3a.S3AFileSystem}} at debug, and
mark as a dependency of HADOOP-13204. Thanks
> sc.binaryFiles can not access files on s3
> -----------------------------------------
>
> Key: SPARK-6527
> URL: https://issues.apache.org/jira/browse/SPARK-6527
> Project: Spark
> Issue Type: Bug
> Components: EC2, Input/Output
> Affects Versions: 1.2.0, 1.3.0
> Environment: I am running Spark on EC2
> Reporter: Zhao Zhang
> Priority: Minor
>
> The sc.binaryFIles() can not access the files stored on s3. It can correctly
> list the number of files, but report "file does not exist" when processing
> them. I also tried sc.textFile() which works fine.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
