> On 23 Jul 2015, at 10:47, Greg Anderson <[email protected]> > wrote: > > So when I go to ~/ephemeral-hdfs/bin/hadoop and check its version, it says > Hadoop 2.0.0-cdh4.2.0. If I run pyspark and use the s3a address, things > should work, right? What am I missing? And thanks so much for the help so > far!
nope, sorry. You'll need a CDH 5.x for s3a, and the more recent one, 5.3? to get s3a to work reliably. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
