Re: spark 1.1.0 (w/ hadoop 2.4) vs aws java sdk 1.7.2

2015-01-22 Thread William-Smith
I have had the same issue while using HttpClient from AWS EMR Spark Streaming to post to a nodejs server. I have found ... using Classloder.getResource('org/apache/http/client/HttpClient") that the class Is being loaded front the spark-assembly-1.1.0-hadoop2.4.0.jar. That in itself is not t

Re: spark 1.1.0 (w/ hadoop 2.4) vs aws java sdk 1.7.2

2015-01-24 Thread William-Smith
Hey Sean, I did find that after my post and tried it spark.files.userClassPathFirst = true But it is deemed in the docs as instrumental and did not work. Monitored that additional config via the logs and it did not complain ... no change though. So... Due to my timeline for a Demo