Hi there, Read your question and I do believe you are on right path. But what could be worth checking is - are you able to connect to s3 bucket from your worker nodes.
I did read that you are able to do it from your machine but since write happens at the the worker end, it might be worth checking the connection from there. Best, Shobhit G -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
