Issue with Spark + Zeppelin on Mesos - Failed to create local dir

2016-07-27 Thread Michael Sells
Trying to get Zeppelin running on Mesos and I'm consistently hitting the following error when I try to create a dataframe/rdd from a file. java.io.IOException: Failed to create local dir in /tmp/blockmgr-82f31798-dd17-4907-a039-d1c90bf12a80/0e. at org.apache.spark.storage.DiskBlockManager.getFile(

Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-16 Thread Michael Sells
Testing out 0.6.1 with Spark 2.0 and discovered the way we load dependencies doesn't seem to be working with the new update. We pass new dependencies in via a SPARK_SUBMIT_OPTIONS environment variable pass the following flags: --packages com.databricks:spark-avro_2.11:3.0.0 Now when I try to impo

Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-17 Thread Michael Sells
0.6.1 & master branch, please file a ticket for >> that. >> >> On Wed, Aug 17, 2016 at 4:09 AM, Michael Sells wrote: >> >>> Testing out 0.6.1 with Spark 2.0 and discovered the way we load >>> dependencies doesn't seem to be working with the ne

Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1

2016-08-17 Thread Michael Sells
Thanks. Created a JIRA and referenced 0.6.1 and 0.7.0. On Wed, Aug 17, 2016 at 8:21 AM Dylan Meissner < dylan.meiss...@gettyimages.com> wrote: > Thanks for pointing this out. It is impacting 0.7.0 as well. > -- > *From:* Michael Sells > *Sent:* We