Mike Sells created ZEPPELIN-1342:
------------------------------------
Summary: Adding dependencies via SPARK_SUBMIT_OPTIONS doesn't work
on Spark 2.0.0
Key: ZEPPELIN-1342
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1342
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.6.1, 0.7.0
Reporter: Mike Sells
Passing dependencies via the SPARK_SUBMIT_OPTIONS seems to be broken in 0.6.1
and 0.7.0 when using Spark 2.0. To replicate pass in a package to
SPARK_SUBMIT_OPTIONS like below:
SPARK_SUBMIT_OPTIONS="--packages com.databricks:spark-avro_2.11:3.0.0"
Now try to import it with:
import com.databricks.spark.avro._
It will error out:
<console>:25: error: object databricks is not a member of package com
import com.databricks.spark.avro._
I checked the logs are there is no error retrieving the package. So it seems to
be something with the classpath.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
