I think this is issue of spark 2.0 or scala 2.11, as I can also reproduce
it in spark-shell of spark 2.0
On Wed, Aug 17, 2016 at 8:59 AM, Jeff Zhang wrote:
> I can also reproduce it in master, please file a ticket.
>
> On Wed, Aug 17, 2016 at 4:56 AM, Daniel Valdivia
> wrote:
>
>> Hi,
>>
>> I
This is spark 2.0 issue, I have created spark ticket
https://issues.apache.org/jira/browse/SPARK-17103
On Wed, Aug 17, 2016 at 4:05 PM, Jeff Zhang wrote:
> I think this is issue of spark 2.0 or scala 2.11, as I can also reproduce
> it in spark-shell of spark 2.0
>
> On Wed, Aug 17, 2016 at 8:
Hello,
It is exciting to see new release 0.6.1 in a short span after 0.6 release.
I am test driving 0.6.1 with spark 2.0 (Scala 2.11). RDD, DF operations are
working fine. I am facing a problem while using csv package (
https://github.com/databricks/spark-csv).
i added "com.databricks:spark-csv_
Hi Abul,
spark-csv is integrated into spark itself so you don't need to load
spark-csv dependencies anymore.
Could you try below instead?
val df = sqlContext.read.
options(Map("header" -> "true", "inferSchema" -> "true")).
csv("hdfs:// ... /S&P")
df.printSchema
Hope this solves your issue!
Mi
Thanks. I'll file a Jira. Looks like custom repos aren't loading either
from either source. I'll try to replicate as well.
Mike
On Tue, Aug 16, 2016 at 5:55 PM Mina Lee wrote:
> I also could reproduce it with Spark 2.0.0, but not with Spark 1.6.1.
> If you want to use Zeppelin with Spark 2.0, o
Abul,
Mina is right, until Spark 1.6 csv parsing was bailable as a separate spark
package. With Spark 2.0 csv parsing is built in. Zeppelin 0.6.1 ships with
Spark 2.0.
Thanks,
Vinay
On Wednesday, August 17, 2016, Mina Lee wrote:
> Hi Abul,
>
> spark-csv is integrated into spark itself so you d
Hi Vinay
Actually I succeeded using my default principal & password and using the
following default url:
jdbc:hive2://mycluster.bdata.corp:8443/;ssl=true;transportMode=http;httpPath=/gateway/pam/hive
Still a problem remains when trying to access Hive from spark:
%spark
println(sc.version)
val
Thanks for pointing this out. It is impacting 0.7.0 as well.
From: Michael Sells
Sent: Wednesday, August 17, 2016 5:46:35 AM
To: users@zeppelin.apache.org
Subject: Re: Issue loading dependency with SPARK_SUBMIT_OPTIONS w/ 0.6.1
Thanks. I'll file a Jira. Looks lik
Thanks. Created a JIRA and referenced 0.6.1 and 0.7.0.
On Wed, Aug 17, 2016 at 8:21 AM Dylan Meissner <
dylan.meiss...@gettyimages.com> wrote:
> Thanks for pointing this out. It is impacting 0.7.0 as well.
> --
> *From:* Michael Sells
> *Sent:* Wednesday, August 17, 2
