Hello Vinay, Mina
Sorry about the late response. I got a chance today to verify the feature
of csv reader in Spar 2.0. It worked for me. Thanks for the direction.
AB
On Wed, Aug 17, 2016 at 6:24 PM, Vinay Shukla wrote:
> Abul,
>
> Mina is right, until Spark 1.6 csv parsing was bailable as a s
Abul,
Mina is right, until Spark 1.6 csv parsing was bailable as a separate spark
package. With Spark 2.0 csv parsing is built in. Zeppelin 0.6.1 ships with
Spark 2.0.
Thanks,
Vinay
On Wednesday, August 17, 2016, Mina Lee wrote:
> Hi Abul,
>
> spark-csv is integrated into spark itself so you d
Hi Abul,
spark-csv is integrated into spark itself so you don't need to load
spark-csv dependencies anymore.
Could you try below instead?
val df = sqlContext.read.
options(Map("header" -> "true", "inferSchema" -> "true")).
csv("hdfs:// ... /S&P")
df.printSchema
Hope this solves your issue!
Mi
Hello,
It is exciting to see new release 0.6.1 in a short span after 0.6 release.
I am test driving 0.6.1 with spark 2.0 (Scala 2.11). RDD, DF operations are
working fine. I am facing a problem while using csv package (
https://github.com/databricks/spark-csv).
i added "com.databricks:spark-csv_
