Re: How to create data frame from an avro file in Spark 1.3.0

2015-03-14 Thread Michael Armbrust
We will be publishing a new version of the library early next week. Here's the PR for the upgraded version if you would like to build from source: https://github.com/databricks/spark-avro/pull/33 On Sat, Mar 14, 2015 at 1:17 PM, Shing Hing Man wrote: > In spark-avro 0.1, the method AvroContext

How to create data frame from an avro file in Spark 1.3.0

2015-03-14 Thread Shing Hing Man
In spark-avro 0.1,  the method AvroContext.avroFile  returns a SchemaRDD, which is deprecated in Spark 1.3.0 package com.databricks.spark import org.apache.spark.sql.{SQLContext, SchemaRDD} package object avro {   /**    * Adds a method, `avroFile`, to SQLContext that allows reading data stor