I'd suggest looking at http://spark-packages.org/package/databricks/spark-avro
On Wed, Aug 26, 2015 at 11:32 AM, gpatcham <gpatc...@gmail.com> wrote: > Hi, > > I'm trying to query hive table which is based on avro in spark SQL and > seeing below errors. > > 15/08/26 17:51:12 WARN avro.AvroSerdeUtils: Encountered AvroSerdeException > determining schema. Returning signal schema to indicate problem > org.apache.hadoop.hive.serde2.avro.AvroSerdeException: Neither > avro.schema.literal nor avro.schema.url specified, can't determine table > schema > at > > org.apache.hadoop.hive.serde2.avro.AvroSerdeUtils.determineSchemaOrThrowException(AvroSerdeUtils.java:68) > at > > org.apache.hadoop.hive.serde2.avro.AvroSerdeUtils.determineSchemaOrReturnErrorSchema(AvroSerdeUtils.java:93) > at > org.apache.hadoop.hive.serde2.avro.AvroSerDe.initialize(AvroSerDe.java:60) > at > > org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:375) > at > > org.apache.hadoop.hive.ql.metadata.Partition.getDeserializer(Partition.java:249) > > > Its not able to determine schema. Hive table is pointing to avro schema > using url. I'm stuck and couldn't find more info on this. > > Any pointers ? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/query-avro-hive-table-in-spark-sql-tp24462.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
