Re: Avro Schema + GenericRecord to HadoopRDD

2014-07-30 Thread Laird, Benjamin
nd (I've done it for Cascading/Scalding). > >- >Chris > > > >From: Laird, Benjamin [benjamin.la...@capitalone.com] >Sent: Tuesday, July 29, 2014 8:00 AM >To: user@spark.apache.org; u...@spark.incubator.apache.org >Subject: Avro Schema + GenericRecor

RE: Avro Schema + GenericRecord to HadoopRDD

2014-07-29 Thread Severs, Chris
che.org; u...@spark.incubator.apache.org Subject: Avro Schema + GenericRecord to HadoopRDD Hi all, I can read in Avro files to Spark with HadoopRDD and submit the schema in the jobConf, but with the guidance I've seen so far, I'm left with a avro GenericRecord of Java objects without type. How d

Avro Schema + GenericRecord to HadoopRDD

2014-07-29 Thread Laird, Benjamin
Hi all, I can read in Avro files to Spark with HadoopRDD and submit the schema in the jobConf, but with the guidance I've seen so far, I'm left with a avro GenericRecord of Java objects without type. How do I actually use the schema to have the types inferred? Example: scala> AvroJob.setInputSc