Re: The error to read HDFS custom file in spark.

din.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 17 March 2016 at 15:21, Tony Liu wrote: > >> Hi, >>My HDFS file is store with custom data structures. I want to read it >> wit

Re: The error to read HDFS custom file in spark.

inkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >> >> >> >> http://talebzadehmich.wordpress.com >> >> >> >> On 17 March 2016 at 15

The error to read HDFS custom file in spark.

Hi, My HDFS file is store with custom data structures. I want to read it with SparkContext object.So I define a formatting object: *1. code of RawDataInputFormat.scala* import com.kiisoo.aegis.bd.common.hdfs.RDRawDataRecord import org.apache.hadoop.io.LongWritable import org.apache.hadoop.mapr