Can someone share me some code to use CombineInputFormat to read avro data.
Today I use
def readGenericRecords(sc: SparkContext, inputDir: String, startDate: Date,
endDate: Date) = {
val path = getInputPaths(inputDir, startDate, endDate)
sc.newAPIHadoopFile[AvroKey[GenericRecord], NullWritable,
AvroKeyInputFormat[GenericRecord]]("/A/B/C/D/D/2015/05/22/out-r-*.avro")
}
And i want to use CombineInputFormat. Will it be any helpful ?
--
Deepak
