Hi, folks. I read the spark sources, and couldn't understand why we should call setID(), setConfParams(), commit() in SparkHadoopWriter.scala. I think we just need create a RecordWriter and write(k, v). Anything I miss?
-- Best Regards, Haosdent Huang