You can make the patch so that everyone review
On Wednesday, February 26, 2014 at 8:23 AM, Nan Zhu wrote:
> Hi, all
>
> I just created a JIRA https://spark-project.atlassian.net/browse/SPARK-1139 .
> The issue discusses that:
>
> the new Hadoop API based Spark APIs are actually a mixture
any discussion on this?
I would like to hear more advices from the community before I create the PR,
an example is how to create a NewHadoopRDD
we get a configuration from JobContext
val updatedConf = job.getConfiguration
new NewHadoopRDD(this, fClass, kClass, vClass, updatedConf)
then we
Hi, all
I just created a JIRA https://spark-project.atlassian.net/browse/SPARK-1139 .
The issue discusses that:
the new Hadoop API based Spark APIs are actually a mixture of old and new
Hadoop API.
Spark APIs are still using JobConf (or Configuration) as one of the parameters,
but actually
