Re: MultipleTextOutputFormat with new hadoop API

2014-10-01 Thread Nicholas Chammas
There is this thread on Stack Overflow about the same topic, which you may find helpful. On Wed, Oct 1, 2014 at 11:17 AM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > Not that I'm aware o

Re: MultipleTextOutputFormat with new hadoop API

2014-10-01 Thread Nicholas Chammas
Not that I'm aware of. I'm looking for a work-around myself! On Wed, Oct 1, 2014 at 11:15 AM, Tomer Benyamini wrote: > Yes exactly.. so I guess this is still an open request. Any workaround? > > On Wed, Oct 1, 2014 at 6:04 PM, Nicholas Chammas > wrote: > > Are you trying to do something along t

Re: MultipleTextOutputFormat with new hadoop API

2014-10-01 Thread Tomer Benyamini
Yes exactly.. so I guess this is still an open request. Any workaround? On Wed, Oct 1, 2014 at 6:04 PM, Nicholas Chammas wrote: > Are you trying to do something along the lines of what's described here? > https://issues.apache.org/jira/browse/SPARK-3533 > > On Wed, Oct 1, 2014 at 10:53 AM, Tomer

Re: MultipleTextOutputFormat with new hadoop API

2014-10-01 Thread Nicholas Chammas
Are you trying to do something along the lines of what's described here? https://issues.apache.org/jira/browse/SPARK-3533 On Wed, Oct 1, 2014 at 10:53 AM, Tomer Benyamini wrote: > Hi, > > I'm trying to write my JavaPairRDD using saveAsNewAPIHadoopFile with > MultipleTextOutputFormat,: > > outRdd

MultipleTextOutputFormat with new hadoop API

2014-10-01 Thread Tomer Benyamini
Hi, I'm trying to write my JavaPairRDD using saveAsNewAPIHadoopFile with MultipleTextOutputFormat,: outRdd.saveAsNewAPIHadoopFile("/tmp", String.class, String.class, MultipleTextOutputFormat.class); but I'm getting this compilation error: Bound mismatch: The generic method saveAsNewAPIHadoopFil