Re: writing my own RDD

2014-05-11 Thread Koert Kuipers
will do On May 11, 2014 6:44 PM, "Aaron Davidson" wrote: > You got a good point there, those APIs should probably be marked as > @DeveloperAPI. Would you mind filing a JIRA for that ( > https://issues.apache.org/jira/browse/SPARK)? > > > On Sun, May 11, 2014 at 11:51 AM, Koert Kuipers wrote: > >

Re: writing my own RDD

2014-05-11 Thread Aaron Davidson
You got a good point there, those APIs should probably be marked as @DeveloperAPI. Would you mind filing a JIRA for that ( https://issues.apache.org/jira/browse/SPARK)? On Sun, May 11, 2014 at 11:51 AM, Koert Kuipers wrote: > resending... my email somehow never made it to the user list. > > > O

Re: writing my own RDD

2014-05-11 Thread Koert Kuipers
resending... my email somehow never made it to the user list. On Fri, May 9, 2014 at 2:11 PM, Koert Kuipers wrote: > in writing my own RDD i ran into a few issues with respect to stuff being > private in spark. > > in compute i would like to return an iterator that respects task killing > (as H