You got a good point there, those APIs should probably be marked as @DeveloperAPI. Would you mind filing a JIRA for that ( https://issues.apache.org/jira/browse/SPARK)?
On Sun, May 11, 2014 at 11:51 AM, Koert Kuipers <ko...@tresata.com> wrote: > resending... my email somehow never made it to the user list. > > > On Fri, May 9, 2014 at 2:11 PM, Koert Kuipers <ko...@tresata.com> wrote: > >> in writing my own RDD i ran into a few issues with respect to stuff being >> private in spark. >> >> in compute i would like to return an iterator that respects task killing >> (as HadoopRDD does), but the mechanics for that are inside the private >> InterruptibleIterator. also the exception i am supposed to throw >> (TaskKilledException) is private to spark. >> > >