to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM Stas Levin
wrote:
Hi,
A short terminology question regarding "bundle", and
particularly splitIntoBundles vs. generateInitialSplits.
In *BoundedSource* we have:
List> *splitIntoBundles*(...)
In *UnboundedSource* we have:
List&g
readers rather than after
creating readers and waiting to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
Hi,
A short terminology question regarding "bundle", and
particularly splitIntoBundles vs. generateInitialSplits.
In *BoundedSource* we have:
List> *
startup to
be
able to split up the work before creating readers rather than after
creating readers and waiting to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
Hi,
A short terminology question regarding "bundle", and
particularly splitInto
o think of them as
> occupying
> >>>>
> >>>> the
> >>>>>
> >>>>> same niche. I'll let someone else who was around for naming discuss
> >>>>
> >>>> whether
> >>>>>
> >>&
ces & Reader methods are called in, but a runner trying to get
efficiency would be able to use splitIntoBundles during job startup to
be
able to split up the work before creating readers rather than after
creating readers and waiting to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM
ey are doing slightly different things: a
>>>
>>> bounded
>>>>
>>>> source is really kind of creating physical chunks of the data, whereas
>>>
>>> the
>>>>
>>>> streaming source is creating conceptual divisions of
g to get
efficiency would be able to use splitIntoBundles during job startup to
be
able to split up the work before creating readers rather than after
creating readers and waiting to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
Hi,
A short terminology question regarding
les during job startup to
be
> > able to split up the work before creating readers rather than after
> > creating readers and waiting to use splitAtFraction.
> >
> > S
> >
> > On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
> >
> > > Hi,
> > &
wn order the
> > Sources & Reader methods are called in, but a runner trying to get
> > efficiency would be able to use splitIntoBundles during job startup to be
> > able to split up the work before creating readers rather than after
> > creating readers and waiting to use
e to use splitIntoBundles during job startup to be
> able to split up the work before creating readers rather than after
> creating readers and waiting to use splitAtFraction.
>
> S
>
> On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
>
> > Hi,
> >
> > A sho
and waiting to use splitAtFraction.
S
On Sun, Jan 8, 2017 at 6:06 AM Stas Levin wrote:
> Hi,
>
> A short terminology question regarding "bundle", and
> particularly splitIntoBundles vs. generateInitialSplits.
>
> In *BoundedSource* we have:
> List> *s
Hi,
A short terminology question regarding "bundle", and
particularly splitIntoBundles vs. generateInitialSplits.
In *BoundedSource* we have:
List> *splitIntoBundles*(...)
In *UnboundedSource* we have:
List>
*generateInitialSplits*(...)
I was wondering if the names were in
12 matches
Mail list logo
