>>>>>>>>> plus the difficulty of judging which transforms
> go
> > > > where,
> > > > > > are
> > > > > > > > >>>>> probably
> > > > > > > > >>>>>>>>> why
> > > > >
>>>>> * at least they are separate classes and not methods
> on
> > > > > > >>> PCollection
> > > > > > >>>>>>> :-)
> > > > > > >>>>>>>>>>>
> >
; Others?
> > > > > > > >>>>>>>>>>>
> > > > > > > >>>>>>>>>>> Kenn
> > > > > > > >>>>>>>>>>>
> > > > > > > >>>>>
dea of having a home
> for
> > > > those
> > > > > >>>>>>>>>> transforms
> > > > > >>>>>>>>>>>> that are not core enough to be part of the sdk, but
> that
> > > we
> > > > >
; > > > but
> > > > >>>>> also
> > > > >>>>>>> as
> > > > >>>>>>>>>> a
> > > > >>>>>>>>>>>> reference of good practices of Beam development, and for
> > &
>> DSL
> > > >>>>>>>>>>> or
> > > >>>>>>>>>>>> if those could be grouped with the current extensions
> (e.g.
> > > >> Join
> > > >>>>> and
> > > >>>>>>>>>>>> S
t;>>>>>> start working on something like this.
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> Ismaël Mejía
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>
> if those could be grouped with the current extensions
> (e.g.
> > > >> Join
> > > >>>>> and
> > > >>>>>>>>>>>> SortValues) into something more general that we as a
>
gt;>>> Ismaël Mejía
> > >>>>>>>>>>>>
> > >>>>>>>>>>>>
> > >>>>>>>>>>>> On Wed, Nov 9, 2016 at 11:59 AM, Jean-Baptiste Onofré <
> > >>>>>
;>>>>>>>> connectors/transforms for Spark and Flink.
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> IMHO, right now, Beam should host this, not sure if it makes
> >>> sense
> >>
tIO.Write so it seems logical that we would want to
have
a
ParDo
do
the
conversion.
Text file formats have a lot of variance, even if you
consider
the
subset
of CSV like formats where it could have fixed width
fields,
or
escaping
and
quoting around other fields, or he
formations" package would serve both
> users
> > >>>> quick
> > >>>>>>>>>>> ramp-up and ease-of-use while keeping Beam more "enabling" ?
> > >>>>>>>>>>>
> > >&
12 matches
Mail list logo
