Re: Looking for I/O transform to untar a tar.gz

2018-03-16 Thread Sajeevan Achuthan
t;> Can one of the JIRA admins assign this to Sajeevan ? >> >> Thanks, >> Cham >> >> On Fri, Mar 16, 2018 at 4:22 PM Sajeevan Achuthan < >> achuthan.sajee...@gmail.com> wrote: >> >>> Hi Guys, >>> >>> Can I take a look at this

Re: Looking for I/O transform to untar a tar.gz

2018-03-16 Thread Sajeevan Achuthan
her than easy access to various file-systems). >>> >>> - Cham >>> >>> [1] https://stackoverflow.com/questions/8005114/fast- >>> concatenation-of-multiple-gzip-files >>> >>> >>> On Fri, Mar 16, 2018 at 12:26 PM Sajeeva

Re: Looking for I/O transform to untar a tar.gz

2018-03-16 Thread Sajeevan Achuthan
star >> eachsajeachsajA20171012.1145+0200-1200+0200_epg10-1_node.xml/ >> data644000175175360513252764467017353 0ustar >> eachsajeachsaj >> >> which are clearly not the expected input. >> >> On Fri, Mar 16, 2018 at 10:39 AM Sajeevan Achuthan < >> achuthan.sajee...@gmail.com> wr

Re: Looking for I/O transform to untar a tar.gz

2018-03-16 Thread Sajeevan Achuthan
his code? Did your test .tar.gz file > contain multiple files? Did you obtain the expected output, identical to > the input except for order of lines? > (also, the ParDo in this code doesn't do anything - it outputs its input - > so it can be removed) > > On Fri, Mar 16, 2018 at

Re: Looking for I/O transform to untar a tar.gz

2018-03-16 Thread Sajeevan Achuthan
Hi Guys, The TextIo can handle the tar.gz type double compressed files. See the code test code. PipelineOptions optios = PipelineOptionsFactory.fromArgs(args).withValidation().create(); Pipeline p = Pipeline.create(optios); * p.apply("ReadLines", TextIO.read().from("/dataset.tar.gz"))*

Re: A personal update

2017-12-14 Thread Sajeevan Achuthan
Hi Davor, Welcome back thanks Saj On 14 December 2017 at 08:25, Etienne Chauchot wrote: > Hi Davor, > > Glad to see you back! > > I wish you the best on this new adventure ! > > Etienne > > > > Le 13/12/2017 à 05:51, Davor Bonaci a écrit : > >> My dear friends, >> As many of you have noticed,