Re: Compression Streamingfilesink ROW-encoded format

2020-07-29 Thread Vijayendra Yadav
Thank You. On Wed, Jul 29, 2020 at 2:07 AM Ravi Bhushan Ratnakar < ravibhushanratna...@gmail.com> wrote: > Yes, flink-compress module is supported from 1.10.0 and onward. > > Regards, > Ravi > > On Tue 28 Jul, 2020, 23:11 Vijayendra Yadav, > wrote: > >> Thank You Ravi for Quick help. One Last

Re: Compression Streamingfilesink ROW-encoded format

2020-07-29 Thread Ravi Bhushan Ratnakar
Yes, flink-compress module is supported from 1.10.0 and onward. Regards, Ravi On Tue 28 Jul, 2020, 23:11 Vijayendra Yadav, wrote: > Thank You Ravi for Quick help. One Last Question is this compression > supported with Flink Version 1.10.0 ? > > Regards, > Vijay > > On Tue, Jul 28, 2020 at 1:2

Re: Compression Streamingfilesink ROW-encoded format

2020-07-28 Thread Vijayendra Yadav
Thank You Ravi for Quick help. One Last Question is this compression supported with Flink Version 1.10.0 ? Regards, Vijay On Tue, Jul 28, 2020 at 1:20 PM Ravi Bhushan Ratnakar < ravibhushanratna...@gmail.com> wrote: > Hi Vijayendra, > > As far as rowFormat is concerned, it doesn't support compre

Re: Compression Streamingfilesink ROW-encoded format

2020-07-28 Thread Ravi Bhushan Ratnakar
Hi Vijayendra, As far as rowFormat is concerned, it doesn't support compression. Regards, Ravi On Tue 28 Jul, 2020, 22:08 Vijayendra Yadav, wrote: > Hi Ravi, > > Thanks for your response. But your example is for *forBulkForma**t*. How > about *forRowFormat* ?. > > Regards, > Vijay > > On Tue

Re: Compression Streamingfilesink ROW-encoded format

2020-07-28 Thread Vijayendra Yadav
Hi Ravi, Thanks for your response. But your example is for *forBulkForma**t*. How about *forRowFormat* ?. Regards, Vijay On Tue, Jul 28, 2020 at 11:28 AM Ravi Bhushan Ratnakar < ravibhushanratna...@gmail.com> wrote: > Hi Vijayendra, > > You could achieve row encoded with like this as well > >

Re: Compression Streamingfilesink ROW-encoded format

2020-07-28 Thread Ravi Bhushan Ratnakar
Hi Vijayendra, You could achieve row encoded with like this as well codecName = "org.apache.hadoop.io.compress.GzipCodec" val streamingFileSink:StreamingFileSink[String] = StreamingFileSink.forBulkFormat(new Path(outputPath),CompressWriters.forExtractor(new DefaultExtractor[String]).withHadoopCo

Compression Streamingfilesink ROW-encoded format

2020-07-28 Thread Vijayendra Yadav
Hi Team, Is there a way to enable compression in StreamingFileSink API for Row-encoded formats ?. val sink: StreamingFileSink[String] = StreamingFileSink .forRowFormat(new Path(outputPath), new SimpleStringEncoder[String]("UTF-8")) Regards, Vijay