Re: Flink AVRO to Parquet writer - Row group size/Page size

2023-08-19 Thread Feng Jin
amal > > > > *From:* Kamal Mittal via user > *Sent:* 18 August 2023 08:04 AM > *To:* user@flink.apache.org > *Subject:* RE: Flink AVRO to Parquet writer - Row group size/Page size > > > > Hello Community, > > > > Please share views for below. > >

RE: Flink AVRO to Parquet writer - Row group size/Page size

2023-08-19 Thread Kamal Mittal via user
Hello Community, Please help me to find out inputs for below query. Rgds, Kamal From: Kamal Mittal via user Sent: 18 August 2023 08:04 AM To: user@flink.apache.org Subject: RE: Flink AVRO to Parquet writer - Row group size/Page size Hello Community, Please share views for below. Rgds, Kamal

RE: Flink AVRO to Parquet writer - Row group size/Page size

2023-08-17 Thread Kamal Mittal via user
Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mittal Sent: 17 August 2023 08:01 AM To: Kamal Mittal ; user@flink.apache.org Subject: RE: Flink AVRO to Parquet writer - Row group size/Page size Hello Community, Please share views for below. Rgds, Kamal From: Kamal

RE: Flink AVRO to Parquet writer - Row group size/Page size

2023-08-16 Thread Kamal Mittal via user
Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mittal via user Sent: 16 August 2023 04:35 PM To: user@flink.apache.org Subject: Flink AVRO to Parquet writer - Row group size/Page size Hello, For Parquet, default row group size is 128 MB and Page size is 1MB but Flink

Flink AVRO to Parquet writer - Row group size/Page size

2023-08-16 Thread Kamal Mittal via user
Hello, For Parquet, default row group size is 128 MB and Page size is 1MB but Flink Bulk writer using file sink create the files based on checkpointing interval only. So is there any significance of configured row group size and page size for Flink parquet bulk writer? How Flink uses these two