Hello Community, Please help me to find out inputs for below query.
Rgds, Kamal From: Kamal Mittal via user <user@flink.apache.org> Sent: 18 August 2023 08:04 AM To: user@flink.apache.org Subject: RE: Flink AVRO to Parquet writer - Row group size/Page size Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mittal <kamal.mit...@ericsson.com<mailto:kamal.mit...@ericsson.com>> Sent: 17 August 2023 08:01 AM To: Kamal Mittal <kamal.mit...@ericsson.com<mailto:kamal.mit...@ericsson.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: RE: Flink AVRO to Parquet writer - Row group size/Page size Hello Community, Please share views for below. Rgds, Kamal From: Kamal Mittal via user <user@flink.apache.org<mailto:user@flink.apache.org>> Sent: 16 August 2023 04:35 PM To: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Flink AVRO to Parquet writer - Row group size/Page size Hello, For Parquet, default row group size is 128 MB and Page size is 1MB but Flink Bulk writer using file sink create the files based on checkpointing interval only. So is there any significance of configured row group size and page size for Flink parquet bulk writer? How Flink uses these two values with checkpointing interval? Rgds, Kamal
