Re: Re: Iceberg table maintenance

Thanks Wenjin for your response. See my answers below: On Tue, Apr 2, 2024, 04:08 wenjin wrote: > Hi Peter, > Thanks a lot for your answers, this detailed explanation has cleared my > confusions and been greatly beneficial to me. If you don't mind, could I > discuss two more questions with your

[jira] [Created] (FLINK-34986) Basic framework for async execution of state

Zakelly Lan created FLINK-34986: --- Summary: Basic framework for async execution of state Key: FLINK-34986 URL: https://issues.apache.org/jira/browse/FLINK-34986 Project: Flink Issue Type: Sub-ta

Re: [DISCUSS] Externalized Google Cloud Connectors

Hey, Claire Thanks starting this discussion, all flink external connector repos are sub-projects of Apache Flink, including https://github.com/apache/flink-connector-aws. Creating a flink external connector repo named flink-connectors-gcp as sub-project of Apache Beam is not a good idea from

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

Hi, Venkata krishnan Thank you for your involvement and suggestions, and hope that the design goals of this FLIP will be helpful to your business. >>> 1. In the proposed FLIP, given the example for the dynamic table, do the data sources always come from a single lake storage such as Paimon or doe

[jira] [Created] (FLINK-34985) It doesn't support to access fields by name for map function in thread mode

Dian Fu created FLINK-34985: --- Summary: It doesn't support to access fields by name for map function in thread mode Key: FLINK-34985 URL: https://issues.apache.org/jira/browse/FLINK-34985 Project: Flink

RE: Re: Iceberg table maintenance

Hi Peter, Thanks a lot for your answers, this detailed explanation has cleared my confusions and been greatly beneficial to me. If you don't mind, could I discuss two more questions with your？ As you mentioned in your proposal and answers, the maintenance tasks may cause resource interference a

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

Congratulations! Best, Ron Jeyhun Karimov 于2024年4月1日周一 18:12写道： > Congratulations! > > Regards, > Jeyhun > > On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > > > Congratulations! > > Best, > > Guowei > > > > > > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > > > > > Congratulations! > > >

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

Hi Ferenc, Thanks for the proposal. Sounds like a good idea! I have a few questions on that: - What is its impact on query optimization because resolving variables at the parsing stage might affect query optimization. - What is the scope of variables? I mean when and how they override each other

[jira] [Created] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

Yuan Mei created FLINK-34984: Summary: Disaggregated State Storage and Management (Umbrella FLIP) Key: FLINK-34984 URL: https://issues.apache.org/jira/browse/FLINK-34984 Project: Flink Issue Type

[RESULT][VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

Hey dev, I'm happy to announce that FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1] has been accepted with 7 approving votes (5 binding) [2] Piotrek Nowojski (binding) Feifan Wang (non-binding) Jing Ge (binding) Rui Fan (binding) Xintong (binding) Yue (non-binding) Yuan M

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

+1 vote myself & Thanks all for the voting. I'm closing the vote and the result will be posted in a separate mail. Best Yuan On Fri, Mar 29, 2024 at 3:07 PM yue ma wrote: > +1 (non-binding) > > > Best, > Yue >

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

Congratulations! Regards, Jeyhun On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > Congratulations! > Best, > Guowei > > > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > > > Congratulations! > > > > Best, > > Feng Jin > > > > On Mon, Apr 1, 2024 at 10:51 AM weijie guo > > wrote: > > > >> C

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

Hi everyone, Thanks for your valuable feedback! The discussion on this FLIP has been going on for a while. I would like to start a vote after 48 hours. Please let me know if you have any concerns or any further questions/comments. Regards, Jeyhun On Thu, Mar 21, 2024 at 6:01 PM Jeyhun Karimov

Re: [DISCUSS] FLIP-399: Flink Connector Doris

Hi, Gentle ping to see if there are any other concerns or things that seems missing from the FLIP. Brs di.wu > 2024年3月25日 17:52，Feng Jin 写道： > > Hi Di > > Thank you for your patience and explanation. > > If this is a server-side configuration, we currently cannot modify it in > the client c

[jira] [Created] (FLINK-34983) Hive param sink.partition-commit.policy.kind default value is not work in stream mode

yunfan created FLINK-34983: -- Summary: Hive param sink.partition-commit.policy.kind default value is not work in stream mode Key: FLINK-34983 URL: https://issues.apache.org/jira/browse/FLINK-34983 Project: Fl

[jira] [Created] (FLINK-34982) FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

Jinzhong Li created FLINK-34982: --- Summary: FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State Key: FLINK-34982 URL: https://issues.apache.org/jira/browse/FLINK-34982 Project: Flink