Re: Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Xintong Song
+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 10:28 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Thu, Mar 28, 2024 at 10:13 PM Jing Ge > wrote: > > > +1(binding) > > > > Best Regards, > > Jing > > > > On Thu, Mar 28, 2024 at 1:28 PM Feifan Wang wrote: >

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Xintong Song
+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 11:04 AM Yunfeng Zhou wrote: > +1 (non-bindling) > > Best, > Yunfeng > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > > Model [1]. Th

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Xintong Song
+1 (binding) Best, Xintong On Fri, Mar 29, 2024 at 12:51 PM Yuepeng Pan wrote: > +1(non-binding) > > Best, > Yuepeng Pan > > > On 2024/03/29 03:03:53 Yunfeng Zhou wrote: > > +1 (non-binding) > > > > Best, > > Yunfeng > > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan > wrote: > > > > > > H

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-28 Thread Yuepeng Pan
+1(non-binding) Best, Yuepeng Pan On 2024/03/28 10:44:25 Yuan Mei wrote: > +1 (binding) > > Best, > Yuan > > On Tue, Mar 26, 2024 at 8:59 AM Yunfeng Zhou > wrote: > > > +1 (non-binding) > > > > Best, > > Yunfeng > > > > On Wed, Mar 20, 2024 at 8:29 PM weijie guo > > wrote: > > > > > > Hi ev

Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Yuepeng Pan
+1(non-binding) Best, Yuepeng Pan On 2024/03/29 02:55:40 gongzhongqiang wrote: > +1(non-binding) > > Best, > > Zhongqiang Gong > > Jinzhong Li 于2024年3月27日周三 18:57写道: > > > Hi devs, > > > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > > The discussion thread

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Yuepeng Pan
+1(non-binding) Best, Yuepeng Pan On 2024/03/29 03:03:53 Yunfeng Zhou wrote: > +1 (non-binding) > > Best, > Yunfeng > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > > > Hi devs, > > > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. The > > discussion thread

Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Yuepeng Pan
+1(non-binding) Best, Yuepeng Pan On 2024/03/29 04:17:15 Yun Tang wrote: > +1 (binding) > > Best, > Yun Tang > > From: Rui Fan <1996fan...@gmail.com> > Sent: Friday, March 29, 2024 10:28 > To: dev@flink.apache.org > Subject: Re: Re: [VOTE] FLIP-427: Disaggregate

Re: Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Yun Tang
+1 (binding) Best, Yun Tang From: Rui Fan <1996fan...@gmail.com> Sent: Friday, March 29, 2024 10:28 To: dev@flink.apache.org Subject: Re: Re: [VOTE] FLIP-427: Disaggregated state Store +1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:30 PM Piotr Nowojski wrote

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yun Tang
Congratulations to all Paimon guys! Glad to see a Flink sub-project has been graduated to an Apache top-level project. Best Yun Tang From: Hangxiang Yu Sent: Friday, March 29, 2024 10:32 To: dev@flink.apache.org Subject: Re: Re: [ANNOUNCE] Apache Paimon is gra

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Yunfeng Zhou
+1 (non-binding) Best, Yunfeng On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > Hi devs, > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. The > discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insuffi

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Yunfeng Zhou
+1 (non-bindling) Best, Yunfeng On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > Hi everyone, > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > Model [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an > objec

Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread gongzhongqiang
+1(non-binding) Best, Zhongqiang Gong Jinzhong Li 于2024年3月27日周三 18:57写道: > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficien

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Hangxiang Yu
Congratulations! On Fri, Mar 29, 2024 at 10:27 AM Benchao Li wrote: > Congratulations! > > Zakelly Lan 于2024年3月29日周五 10:25写道: > > > > Congratulations! > > > > > > Best, > > Zakelly > > > > On Thu, Mar 28, 2024 at 10:13 PM Jing Ge > wrote: > > > > > Congrats! > > > > > > Best regards, > > > Jin

Re: Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:32 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 18:43:36, "Yuan Mei" wrote: > >+1 (binding) > > > >Best, > >Yuan > > > >On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li >

Re: Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:31 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 18:43:12, "Yuan Mei" wrote: > >+1 (binding) > > > >Best, > >Yuan > > > >On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li >

Re: Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 8:31 PM Feifan Wang wrote: > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 20:21:50, "Jing Ge" wrote: > >+1 (binding) > > > >Thanks! > > > >Best regards, > >Jing > > > >On Wed, Mar 27, 2024 at 1

Re: Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:12 PM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Thu, Mar 28, 2024 at 1:30 PM Feifan Wang wrote: > > > +1 (non-binding) > > > > > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28

Re: Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:30 PM Piotr Nowojski wrote: > +1 (binding) > > czw., 28 mar 2024 o 13:31 Feifan Wang napisał(a): > > > +1 (non-binding) > > > > > > > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28 19:01:01, "Yua

Re: Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Rui Fan
+1(binding) Best, Rui On Thu, Mar 28, 2024 at 10:13 PM Jing Ge wrote: > +1(binding) > > Best Regards, > Jing > > On Thu, Mar 28, 2024 at 1:28 PM Feifan Wang wrote: > > > +1 (non-binding) > > > > —— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28 20:20:21

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Benchao Li
Congratulations! Zakelly Lan 于2024年3月29日周五 10:25写道: > > Congratulations! > > > Best, > Zakelly > > On Thu, Mar 28, 2024 at 10:13 PM Jing Ge wrote: > > > Congrats! > > > > Best regards, > > Jing > > > > On Thu, Mar 28, 2024 at 1:27 PM Feifan Wang wrote: > > > > > Congratulations!—— >

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Zakelly Lan
Congratulations! Best, Zakelly On Thu, Mar 28, 2024 at 10:13 PM Jing Ge wrote: > Congrats! > > Best regards, > Jing > > On Thu, Mar 28, 2024 at 1:27 PM Feifan Wang wrote: > > > Congratulations!—— > > > > Best regards, > > > > Feifan Wang > > > > > > > > > > At 2024-03-28 20:02:43,

Iceberg table maintenance

2024-03-28 Thread Péter Váry
Hi Team, I am working on adding a possibility to the Flink Iceberg connector to run maintenance tasks on the Iceberg tables. This will fix the small files issues and in the long run help compacting the high number of positional and equality deletes created by Flink tasks writing CDC data to Iceber

Re: [DISCUSS] FLIP-XXX: Introduce Flink SQL variables

2024-03-28 Thread Ferenc Csaky
Hi, Jim, Yanfei, Thanks for your comments! Let me reply in the order of the messages. > I'd prefer sticking to the SQL standard if possible. Would > it be possible / sensible to allow for each syntax, perhaps > managed by a config setting? Correct me if I am wrong, but AFAIK variables are not p

Re: [DISCUSS] FLIP-437: Support ML Models in Flink SQL

2024-03-28 Thread Hao Li
Thanks Timo. I'll start a vote tomorrow if no further discussion. Thanks, Hao On Thu, Mar 28, 2024 at 9:33 AM Timo Walther wrote: > Hi everyone, > > I updated the FLIP according to this discussion. > > @Hao Li: Let me know if I made a mistake somewhere. I added some > additional explaning comme

Re: [DISCUSS] Externalized Google Cloud Connectors

2024-03-28 Thread Claire McCarthy
Hey Martijn, Apologies, I had missed this message initially! Comments inline. > contributions that have happened outside of the Apache realm do not play a role when evaluating potential new committers. I understand. This, unfortunately, is the tradeoff for developing the connectors outside of Ap

[jira] [Created] (FLINK-34962) flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata

2024-03-28 Thread Yubiao Feng (Jira)
Yubiao Feng created FLINK-34962: --- Summary: flink-connector-pulsa starts failed due to incorrect use of Pulsar API: LookupService. getPartitionedTopicMetadata Key: FLINK-34962 URL: https://issues.apache.org/jira/brow

Re: [DISCUSS] FLIP-437: Support ML Models in Flink SQL

2024-03-28 Thread Timo Walther
Hi everyone, I updated the FLIP according to this discussion. @Hao Li: Let me know if I made a mistake somewhere. I added some additional explaning comments about the new PTF syntax. There are no further objections from my side. If nobody objects, Hao feel free to start the voting tomorrow.

Re: [DISCUSS] FLIP-437: Support ML Models in Flink SQL

2024-03-28 Thread Jark Wu
Thanks, Hao, Sounds good to me. Best, Jark On Thu, 28 Mar 2024 at 01:02, Hao Li wrote: > Hi Jark, > > I think we can start with supporting popular model providers such as > openai, azureml, sagemaker for remote models. > > Thanks, > Hao > > On Tue, Mar 26, 2024 at 8:15 PM Jark Wu wrote: > > >

[jira] [Created] (FLINK-34961) GitHub Actions statistcs can be monitored per workflow name

2024-03-28 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34961: - Summary: GitHub Actions statistcs can be monitored per workflow name Key: FLINK-34961 URL: https://issues.apache.org/jira/browse/FLINK-34961 Project: Flink

Re: Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Piotr Nowojski
+1 (binding) czw., 28 mar 2024 o 13:31 Feifan Wang napisał(a): > +1 (non-binding) > > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 19:01:01, "Yuan Mei" wrote: > >+1 (binding) > > > >Best > >Yuan > > > > > > > > > >On Wed, Mar 27, 2024 at 6:37 PM Hangxiang Yu w

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Jing Ge
Congrats! Best regards, Jing On Thu, Mar 28, 2024 at 1:27 PM Feifan Wang wrote: > Congratulations!—— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 20:02:43, "Yanfei Lei" wrote: > >Congratulations! > > > >Best, > >Yanfei > > > >Zhanghao Chen 于2024年3月28日周四 19:59写道: > >>

Re: Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Jing Ge
+1(binding) Best Regards, Jing On Thu, Mar 28, 2024 at 1:28 PM Feifan Wang wrote: > +1 (non-binding) > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 20:20:21, "Piotr Nowojski" wrote: > >+1 (binding) > > > >Piotrek > > > >czw., 28 mar 2024 o 11:43 Yuan Mei napisał(

Re: Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Jing Ge
+1(binding) Best Regards, Jing On Thu, Mar 28, 2024 at 1:30 PM Feifan Wang wrote: > +1 (non-binding) > > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-03-28 20:20:39, "Piotr Nowojski" wrote: > >+1 (binding) > > > >Piotrek > > > >czw., 28 mar 2024 o 11:44 Yuan Mei napi

Re:Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 18:43:36, "Yuan Mei" wrote: >+1 (binding) > >Best, >Yuan > >On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li >wrote: > >> Hi devs, >> >> >> I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale >> Integration

Re:Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 18:43:12, "Yuan Mei" wrote: >+1 (binding) > >Best, >Yuan > >On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li >wrote: > >> Hi devs, >> >> I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. >> The

Re:Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 19:01:01, "Yuan Mei" wrote: >+1 (binding) > >Best >Yuan > > > > >On Wed, Mar 27, 2024 at 6:37 PM Hangxiang Yu wrote: > >> Hi devs, >> >> Thanks all for your valuable feedback about FLIP-427: Disaggregated state >> S

Re:Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 20:20:39, "Piotr Nowojski" wrote: >+1 (binding) > >Piotrek > >czw., 28 mar 2024 o 11:44 Yuan Mei napisał(a): > >> +1 (binding) >> >> Best, >> Yuan >> >> On Thu, Mar 28, 2024 at 4:33 PM Xuannan Su wrote: >> >> > +1 (

Re:Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 20:21:50, "Jing Ge" wrote: >+1 (binding) > >Thanks! > >Best regards, >Jing > >On Wed, Mar 27, 2024 at 11:23 AM Zakelly Lan wrote: > >> Hi devs, >> >> I'd like to start a vote on the FLIP-424: Asynchronous State APIs

Re:Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Feifan Wang
+1 (non-binding) —— Best regards, Feifan Wang At 2024-03-28 20:20:21, "Piotr Nowojski" wrote: >+1 (binding) > >Piotrek > >czw., 28 mar 2024 o 11:43 Yuan Mei napisał(a): > >> Hi devs, >> >> I'd like to start a vote on the FLIP-423: Disaggregated State Storage and >> Management (

Re:Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Feifan Wang
Congratulations!—— Best regards, Feifan Wang At 2024-03-28 20:02:43, "Yanfei Lei" wrote: >Congratulations! > >Best, >Yanfei > >Zhanghao Chen 于2024年3月28日周四 19:59写道: >> >> Congratulations! >> >> Best, >> Zhanghao Chen >> >> From: Yu Li >> Sent: Th

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Jing Ge
+1 (binding) Thanks! Best regards, Jing On Wed, Mar 27, 2024 at 11:23 AM Zakelly Lan wrote: > Hi devs, > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. The > discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Piotr Nowojski
+1 (binding) Piotrek czw., 28 mar 2024 o 11:44 Yuan Mei napisał(a): > +1 (binding) > > Best, > Yuan > > On Thu, Mar 28, 2024 at 4:33 PM Xuannan Su wrote: > > > +1 (non-binding) > > > > Best regards, > > Xuannan > > > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > > > Hi everyone,

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Piotr Nowojski
+1 (binding) Piotrek czw., 28 mar 2024 o 11:42 Yuan Mei napisał(a): > +1 (binding) > > Best, > Yuan > > On Thu, Mar 28, 2024 at 4:30 PM Xuannan Su wrote: > > > +1 (non-binding) > > > > Best, > > Xuannan > > > > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan > wrote: > > > > > > Hi devs, > >

Re: [VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Piotr Nowojski
+1 (binding) Piotrek czw., 28 mar 2024 o 11:43 Yuan Mei napisał(a): > Hi devs, > > I'd like to start a vote on the FLIP-423: Disaggregated State Storage and > Management (Umbrella FLIP) [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an ob

[jira] [Created] (FLINK-34960) NullPointerException while applying parallelism overrides for session jobs

2024-03-28 Thread Kunal Rohitas (Jira)
Kunal Rohitas created FLINK-34960: - Summary: NullPointerException while applying parallelism overrides for session jobs Key: FLINK-34960 URL: https://issues.apache.org/jira/browse/FLINK-34960 Project:

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yanfei Lei
Congratulations! Best, Yanfei Zhanghao Chen 于2024年3月28日周四 19:59写道: > > Congratulations! > > Best, > Zhanghao Chen > > From: Yu Li > Sent: Thursday, March 28, 2024 15:55 > To: d...@paimon.apache.org > Cc: dev ; user > Subject: Re: [ANNOUNCE] Apache Paimon is gr

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Zhanghao Chen
Congratulations! Best, Zhanghao Chen From: Yu Li Sent: Thursday, March 28, 2024 15:55 To: d...@paimon.apache.org Cc: dev ; user Subject: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project CC the Flink user and dev mailing list. Paimon originated wi

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Jinzhong Li
Congratulations! Best, Jinzhong Li On Thu, Mar 28, 2024 at 7:08 PM gongzhongqiang wrote: > Congratulations! > > Best, > > Zhongqiang Gong > > Yu Li 于2024年3月28日周四 15:57写道: > > > CC the Flink user and dev mailing list. > > > > Paimon originated within the Flink community, initially known as Flin

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread gongzhongqiang
Congratulations! Best, Zhongqiang Gong Yu Li 于2024年3月28日周四 15:57写道: > CC the Flink user and dev mailing list. > > Paimon originated within the Flink community, initially known as Flink > Table Store, and all our incubating mentors are members of the Flink > Project Management Committee. I am c

Re: [VOTE] FLIP-427: Disaggregated state Store

2024-03-28 Thread Yuan Mei
+1 (binding) Best Yuan On Wed, Mar 27, 2024 at 6:37 PM Hangxiang Yu wrote: > Hi devs, > > Thanks all for your valuable feedback about FLIP-427: Disaggregated state > Store [1]. > I'd like to start a vote on it. The discussion thread is here [2]. > > The vote will be open for at least 72 hou

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Roc Marshal
Congratulations ! Best, Yuepeng Pan At 2024-03-28 18:46:58, "Yuan Mei" wrote: >Congratulations > >Best >Yuan > >On Thu, Mar 28, 2024 at 5:35 PM Samrat Deb wrote: > >> Congratulations ! >> Great news >> >> Bests, >> Samrat >> >> On Thu, 28 Mar 2024 at 3:00 PM, Ahmed Hamdy wrote: >> >> > Congr

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yuan Mei
Congratulations Best Yuan On Thu, Mar 28, 2024 at 5:35 PM Samrat Deb wrote: > Congratulations ! > Great news > > Bests, > Samrat > > On Thu, 28 Mar 2024 at 3:00 PM, Ahmed Hamdy wrote: > > > Congratulations! > > Best Regards > > Ahmed Hamdy > > > > > > On Thu, 28 Mar 2024 at 08:16, Paul Lam wr

Re: [VOTE] FLIP-433: State Access on DataStream API V2

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Tue, Mar 26, 2024 at 8:59 AM Yunfeng Zhou wrote: > +1 (non-binding) > > Best, > Yunfeng > > On Wed, Mar 20, 2024 at 8:29 PM weijie guo > wrote: > > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-433: State Access on > > DataStream API V2 [1].

Re: [VOTE] FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 7:31 PM Jinzhong Li wrote: > Hi devs, > > > I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale > Integration for Disaggregated State [1]. The discussion thread is here [2]. > > > The vote will be open for at least 72 hours unless th

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:33 PM Xuannan Su wrote: > +1 (non-binding) > > Best regards, > Xuannan > > On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > > Model [1]. The

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Thu, Mar 28, 2024 at 4:30 PM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > > On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > > > Hi devs, > > > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. > The > > discussion thread

Re: [VOTE] FLIP-426: Grouping Remote State Access

2024-03-28 Thread Yuan Mei
+1 (binding) Best, Yuan On Wed, Mar 27, 2024 at 6:56 PM Jinzhong Li wrote: > Hi devs, > > I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1]. > The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insufficie

[VOTE] FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-03-28 Thread Yuan Mei
Hi devs, I'd like to start a vote on the FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP) [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1] https://cwiki.apache.org/confluence/x/R4p3EQ [

Re: [DISCUSS] FLIP-423 ~FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

2024-03-28 Thread Yuan Mei
Thanks Zakelly for driving the entire discussion and making endless efforts to improve the proposal. Thanks everyone for giving invaluable input and suggestions. Asycn execution is fundamental to disaggregate CPU utils and IO/network utils. It is also widely adopted in many modern systems to impr

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Samrat Deb
Congratulations ! Great news Bests, Samrat On Thu, 28 Mar 2024 at 3:00 PM, Ahmed Hamdy wrote: > Congratulations! > Best Regards > Ahmed Hamdy > > > On Thu, 28 Mar 2024 at 08:16, Paul Lam wrote: > > > Congrats! > > > > Best, > > Paul Lam > > > > > 2024年3月28日 16:03,Rui Fan <1996fan...@gmail.com>

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Ahmed Hamdy
Congratulations! Best Regards Ahmed Hamdy On Thu, 28 Mar 2024 at 08:16, Paul Lam wrote: > Congrats! > > Best, > Paul Lam > > > 2024年3月28日 16:03,Rui Fan <1996fan...@gmail.com> 写道: > > > > Congratulations~ > > > > Best, > > Rui > > > > On Thu, Mar 28, 2024 at 3:55 PM Yu Li wrote: > > > >> CC the

Re: Bug report for reading Hive table as streaming source.

2024-03-28 Thread Xiaolong Wang
I think it worth mentioning in the documentation of Hive read that it cannot read a table that has more than 32,767 partitions. On Thu, Mar 28, 2024 at 5:10 PM Xiaolong Wang wrote: > Found out the reason: > > It turned out that in Flink, it uses hive’s IMetaStoreClient to fetch > partitions usin

[jira] [Created] (FLINK-34959) Update old flink-cdc-connectors artifactId

2024-03-28 Thread xleoken (Jira)
xleoken created FLINK-34959: --- Summary: Update old flink-cdc-connectors artifactId Key: FLINK-34959 URL: https://issues.apache.org/jira/browse/FLINK-34959 Project: Flink Issue Type: Improvement

Re: Bug report for reading Hive table as streaming source.

2024-03-28 Thread Xiaolong Wang
Found out the reason: It turned out that in Flink, it uses hive’s IMetaStoreClient to fetch partitions using the following method: List listPartitionNames(String db_name, String tbl_name, short max_parts) throws MetaException, TException; where the max_parts represents the max number of pa

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Muhammet Orazov
Hey Rui, Thanks for the detailed explanation and updating the FLIP! It is much clearer definitely, thanks for the proposal. Best, Muhammet On 2024-03-28 07:37, Rui Fan wrote: Hi Muhammet, Thanks for your reply! The execution mode is also used for the DataStream API [1], would that also aff

Re: [VOTE] FLIP-425: Asynchronous Execution Model

2024-03-28 Thread Xuannan Su
+1 (non-binding) Best regards, Xuannan On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > Hi everyone, > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > Model [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an

Re: [VOTE] FLIP-424: Asynchronous State APIs

2024-03-28 Thread Xuannan Su
+1 (non-binding) Best, Xuannan On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > Hi devs, > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. The > discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insuff

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Paul Lam
Congrats! Best, Paul Lam > 2024年3月28日 16:03,Rui Fan <1996fan...@gmail.com> 写道: > > Congratulations~ > > Best, > Rui > > On Thu, Mar 28, 2024 at 3:55 PM Yu Li wrote: > >> CC the Flink user and dev mailing list. >> >> Paimon originated within the Flink community, initially known as Flink >> T

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Rui Fan
Congratulations~ Best, Rui On Thu, Mar 28, 2024 at 3:55 PM Yu Li wrote: > CC the Flink user and dev mailing list. > > Paimon originated within the Flink community, initially known as Flink > Table Store, and all our incubating mentors are members of the Flink > Project Management Committee. I a

Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-28 Thread Yu Li
CC the Flink user and dev mailing list. Paimon originated within the Flink community, initially known as Flink Table Store, and all our incubating mentors are members of the Flink Project Management Committee. I am confident that the bonds of enduring friendship and close collaboration will contin

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Rui Fan
Hi Venkat, > I assume the current proposal would also handle the case of mixed mode (BATCH + STREAMING within the same app) in the future, right? IIUC, currently one flink job is either STREAMING or BATCH. And flink doesn't support mixed mode so far. If one flink job can run with mixed mode, and

Re: [DISCUSS] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-03-28 Thread Rui Fan
Hi Muhammet, Thanks for your reply! > The execution mode is also used for the DataStream API [1], > would that also affect/hide the DataStream execution mode > if we remove it from the WebUI? Sorry, I didn't describe it clearly in FLIP-441[2], I have updated it. Let me clarify the Execution Mode