[jira] [Created] (FLINK-31116) Support taskmanager related parameters in session mode Support job granularity setting

2023-02-16 Thread waywtdcc (Jira)
waywtdcc created FLINK-31116: Summary: Support taskmanager related parameters in session mode Support job granularity setting Key: FLINK-31116 URL: https://issues.apache.org/jira/browse/FLINK-31116 Projec

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Qingsheng Ren
Congratulations, Dong! Best, Qingsheng On Fri, Feb 17, 2023 at 3:00 PM Jane Chan wrote: > Congratulations, Dong! > > Best, > Jane > > On Fri, Feb 17, 2023 at 10:43 AM Zhipeng Zhang > wrote: > > > Congratulations, Dong! > > > > Yun Tang 于2023年2月17日周五 10:37写道: > > > > > > Congratulations, Dong!

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-16 Thread Qingsheng Ren
Congratulations and welcome, Jing! Best, Qingsheng On Fri, Feb 17, 2023 at 3:02 PM Jane Chan wrote: > Congratulations, Jing! > > Best, > Jane > > On Fri, Feb 17, 2023 at 9:59 AM ConradJam wrote: > > > Congratulations Jing! > > > > Anton Kalashnikov 于2023年2月16日周四 23:43写道: > > > > > Congrats Ji

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-16 Thread Jane Chan
Congratulations, Jing! Best, Jane On Fri, Feb 17, 2023 at 9:59 AM ConradJam wrote: > Congratulations Jing! > > Anton Kalashnikov 于2023年2月16日周四 23:43写道: > > > Congrats Jing! > > > > -- > > Best regards, > > Anton Kalashnikov > > > > On 16.02.23 14:38, Austin Cawley-Edwards wrote: > > > Congrats

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Jane Chan
Congratulations, Dong! Best, Jane On Fri, Feb 17, 2023 at 10:43 AM Zhipeng Zhang wrote: > Congratulations, Dong! > > Yun Tang 于2023年2月17日周五 10:37写道: > > > > Congratulations, Dong! > > > > Best > > Yun Tang > > > > From: Yuxin Tan > > Sent: Friday, February 17,

[jira] [Created] (FLINK-31115) Support a task to specify multiple slots

2023-02-16 Thread waywtdcc (Jira)
waywtdcc created FLINK-31115: Summary: Support a task to specify multiple slots Key: FLINK-31115 URL: https://issues.apache.org/jira/browse/FLINK-31115 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-31114) Batch job fails with IllegalStateException when using adaptive batch scheduler

2023-02-16 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-31114: -- Summary: Batch job fails with IllegalStateException when using adaptive batch scheduler Key: FLINK-31114 URL: https://issues.apache.org/jira/browse/FLINK-31114 Project: F

[jira] [Created] (FLINK-31113) Support AND filter for flink-orc

2023-02-16 Thread Shammon (Jira)
Shammon created FLINK-31113: --- Summary: Support AND filter for flink-orc Key: FLINK-31113 URL: https://issues.apache.org/jira/browse/FLINK-31113 Project: Flink Issue Type: Improvement Com

[jira] [Created] (FLINK-31112) How to Change the default mode of the volume attached to flink-config-volume in a pod on Flink native Kubernetes

2023-02-16 Thread hob007 (Jira)
hob007 created FLINK-31112: -- Summary: How to Change the default mode of the volume attached to flink-config-volume in a pod on Flink native Kubernetes Key: FLINK-31112 URL: https://issues.apache.org/jira/browse/FLINK-311

[jira] [Created] (FLINK-31111) Introduce CatalogTestBase

2023-02-16 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-3: Summary: Introduce CatalogTestBase Key: FLINK-3 URL: https://issues.apache.org/jira/browse/FLINK-3 Project: Flink Issue Type: Improvement C

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Zhipeng Zhang
Congratulations, Dong! Yun Tang 于2023年2月17日周五 10:37写道: > > Congratulations, Dong! > > Best > Yun Tang > > From: Yuxin Tan > Sent: Friday, February 17, 2023 10:19 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin > > Cong

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Yun Tang
Congratulations, Dong! Best Yun Tang From: Yuxin Tan Sent: Friday, February 17, 2023 10:19 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin Congratulations, Dong! Best, Yuxin ConradJam 于2023年2月17日周五 09:59写道: > Congratu

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Yuxin Tan
Congratulations, Dong! Best, Yuxin ConradJam 于2023年2月17日周五 09:59写道: > Congratulations Dong > > Dong Lin 于2023年2月16日周四 21:32写道: > > > Thank you all! > > > > I am looking forward to making more contributions to Apache Flink! > > > > On Thu, Feb 16, 2023 at 8:34 PM Jark Wu wrote: > > > > > Cong

Re: [DISCUSS] Release Flink 1.15.4

2023-02-16 Thread ConradJam
+1 Sergey Nuyanzin 于2023年2月16日周四 17:36写道: > +1 > > On Thu, Feb 16, 2023 at 10:32 AM yuxia > wrote: > > > +1 > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Rui Fan" <1996fan...@gmail.com> > > 收件人: "dev" > > 发送时间: 星期四, 2023年 2 月 16日 上午 11:31:49 > > 主题: Re: [DISCUSS] Release F

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread ConradJam
Congratulations Dong Dong Lin 于2023年2月16日周四 21:32写道: > Thank you all! > > I am looking forward to making more contributions to Apache Flink! > > On Thu, Feb 16, 2023 at 8:34 PM Jark Wu wrote: > > > Congratulations, Dong! > > > > Best, > > Jark > > > > > 2023年2月16日 20:13,Yanfei Lei 写道: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-16 Thread ConradJam
Congratulations Jing! Anton Kalashnikov 于2023年2月16日周四 23:43写道: > Congrats Jing! > > -- > Best regards, > Anton Kalashnikov > > On 16.02.23 14:38, Austin Cawley-Edwards wrote: > > Congrats Jing! > > > > On Thu, Feb 16, 2023 at 01:37 Feng Jin wrote: > > > >> Congratulations, Jing! > >> > >> > >>

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Shammon FY
Hi Gyula, Samrat Thanks for your input and I totally agree with you that it's really big work. As @Samrat mentioned above, I think it's not a short way to make the autoscaler completely independent too. But I still find some valuable points for the `completely independent autoscaler`, and I think

[jira] [Created] (FLINK-31110) Web UI shows "User Configuration" preserving lines and whitespaces

2023-02-16 Thread Mingliang Liu (Jira)
Mingliang Liu created FLINK-31110: - Summary: Web UI shows "User Configuration" preserving lines and whitespaces Key: FLINK-31110 URL: https://issues.apache.org/jira/browse/FLINK-31110 Project: Flink

[jira] [Created] (FLINK-31109) Fails with proxy user not supported even when security.kerberos.fetch.delegation-token is set to false

2023-02-16 Thread Venkata krishnan Sowrirajan (Jira)
Venkata krishnan Sowrirajan created FLINK-31109: --- Summary: Fails with proxy user not supported even when security.kerberos.fetch.delegation-token is set to false Key: FLINK-31109 URL: https://issues.

[jira] [Created] (FLINK-31108) Use StreamARN for API calls in Kinesis Connector

2023-02-16 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-31108: --- Summary: Use StreamARN for API calls in Kinesis Connector Key: FLINK-31108 URL: https://issues.apache.org/jira/browse/FLINK-31108 Project: Flink Issue

[jira] [Created] (FLINK-31107) Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31107: --- Summary: Can't subscribe the non-persistent topics by using regex in Pulsar 2.11.0 Key: FLINK-31107 URL: https://issues.apache.org/jira/browse/FLINK-31107 Project: Flin

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-16 Thread Anton Kalashnikov
Congrats Jing! -- Best regards, Anton Kalashnikov On 16.02.23 14:38, Austin Cawley-Edwards wrote: Congrats Jing! On Thu, Feb 16, 2023 at 01:37 Feng Jin wrote: Congratulations, Jing! Best, Feng On Thu, Feb 16, 2023 at 2:24 PM Weihua Hu wrote: Congratulations, Jing! Best, Weihua On Th

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Gyula Fóra
@Shammon , Samrat: I appreciate the enthusiasm and I wish this was only a matter of intention but making the autoscaler work without the operator may be a pretty big task. You must not forget 2 core requirements here. 1. The autoscaler logic itself has to run somewhere (in this case on k8s within

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
Hi Shammon, Thank you for your input, completely aligned with you. We are fine with either of the options , but IMO, to start with it will be easy to have it in the flink-kubernetes-operator as a module instead of a separate repo which requires additional effort. Given that we would be incremen

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
Hi Max , If you are fine and aligned with the same thought , since this is going to be very useful to us, we are ready to help / contribute additional work required. Bests, Samrat On Thu, 16 Feb 2023 at 5:28 PM, Shammon FY wrote: > Hi Samrat > > Do you mean to create an independent module for

[RESULT][VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-16 Thread Dong Lin
Hi all, I am happy to announce that FLIP-289: Support online inference (Flink ML) [1] has been accepted. There are 3 binding votes [2]: - Dian Fu (binding) - Zhipeng Zhang (binding) - Dong Lin (binding) There is no disapproving vote. Regards, Dong [1] https://cwiki.apache.org/confluence/pages/

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-16 Thread Dong Lin
Thank you all for the votes! The vote is now closed. I will announce the results in a separate email. Cheers, Dong On Thu, Feb 16, 2023 at 6:02 PM Zhipeng Zhang wrote: > +1 (binding) > > Regards, > Zhipeng > > Dian Fu 于2023年2月13日周一 20:21写道: > > > > +1 (binding) > > > > Regards, > > Dian > > >

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-16 Thread Austin Cawley-Edwards
Congrats Jing! On Thu, Feb 16, 2023 at 01:37 Feng Jin wrote: > Congratulations, Jing! > > > Best, > Feng > > On Thu, Feb 16, 2023 at 2:24 PM Weihua Hu wrote: > > > > Congratulations, Jing! > > > > Best, > > Weihua > > > > > > On Thu, Feb 16, 2023 at 2:03 PM Dian Fu wrote: > > > > > Congratulat

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Dong Lin
Thank you all! I am looking forward to making more contributions to Apache Flink! On Thu, Feb 16, 2023 at 8:34 PM Jark Wu wrote: > Congratulations, Dong! > > Best, > Jark > > > 2023年2月16日 20:13,Yanfei Lei 写道: > > > > Congratulations, Dong! > > > > Best regards, > > Yanfei > > > > Sergey Nuyanz

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Jark Wu
Congratulations, Dong! Best, Jark > 2023年2月16日 20:13,Yanfei Lei 写道: > > Congratulations, Dong! > > Best regards, > Yanfei > > Sergey Nuyanzin 于2023年2月16日周四 17:21写道: >> >> Congratulations, Dong! >> >> On Thu, Feb 16, 2023 at 10:01 AM Wencong Liu wrote: >> >>> Congratulations Dong! >>> >

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Yanfei Lei
Congratulations, Dong! Best regards, Yanfei Sergey Nuyanzin 于2023年2月16日周四 17:21写道: > > Congratulations, Dong! > > On Thu, Feb 16, 2023 at 10:01 AM Wencong Liu wrote: > > > Congratulations Dong! > > > > > > Bast, > > Wencong Liu > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >

[jira] [Created] (FLINK-31106) Skip history server archiving for suspended jobs on JsonResponseHistoryServerArchivist

2023-02-16 Thread xy (Jira)
xy created FLINK-31106: -- Summary: Skip history server archiving for suspended jobs on JsonResponseHistoryServerArchivist Key: FLINK-31106 URL: https://issues.apache.org/jira/browse/FLINK-31106 Project: Flink

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Shammon FY
Hi Samrat Do you mean to create an independent module for flink scaling in flink-k8s-operator? How about creating a project such as `flink-auto-scaling` which is completely independent? Besides resource managers such as k8s and yarn, we can do more things in the project, for example, updating conf

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Maximilian Michels
Hi Samrat, The autoscaling module is now pluggable but it is still tightly coupled with Kubernetes. It will take additional work for the logic to work independently of the cluster manager. -Max On Thu, Feb 16, 2023 at 11:14 AM Samrat Deb wrote: > > Oh! yesterday it got merged. > Apologies , I m

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.4.0, release candidate #1

2023-02-16 Thread Maximilian Michels
+1 (binding) 1. Downloaded the archives, checksums, and signatures 2. Verified the signatures and checksums 3. Extract and inspect the source code for binaries 4. Compiled and tested the source code via mvn verify 5. Verified license files / headers 6. Deployed helm chart to test cluster 7. Ran ex

[jira] [Created] (FLINK-31105) SqlClient doesn't respond to QUIT or HELP command even though it's mentioned in the welcome message

2023-02-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31105: - Summary: SqlClient doesn't respond to QUIT or HELP command even though it's mentioned in the welcome message Key: FLINK-31105 URL: https://issues.apache.org/jira/browse/FLINK-31

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
Oh! yesterday it got merged. Apologies , I missed the recent commit @Gyula. Thanks for the update On Thu, Feb 16, 2023 at 3:17 PM Gyula Fóra wrote: > Max recently moved the autoscaler logic in a separate submodule, did you > see that? > > > https://github.com/apache/flink-kubernetes-operator/

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

2023-02-16 Thread Zhipeng Zhang
+1 (binding) Regards, Zhipeng Dian Fu 于2023年2月13日周一 20:21写道: > > +1 (binding) > > Regards, > Dian > > On Mon, Feb 13, 2023 at 11:04 AM Dong Lin wrote: > > > Hi all, > > > > We would like to start the vote for FLIP-289: Support online inference > > (Flink ML) [1]. This FLIP was discussed in this

[jira] [Created] (FLINK-31104) TPC-DS test timed out in query 36

2023-02-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31104: - Summary: TPC-DS test timed out in query 36 Key: FLINK-31104 URL: https://issues.apache.org/jira/browse/FLINK-31104 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31103) Public Table API for table store

2023-02-16 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31103: Summary: Public Table API for table store Key: FLINK-31103 URL: https://issues.apache.org/jira/browse/FLINK-31103 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Gyula Fóra
Max recently moved the autoscaler logic in a separate submodule, did you see that? https://github.com/apache/flink-kubernetes-operator/commit/5bb8e9dc4dd29e10f3ba7c8ce7cefcdffbf92da4 Gyula On Thu, Feb 16, 2023 at 10:27 AM Samrat Deb wrote: > Hi , > > *Context:* > Auto Scaling was introduced in

[jira] [Created] (FLINK-31102) Add ARRAY_REMOVE supported in SQL & Table API

2023-02-16 Thread jackylau (Jira)
jackylau created FLINK-31102: Summary: Add ARRAY_REMOVE supported in SQL & Table API Key: FLINK-31102 URL: https://issues.apache.org/jira/browse/FLINK-31102 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Release Flink 1.15.4

2023-02-16 Thread Sergey Nuyanzin
+1 On Thu, Feb 16, 2023 at 10:32 AM yuxia wrote: > +1 > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Rui Fan" <1996fan...@gmail.com> > 收件人: "dev" > 发送时间: 星期四, 2023年 2 月 16日 上午 11:31:49 > 主题: Re: [DISCUSS] Release Flink 1.15.4 > > +1 > > On Thu, Feb 16, 2023 at 6:51 AM Jing Ge > wrote:

Re: [DISCUSS] Release Flink 1.15.4

2023-02-16 Thread yuxia
+1 Best regards, Yuxia - 原始邮件 - 发件人: "Rui Fan" <1996fan...@gmail.com> 收件人: "dev" 发送时间: 星期四, 2023年 2 月 16日 上午 11:31:49 主题: Re: [DISCUSS] Release Flink 1.15.4 +1 On Thu, Feb 16, 2023 at 6:51 AM Jing Ge wrote: > +1 > > On Wed, Feb 15, 2023 at 4:03 PM Konstantin Knauf > wrote: > > > +1

[DISCUSS] Extract core autoscaling algorithm as new SubModule in flink-kubernetes-operator

2023-02-16 Thread Samrat Deb
Hi , *Context:* Auto Scaling was introduced in Flink as part of FLIP-271[1]. It discusses one of the important aspects to provide a robust default scaling algorithm. a. Ensure scaling yields effective usage of assigned task slots. b. Ramp up in case of any backlog to ensure it gets pro

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Sergey Nuyanzin
Congratulations, Dong! On Thu, Feb 16, 2023 at 10:01 AM Wencong Liu wrote: > Congratulations Dong! > > > Bast, > Wencong Liu > > > > > > > > > > > > > > > > > > At 2023-02-16 14:19:08, "Guowei Ma" wrote: > >Hi, everyone > > > >On behalf of the PMC, I'm very happy to announce Dong Lin as a n

[jira] [Created] (FLINK-31101) Replace all the JUnit 5 assertions to AssertJ

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31101: --- Summary: Replace all the JUnit 5 assertions to AssertJ Key: FLINK-31101 URL: https://issues.apache.org/jira/browse/FLINK-31101 Project: Flink Issue Type: Techn

Re:[ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Wencong Liu
Congratulations Dong! Bast, Wencong Liu At 2023-02-16 14:19:08, "Guowei Ma" wrote: >Hi, everyone > >On behalf of the PMC, I'm very happy to announce Dong Lin as a new >Flink PMC. > >Dong is currently the main driver of Flink ML. He reviewed a large >number of Flink ML re

Re: [DISCUSS] Release Flink 1.15.4

2023-02-16 Thread Matthias Pohl
Generally, I feel like doing a final patch release of the then-not-supported minor version (here 1.15) _after_ the release of a new minor version (here 1.17) sounds more reasonable process-wise because that way we are sure that any even minor commit is included in that final patch release and nothi

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Matthias Pohl
Congratulations, Dong :-) On Thu, Feb 16, 2023 at 9:28 AM weijie guo wrote: > Congratulations Dong! Well deserved~ > > Best regards, > > Weijie > > > Samrat Deb 于2023年2月16日周四 16:12写道: > > > Congratulations , Dong! > > > > On Thu, Feb 16, 2023 at 1:39 PM Jing Ge > > wrote: > > > > > Congrats, D

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Shammon FY
Congratulations, Dong! Best, Shammon On Thu, Feb 16, 2023 at 4:27 PM weijie guo wrote: > Congratulations Dong! Well deserved~ > > Best regards, > > Weijie > > > Samrat Deb 于2023年2月16日周四 16:12写道: > > > Congratulations , Dong! > > > > On Thu, Feb 16, 2023 at 1:39 PM Jing Ge > > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread weijie guo
Congratulations Dong! Well deserved~ Best regards, Weijie Samrat Deb 于2023年2月16日周四 16:12写道: > Congratulations , Dong! > > On Thu, Feb 16, 2023 at 1:39 PM Jing Ge > wrote: > > > Congrats, Dong! > > > > On Thu, Feb 16, 2023 at 8:49 AM Martijn Visser > > > wrote: > > > > > Congratulations Dong

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Samrat Deb
Congratulations , Dong! On Thu, Feb 16, 2023 at 1:39 PM Jing Ge wrote: > Congrats, Dong! > > On Thu, Feb 16, 2023 at 8:49 AM Martijn Visser > wrote: > > > Congratulations Dong! > > > > On Thu, Feb 16, 2023 at 8:47 AM zhouenning > > > wrote: > > > > > Congratulations, Dong! Best, Eming > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Jing Ge
Congrats, Dong! On Thu, Feb 16, 2023 at 8:49 AM Martijn Visser wrote: > Congratulations Dong! > > On Thu, Feb 16, 2023 at 8:47 AM zhouenning > wrote: > > > Congratulations, Dong! Best, Eming > > > > > > 在 2023年2月16日 15:30,Geng Biao 写道: > > > > > > Congrats, Dong! Best, Biao Geng 获取 Outlook for

[jira] [Created] (FLINK-31100) Support the short topic pattern subscriber on default tenant and namespace

2023-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-31100: --- Summary: Support the short topic pattern subscriber on default tenant and namespace Key: FLINK-31100 URL: https://issues.apache.org/jira/browse/FLINK-31100 Project: Fli