[jira] [Created] (FLINK-35472) Improve tests for Elasticsearch 8 connector

2024-05-28 Thread Mingliang Liu (Jira)
Mingliang Liu created FLINK-35472: - Summary: Improve tests for Elasticsearch 8 connector Key: FLINK-35472 URL: https://issues.apache.org/jira/browse/FLINK-35472 Project: Flink Issue Type: Imp

[RESULT][VOTE] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-28 Thread Jane Chan
Hi all, I'm happy to announce that FLIP-457[1] has been accepted. There are 11 votes, of which 6 are binding[2]. - Benchao Li (binding) - Leonard Xu (binding) - Lincoln Lee (binding) - Jark Wu (binding) - Rui Fan (binding) - Weijie Guo (binding) - Feng Jin (non-binding) - Hang Ruan (non-binding

[jira] [Created] (FLINK-35473) FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-28 Thread Jane Chan (Jira)
Jane Chan created FLINK-35473: - Summary: FLIP-457: Improve Table/SQL Configuration for Flink 2.0 Key: FLINK-35473 URL: https://issues.apache.org/jira/browse/FLINK-35473 Project: Flink Issue Type:

[jira] [Created] (FLINK-35474) During the process of catching up after a restart, Flink CDC uses the latest table information to parse old binlogs.

2024-05-28 Thread stevedengzhi (Jira)
stevedengzhi created FLINK-35474: Summary: During the process of catching up after a restart, Flink CDC uses the latest table information to parse old binlogs. Key: FLINK-35474 URL: https://issues.apache.org/jira/

[jira] [Created] (FLINK-35475) Introduce isInternalSorterSupport to OperatorAttributes

2024-05-28 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-35475: -- Summary: Introduce isInternalSorterSupport to OperatorAttributes Key: FLINK-35475 URL: https://issues.apache.org/jira/browse/FLINK-35475 Project: Flink Issue Typ

[jira] [Created] (FLINK-35476) The IF built-in function returns an exception when returning a string

2024-05-28 Thread jianhao.Li (Jira)
jianhao.Li created FLINK-35476: -- Summary: The IF built-in function returns an exception when returning a string Key: FLINK-35476 URL: https://issues.apache.org/jira/browse/FLINK-35476 Project: Flink

[DISCUSS] Flink CDC 3.1.1 Release

2024-05-28 Thread Xiqian YU
Hi devs, I would like to make a proposal about creating a new Flink CDC 3.1 patch release (3.1.1). It’s been a week since the last CDC version 3.1.0 got released [1], and since then, 7 tickets have been closed, 4 of them are of high priority. Currently, there are 5 items open at the moment: 1 o

Re: [DISCUSS] Connector releases for Flink 1.19

2024-05-28 Thread Jing Ge
Hi, Thanks Danny for driving it! Do we have an umbrella ticket for Flink 1.19 connectors release? @Sergei Thanks for the hint wrt JDBC connector. Where could users know that it already supports 1.19? Best regards, Jing On Fri, May 17, 2024 at 4:07 AM Sergey Nuyanzin wrote: > >, it looks like

[DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-05-28 Thread Yuxin Tan
Hi all, I would like to start a discussion on FLIP-459 Support Flink hybrid shuffle integration with Apache Celeborn[1]. Flink hybrid shuffle supports transitions between memory, disk, and remote storage to improve performance and job stability. Concurrently, Apache Celeborn provides a stable, per

Re: [VOTE] FLIP-443: Interruptible watermark processing

2024-05-28 Thread Piotr Nowojski
+1 (binding) from my side as well. Voting is closed. Thank you all for voting. Best, Piotrek pon., 27 maj 2024 o 11:37 Stefan Richter napisał(a): > > +1 (binding) > > > > > On 24. May 2024, at 09:59, Martijn Visser > wrote: > > > > +1 (binding) > > > > On Fri, May 24, 2024 at 7:31 AM weijie g

[RESULT][VOTE] FLIP-443: Interruptible watermark processing

2024-05-28 Thread Piotr Nowojski
Hi all! I'm happy to announce that FLIP-443 [1] has been accepted [2]. There were 7 votes in favour, all binding: - Zakelly - Yanfei Lei - Rui Fan - Wejie Guo - Martijn Visser - Stefan Richter - Piotr Nowojski [1] https://cwiki.apache.org/confluence/x/qgn9EQ [2] https://lists.apache.org/thread/t

Re: [DISCUSS] Merge "flink run" and "flink run-application" in Flink 2.0

2024-05-28 Thread Ferenc Csaky
Thank you Xintong for your input. I prepared a FLIP for this change [1], looking forward for any other opinions. Thanks, Ferenc [1] https://docs.google.com/document/d/1EX74rFp9bMKdfoGkz1ASOM6Ibw32rRxIadX72zs2zoY/edit?usp=sharing On Friday, 17 May 2024 at 07:04, Xintong Song wrote: > > >

Re: [VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-05-28 Thread gongzhongqiang
+1(non-binding) - Verified signatures and hash sums - Reviewed the web PR - Built from source code with JDK 1.8 on Ubuntu 22.04 - Checked release notes Best, Zhongqiang Gong Sergey Nuyanzin 于2024年5月16日周四 06:03写道: > Hi everyone, > Please review and vote on release candidate #1 for > flink-conn

[jira] [Created] (FLINK-35477) Pulsar connector resets existing subscription

2024-05-28 Thread Igor Basov (Jira)
Igor Basov created FLINK-35477: -- Summary: Pulsar connector resets existing subscription Key: FLINK-35477 URL: https://issues.apache.org/jira/browse/FLINK-35477 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-05-28 Thread Xintong Song
+1 for this proposal. We have been prototyping this feature internally at Alibaba for a couple of months. Yuxin, I think we can also publish the prototype codes so the community can better understand and help with it. Best, Xintong On Tue, May 28, 2024 at 8:34 PM Yuxin Tan wrote: > Hi all,

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-05-28 Thread Rui Fan
Thanks Yuxin for driving this proposal! Kindly reminder: the image of CIP-6[1] cannot be loaded. [1] https://cwiki.apache.org/confluence/display/CELEBORN/CIP-6+Support+Flink+hybrid+shuffle+integration+with+Apache+Celeborn Best, Rui On Wed, May 29, 2024 at 9:03 AM Xintong Song wrote: > +1 for

Re: [DISCUSS] Flink CDC 3.1.1 Release

2024-05-28 Thread Leonard Xu
Thanks XIqian for kicking off the discussion, +1 from my side. Best, Leonard > 2024年5月28日 下午7:43,Xiqian YU 写道: > > Hi devs, > > I would like to make a proposal about creating a new Flink CDC 3.1 patch > release (3.1.1). It’s been a week since the last CDC version 3.1.0 got > released [1], a

Re: [DISCUSS] FLIP-459: Support Flink hybrid shuffle integration with Apache Celeborn

2024-05-28 Thread Yuxin Tan
Hi, Xintong, > I think we can also publish the prototype codes so the community can better understand and help with it. Ok, I agree on the point. I will prepare and publish the code recently. Rui, > Kindly reminder: the image of CIP-6[1] cannot be loaded. Thanks for the reminder. I've updated

[DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-05-28 Thread Zhanghao Chen
Hi all, I'd like start a discussion on FLIP-460: Display source/sink I/O metrics on Flink Web UI [1]. Currently, the numRecordsIn & numBytesIn metrics for sources and the numRecordsOut & numBytesOut metrics for sinks are always 0 on the Flink web dashboard. It is especially confusing for simpl

[jira] [Created] (FLINK-35478) Pipeline sink Unified primary.key parameter

2024-05-28 Thread melin (Jira)
melin created FLINK-35478: - Summary: Pipeline sink Unified primary.key parameter Key: FLINK-35478 URL: https://issues.apache.org/jira/browse/FLINK-35478 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Flink CDC 3.1.1 Release

2024-05-28 Thread ConradJam
+1 Thanks discussion Leonard Xu 于2024年5月29日周三 09:45写道: > Thanks XIqian for kicking off the discussion, +1 from my side. > > Best, > Leonard > > > > 2024年5月28日 下午7:43,Xiqian YU 写道: > > > > Hi devs, > > > > I would like to make a proposal about creating a new Flink CDC 3.1 patch > release (3.1.1)

Re: [DISCUSS] Add Flink CDC Channel to Apache Flink Slack Workspace

2024-05-28 Thread Hang Ruan
Hi, zhongqiang. Thanks for the proposal. +1 for it. Best, Hang Leonard Xu 于2024年5月28日周二 11:58写道: > > Thanks Zhongqiang for the proposal, we need the Channel and I should have > been created it but not yet, +1 from my side. > > Best, > Leonard > > > 2024年5月28日 上午11:54,gongzhongqiang 写道: > > >

Re: [DISCUSS] The performance of serializerHeavyString starts regress since April 3

2024-05-28 Thread Sam Barker
> I guess that improvement is a fluctuation. You can double check the performance results[1] of the last few days. The performance isn't recovered. Hmm yeah the improvement was a fluctuation and smaller than I remembered seeing (maybe I had zoomed into the timeline too much). > I fixed an issue r