Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Timo Walther
Hi Hao, 1. Can `StructuredType` be nested? Yes this is supported. 2. What's the main reason the class won't be enforced in SQL? SQL should not care about classes. Within the SQL ecosystem, the SQL engine controls the data serialization and protocols. The SQL engine will not load the class. C

[RESULT][VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-22 Thread Arvid Heise
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 4 of which are binding: * Yanquan Lv (non-binding) * Xiqian YU (non-binding) * Leonard Xu (binding) * Tom Cooper (non-binding) * Weijie guo (binding) * Sergey Nuyanzin (binding) * Robert Metzger (bin

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-22 Thread Arvid Heise
Thank you everyone for verifying the release. We have enough votes, so I will close this thread and announce the results in another. Best, Arvid On Wed, Apr 23, 2025 at 8:10 AM Robert Metzger wrote: > +1 (binding) > > - checked the staged maven artifacts > > On Tue, Apr 22, 2025 at 11:06 PM Se

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-22 Thread Robert Metzger
+1 (binding) - checked the staged maven artifacts On Tue, Apr 22, 2025 at 11:06 PM Sergey Nuyanzin wrote: > +1 (binding) > > - verified signatures and hashsums > - checked RNs > - compiled from source > > one finding: > it seems KafkaTableITCase generates test artifacts not in a temporary > fol

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Hao Li
Hi Timo, Thanks for the FLIP. +1 with a few questions: 1. Can `StructuredType` be nested? e.g. `STRUCTURED<'com.example.User', name STRING, age INT NOT NULL, address STRUCTURED<'com.example.address', street STRING, zip STRING>>` 2. What's the main reason the class won't be enforced in SQL? Since

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-22 Thread Sergey Nuyanzin
+1 (binding) - verified signatures and hashsums - checked RNs - compiled from source one finding: it seems KafkaTableITCase generates test artifacts not in a temporary folder and it appears in git diff after that I create a jira issue for that[1] Based on git history the issue is present since Se

[jira] [Created] (FLINK-37714) KafkaTableITCase generates artifacts in main path

2025-04-22 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-37714: --- Summary: KafkaTableITCase generates artifacts in main path Key: FLINK-37714 URL: https://issues.apache.org/jira/browse/FLINK-37714 Project: Flink Issue

Re: [DISCUSS] FLIP-518: Introduce a community review process

2025-04-22 Thread David Radley
Hi Seb and Robert, Thanks for your feedback I have taken it on board, and have amended the Flip[1] to be a Git action that will automatically set and remove the labels. See the updated text and flow diagram in the flip for details, Kind regards, David. [1] https://cwiki.apache.org/confluence/di

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Timo Walther
Hi Arvid, Hi Sergey, thanks for your feedback. I updated the FLIP accordingly but let me answer your questions here as well: > Are we going to enforce that the name is a valid class name? What is > happening if it's not a correct name? > What are the implications of using a class that is not i

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Timo Walther
It seems the original DISCUSS thread was split into two. I will answer in the original thread for improving the history. Cheers, Timo On 22.04.25 15:23, Arvid Heise wrote: Hi Timo, +1 for the proposal. A couple of remarks: - Are we going to enforce that the name is a valid class name? What is

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Arvid Heise
Hi Timo, +1 for the proposal. A couple of remarks: - Are we going to enforce that the name is a valid class name? What is happening if it's not a correct name? - What are the implications of using a class that is not in the classpath in Table API? It looks to me that the name is metadata-only unti

RE: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Gustavo de Morais
Thanks for the small but important changes proposed. IMO, these are essential for dealing with these directly in SQL. On 2025/04/10 05:54:58 Timo Walther wrote: > Hi everyone, > > I would like to start a discussion about FLIP-520: Simplify > StructuredType handling [1]. > > Flink SQL already

[jira] [Created] (FLINK-37713) SchemaManager was recreated in SchemaRegistry after job failover

2025-04-22 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37713: -- Summary: SchemaManager was recreated in SchemaRegistry after job failover Key: FLINK-37713 URL: https://issues.apache.org/jira/browse/FLINK-37713 Project: Flink

Re: [ANNOUNCE] Apache flink-connector-jdbc 3.3.0 & 4.0.0 released

2025-04-22 Thread Leonard Xu
Nice work, Hang! Best, Leonard > 2025 4月 22 17:54,Hang Ruan 写道: > > The Apache Flink community is very happy to announce the release of > Apache flink-connector-jdbc 3.3.0 & 4.0.0. > > Apache Flink® is an open-source stream processing framework for > distributed, high-performing, always-availa

2025/04/17 CHI Western time zone workgroup meeting minute

2025-04-22 Thread David Radley
Hi, Here are last Thursday’s CHI meeting minutes. We talked about the Kryo change and the community review Flip. David to progress these items. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=350784108 kind regards, David. Unless otherwise stated above: IBM United Kingdom Limi

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Sergey Nuyanzin
Thanks for driving this Timo The FLIP seems reasonable to me I have one minor question/clarification do I understand it correct that after this FLIP we can execute of `typeof` against result of `OBJECT_OF` for instance SELECT typeof(OBJECT_OF( 'com.example.User', 'name', 'Bob', 'age', 42 )

[ANNOUNCE] Apache flink-connector-jdbc 3.3.0 & 4.0.0 released

2025-04-22 Thread Hang Ruan
The Apache Flink community is very happy to announce the release of Apache flink-connector-jdbc 3.3.0 & 4.0.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for dow

Re: [DISCUSS] FLIP-520: Simplify StructuredType handling

2025-04-22 Thread Timo Walther
Hi everyone, I would like to ask again for feedback on this FLIP. It is a rather small change but with big impact on usability for structured data. Are there any objections? Otherwise I would like to continue with voting soon. Thanks, Timo On 10.04.25 07:54, Timo Walther wrote: Hi everyon

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-22 Thread Timo Walther
+1 for this feature. Having a VARIANT type makes a lot of sense and together with an OBJECT type will make semi-structured data processing in Flink easier. Currently, I'm catching up with notifications after the easter holidays, but happy to give some feedback by tomorrow or Thursday as well.

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-22 Thread Jingsong Li
Thanks Xuannan for driving this discussion. At present, communities such as Apache Iceberg, Delta, Spark, Parquet, etc. are all designing and developing around Variant, and our Flink support for Variant is very valuable. After a rough look at the design, there is no overall problem. It is designe

[KINDLY REMINDER] Flink 2.1 Release Sync 23/04/2025

2025-04-22 Thread Ron Liu
Hi, everyone! The first release sync will be held at the following time. - 14:00, Apr 23, BJT (GMT+8) - 08:00, Apr 23, CET (GMT+2) - 23:00, Apr 22, PT (GMT-7) Everyone is welcome to join via Google Meet [1]. The topics to be discussed can be found at the Status / Follow-ups section of the release

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-22 Thread weijie guo
+1(binding) - verified signatures and hashsums - checked release tag - checked release note - compiled from source Best regards, Weijie Yanquan Lv 于2025年4月22日周二 10:24写道: > Gentle ping for more binding votes. > > Tom Cooper 于2025年4月17日周四 20:09写道: > > > Hi Arvid, > > > > Thanks for looking at

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-22 Thread Xintong Song
+1 for this proposal. Storing all structured, semi-structured and unstructured data at one place has been one of the main design goals since day 1 of data lake. Semi-structured / unstructured data processing is becoming even more crucial in the AI era. As already supported by lake formats like Ice

[RESULT][VOTE] flink-connector-jdbc 4.0.0, release candidate #3

2025-04-22 Thread Hang Ruan
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Leonard Xu (binding) * weijie guo (binding) * Xiqian YU * Zakelly Lan (binding) * Yuepeng Pan There are no disapproving votes. Thanks everyone! Best, Hang

[RESULT][VOTE] flink-connector-jdbc 3.3.0, release candidate #2

2025-04-22 Thread Hang Ruan
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Yanquan Lv * Ferenc Csaky * Leonard Xu (binding) * weijie guo (binding) * Zakelly Lan (binding) There are no disapproving votes. Thanks everyone! Best, Hang

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #2

2025-04-22 Thread Hang Ruan
Thanks all, this vote is now closed. I will announce the results on a separate thread. Best, Hang On Mon, Apr 21, 2025 at 7:32 PM Zakelly Lan wrote: > > +1 (binding) > > I have verified: > > - Checksum and signature > - Github CI > - There are no binaries in the source archive > - Release t

Re: [VOTE] Release flink-connector-jdbc v4.0.0, release candidate #3

2025-04-22 Thread Hang Ruan
Thanks all, this vote is now closed. I will announce the results on a separate thread. Best, Hang On Mon, Apr 21, 2025 at 10:59 PM Yuepeng Pan wrote: > > +1 (non-binding) > > Checked: - Download links. > - Local build from source with JDK 11 > - Verified the test cases. > > Best Regards, > Y