[jira] [Created] (FLINK-37732) FLIP-527: State Schema Evolution for RowData

2025-04-25 Thread Weiqing Yang (Jira)
Weiqing Yang created FLINK-37732: Summary: FLIP-527: State Schema Evolution for RowData Key: FLINK-37732 URL: https://issues.apache.org/jira/browse/FLINK-37732 Project: Flink Issue Type: New

[DISCUSS] State Schema Evolution for RowData

2025-04-25 Thread Weiqing Yang
Hi all, I’d like to initiate a discussion about enhancing state schema evolution support for RowData in Flink. *Motivation* Flink applications frequently need to evolve their state schema as business requirements change. Currently, when users update a Table API or SQL job with schema changes inv

[jira] [Created] (FLINK-37731) Update dependency of Paimon to 1.1 and add support for Postpone Bucket

2025-04-25 Thread Yanquan Lv (Jira)
Yanquan Lv created FLINK-37731: -- Summary: Update dependency of Paimon to 1.1 and add support for Postpone Bucket Key: FLINK-37731 URL: https://issues.apache.org/jira/browse/FLINK-37731 Project: Flink

2025/04/24 CHI Eastern time zone workgroup meeting minutes

2025-04-25 Thread David Radley
Hi , The 21st 30 minute working meeting of the Community Health Initiative (CHI) for Western time zone. We talked about the community review process Flip, new statistics from Github and Kryo migration. Full details in the link https://cwiki.apache.org/confluence/x/KooEFQ kind regards, David. U

RE: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-25 Thread David Radley
Hi Xuannan, This looks like a good addition. 1. I was wondering whether it is possible to have a type, but the value be null – for example a null value in a Float type and tolerate nulls being returned for float getFloat(). If so then maybe we should return an object Float instead. 2. Yo

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-25 Thread Timo Walther
Hi Xuannan, sorry for the delay. This is a great addition but needs careful design. Here is some feedback that I found while reading the design doc: 1. Exception design The FLIP mentions IllegalStateException to be thrown. However, this is a very generic exception. We should rather use Table

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-25 Thread Lincoln Lee
+1 for this FLIP. VARIANT type support will be a great addition to sql. Look forward to the detailed design of the subsequent shredding optimizations. Best, Lincoln Lee Timo Walther 于2025年4月22日周二 16:51写道: > +1 for this feature. Having a VARIANT type makes a lot of sense and > together with an

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-25 Thread Xuannan Su
Hi everyone, Thank you for all the comments! If there are no further comments, I'd like to close the discussion and start the voting next Monday. Best, Xuannan On Fri, Apr 25, 2025 at 7:41 PM Lincoln Lee wrote: > > +1 for this FLIP. VARIANT type support will be a great addition to sql. > Look f

FW: Kryo v2 to v5 migration tool

2025-04-25 Thread David Radley
Hi, Quick update, from a quick play - using KryoSerializerSnapshot is not going to work as I suggested below. I did not realise how many parts of Flink depend on Kryo, there is no easy way I can see to have v2 and v5 co existing in the Flink repo without a large refactor. For example I see that

[jira] [Created] (FLINK-37730) Collect job exceptions as kubernetes events

2025-04-25 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-37730: -- Summary: Collect job exceptions as kubernetes events Key: FLINK-37730 URL: https://issues.apache.org/jira/browse/FLINK-37730 Project: Flink Issue Type: I

[jira] [Created] (FLINK-37729) Implement ResultTypeQueryable for Avro serialization schema

2025-04-25 Thread Pawel Leszczynski (Jira)
Pawel Leszczynski created FLINK-37729: - Summary: Implement ResultTypeQueryable for Avro serialization schema Key: FLINK-37729 URL: https://issues.apache.org/jira/browse/FLINK-37729 Project: Flink

[jira] [Created] (FLINK-37727) java.lang.UnsatisfiedLinkError error on pemja.core.PythonInterpreter$MainInterpreter.initialize()

2025-04-25 Thread Shuyi Chen (Jira)
Shuyi Chen created FLINK-37727: -- Summary: java.lang.UnsatisfiedLinkError error on pemja.core.PythonInterpreter$MainInterpreter.initialize() Key: FLINK-37727 URL: https://issues.apache.org/jira/browse/FLINK-37727

[jira] [Created] (FLINK-37728) Incorrect import in EmbeddedPythonWindowOperator.java

2025-04-25 Thread Shuyi Chen (Jira)
Shuyi Chen created FLINK-37728: -- Summary: Incorrect import in EmbeddedPythonWindowOperator.java Key: FLINK-37728 URL: https://issues.apache.org/jira/browse/FLINK-37728 Project: Flink Issue Type: