Re: [ANNOUNCE] Apache Flink 2.1.0 released

2025-07-31 Thread Zakelly Lan
Congratulations! Thanks Ron and all the contributors! Best, Zakelly On Thu, Jul 31, 2025 at 8:03 PM Lincoln Lee wrote: > Congratulations! Thanks for driving this! > > Best, > Lincoln Lee > > > Leonard Xu 于2025年7月31日周四 15:36写道: > > > Nice! Thanks Ron and all involved for the great work. > > >

Re: [VOTE] Release 2.1.0, release candidate #1

2025-07-28 Thread Zakelly Lan
Ron Liu wrote: > Hi, Zakelly > > These open issues will be moved to version 2.2.0 after release, which will > require a PMC member to help with this. > > Best, > Ron > > Zakelly Lan 于2025年7月28日周一 14:00写道: > > > Hi Ron, > > > > When reading the jira rele

Re: [VOTE] Release 2.1.0, release candidate #1

2025-07-27 Thread Zakelly Lan
Hi Ron, When reading the jira release notes, I found there might be some tickets that are not fixed in 2.1.0 (still open) but labeled 2.1.0, e.g. FLINK-9879[1] and FLINK-10113[2]. Correct me if I'm wrong. Shall we revisit those open tickets which are labeled 2.1.0 and see if they are actually done

Re: [VOTE] Release 1.19.3, release candidate #2

2025-07-02 Thread Zakelly Lan
+1 (binding) - Verified checksums and signatures - Reviewed jira release notes - Checked the git tag - Checked web PR - Confirmed several artifacts are built with maven 3.8.6 and JDK 1.8.0_442 Best, Zakelly On Sun, Jun 29, 2025 at 3:43 PM Sergey Nuyanzin wrote: > +1 (binding) > > - verified c

[jira] [Created] (FLINK-37944) New test harness for KeyedProcessFunction using State V2

2025-06-11 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37944: --- Summary: New test harness for KeyedProcessFunction using State V2 Key: FLINK-37944 URL: https://issues.apache.org/jira/browse/FLINK-37944 Project: Flink Issue

[jira] [Created] (FLINK-37931) LookupJoinUtil failed to compile

2025-06-10 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37931: --- Summary: LookupJoinUtil failed to compile Key: FLINK-37931 URL: https://issues.apache.org/jira/browse/FLINK-37931 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37930) Generalize the AsyncExecutionController

2025-06-09 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37930: --- Summary: Generalize the AsyncExecutionController Key: FLINK-37930 URL: https://issues.apache.org/jira/browse/FLINK-37930 Project: Flink Issue Type

Re: [VOTE] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-06-02 Thread Zakelly Lan
+1 (binding) Looking forward to the new project Best, Zakelly On Tue, Jun 3, 2025 at 10:36 AM Guowei Ma wrote: > +1 (binding) > Best, > Guowei > > > On Tue, Jun 3, 2025 at 9:17 AM Xingbo Huang wrote: > > > +1 (binding) > > > > Best, > > Xingbo > > > > Letao Jiang 于2025年6月3日周二 07:32写道: > > >

Re: [DISCUSS] Migrate state processor API from source v1 to source v2 API

2025-05-29 Thread Zakelly Lan
o be done. > The whole code is depending on `SourceReaderContext.getRuntimeContext` but > I think when it's stable > and there is another approach how to expose `RuntimeContext` then it's only > matter of time to make that > adjustments. Hope that we're not shooting f

[jira] [Created] (FLINK-37868) Respect the `maxTransferBytes` when using path copying in ForSt

2025-05-29 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37868: --- Summary: Respect the `maxTransferBytes` when using path copying in ForSt Key: FLINK-37868 URL: https://issues.apache.org/jira/browse/FLINK-37868 Project: Flink

[jira] [Created] (FLINK-37867) ForSt StateBackend fail to clean up files of the half-uploaded checkpoint when using path copying

2025-05-29 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37867: --- Summary: ForSt StateBackend fail to clean up files of the half-uploaded checkpoint when using path copying Key: FLINK-37867 URL: https://issues.apache.org/jira/browse/FLINK-37867

Re: [DISCUSS] Migrate state processor API from source v1 to source v2 API

2025-05-29 Thread Zakelly Lan
Hi Gabor, Good point for the migration. I took a brief look. I thought the `RuntimeContext` is too powerful and might not be suitable to expose on \@Public API. Is it possible to introduce another 'rich' code path just like the difference between `RichInputFormat` and `InputFormat`, and keep that

[jira] [Created] (FLINK-37826) Some serde-related perfs regression since May 19th

2025-05-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37826: --- Summary: Some serde-related perfs regression since May 19th Key: FLINK-37826 URL: https://issues.apache.org/jira/browse/FLINK-37826 Project: Flink Issue Type

Re: Keyed Process Stream Operator Behavior for Asynchronous

2025-05-18 Thread Zakelly Lan
Hi Vamsi, In short, the `KeyedProcessFunction` will process the next record of the same key before getting the async response. It only controls the synchronous part of `processElement` for each record to be executed in serial. For now we have similar functionality like keeping same-key record proc

Re: [VOTE] FLIP-516: Multi-Way Join Operator

2025-05-12 Thread Zakelly Lan
Good addition. +1 (binding) Best, Zakelly On Tue, May 13, 2025 at 5:22 AM Dawid Wysakowicz wrote: > +1(binding) > > On Wed, 7 May 2025 at 18:36, Gustavo de Morais > wrote: > > > Hi everyone, > > > > I'd like to start voting on FLIP-516: Multi-Way Join Operator [1]. The > > discussion can be f

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #3

2025-05-12 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - There are no binaries in the source archive - Release tag and staging jars - Release notes Best, Zakelly On Wed, May 7, 2025 at 10:57 AM Leonard Xu wrote: > +1 (binding) > > - verified signatures > - verified hashsums > - checked G

Re: [VOTE]FLIP-519: Introduce async lookup key ordered mode

2025-05-11 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Mon, May 12, 2025 at 9:55 AM Lincoln Lee wrote: > +1 (binding) > > > Best, > Lincoln Lee > > > shuai xu 于2025年5月9日周五 17:46写道: > > > Hi devs, > > > > Thank you for providing feedback on FLIP-519: Introduce async lookup key > > ordered mode[1]. > > I'd like to star

Re: [DISCUSS] Flink 1.19.3 release

2025-05-09 Thread Zakelly Lan
+1 Thanks for volunteering Best, Zakelly On Fri, May 9, 2025 at 9:56 AM Ron Liu wrote: > +1 > > Best, > Ron > > Gabor Somogyi 于2025年5月9日周五 00:06写道: > > > Thanks for volunteering +1. > > > > G > > > > > > On Thu, May 8, 2025 at 5:49 PM Ferenc Csaky > > wrote: > > > > > Hello devs, > > > > >

Re: [DISCUSS] Flink 1.20.2 release

2025-05-09 Thread Zakelly Lan
+1 Thanks for volunteering Best, Zakelly On Fri, May 9, 2025 at 3:42 PM Martijn Visser wrote: > +1, thanks! > > On Fri, May 9, 2025 at 3:57 AM Ron Liu wrote: > > > +1 > > > > Best, > > Ron > > > > Gabor Somogyi 于2025年5月8日周四 23:52写道: > > > > > Thanks for volunteering +1. > > > > > > G > > >

Re: [DISCUSS] State Schema Evolution for RowData

2025-04-28 Thread Zakelly Lan
ile enabling RowData to > perform specialized migration logic without requiring backend changes. > > I’ve updated the proposal document to include pseudo-code examples of > *migrateState* and *migrateElement* in the *RowDataSerializerSnapshot* > class to illustrate this. Let me

Re: [DISCUSS] State Schema Evolution for RowData

2025-04-26 Thread Zakelly Lan
Hi, Weiqing Thanks for the FLIP! In general I'd +1 for schema evolution for RowData types, which will enhance the user experience of SQL jobs. I have one questions for now: You suggested introducing new methods in `TypeSerializerSnapshot`, but is it possible to leverage existing state migration

Re: [VOTE] Release flink-connector-jdbc v4.0.0, release candidate #3

2025-04-21 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - Github CI - There are no binaries in the source archive - Release tag and staging jars, manifest shows they are built by JDK 11.0.16.1 - Release notes and web PR Best, Zakelly On Mon, Apr 21, 2025 at 4:28 PM Xiqian YU wrote: > +1

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #2

2025-04-21 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - Github CI - There are no binaries in the source archive - Release tag and staging jars, manifest shows they are built by JDK 1.8.0_301 - Release notes and web PR Best, Zakelly On Mon, Apr 21, 2025 at 3:54 PM weijie guo wrote: > +1

Re: [VOTE] FLIP-522: Add generalized type information to SQL state connector

2025-04-21 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Mon, Apr 21, 2025 at 6:17 PM Márton Balassi wrote: > +1 (binding) > > On Mon, Apr 21, 2025 at 9:27 AM Gabor Somogyi > wrote: > > > Hi All, > > > > I'd like to start a vote on FLIP-522: Add generalized type information to > > SQL state connector [1] > > which has

Re: [DISCUSS] Missing TreeMapState abstraction for maintaining ordered state

2025-04-21 Thread Zakelly Lan
the order book use case, sorting doubles (IEEE 754) is fairly > straightforward: > > long toOrderedBits(double value) { > long bits = Double.doubleToRawLongBits(value); > return bits ^ (((bits >> 63) - 1L) | 0x8000L); > } > > > [1] https://cwiki.

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #1

2025-04-17 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - There are no binaries in the source archive - Release tag and staging jars, manifest shows they are built by JDK 1.8.0_301 - Release notes and web PR Best, Zakelly On Mon, Apr 14, 2025 at 8:11 PM Leonard Xu wrote: > +1 (binding) >

Re: [VOTE] Release flink-connector-elasticsearch v4.0.0, release candidate #2

2025-04-16 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - There are no binaries in the source archive - Release tag and staging jars, manifest shows they are built by JDK 11.0.23 - Built from source - Release notes and web PR Best, Zakelly On Mon, Apr 14, 2025 at 9:02 PM Leonard Xu wrote

Re: [ANNOUNCE] New Apache Flink Committer - Yanquan Lv

2025-04-16 Thread Zakelly Lan
Congratulations! Best, Zakelly On Wed, Apr 16, 2025 at 8:27 PM Jiabao Sun wrote: > Congrats Yanquan! > > Best, > Jiabao > > On 2025/04/16 07:23:42 Leonard Xu wrote: > > Hi everyone, > > > > On behalf of the PMC, I'm happy to let you know that Yanquan Lv has > become a new Flink Committer! > >

Re: [ANNOUNCE] New Apache Flink Committer - Xiqian Yu

2025-04-16 Thread Zakelly Lan
Congratulations! Best, Zakelly On Wed, Apr 16, 2025 at 8:27 PM Yanquan Lv wrote: > Congratulations! > > Best, > Yanquan > > Jiabao Sun 于2025年4月16日周三 20:25写道: > > > Congrats Xiqian! > > > > Best, > > Jiabao > > > > On 2025/04/16 07:25:19 Leonard Xu wrote: > > > Hi everyone, > > > > > > On beha

Re: [DISCUSS] Add generalized type information to SQL state connector

2025-04-16 Thread Zakelly Lan
Hi Gabor, Thanks for driving this. Well this is a nice addition, so +1 from my side. Best, Zakelly On Tue, Apr 15, 2025 at 9:06 AM Gabor Somogyi wrote: > Hi All, > > I'd like to start a discussion of FLIP-522: Add generalized type > information to SQL state connector [1]. > Feel free to add

Re: [DISCUSS] Missing TreeMapState abstraction for maintaining ordered state

2025-04-13 Thread Zakelly Lan
Hi Charles, There is a FLIP-220[1] and discussions[2] about introducing a sorted map state in binary order. But it seems like there is no further progress and conclusion. It would be nice if anyone could drive this. I would +1 for introducing this. As the RocksDB stores key-value in binary order,

[jira] [Created] (FLINK-37628) Wrong reference counting in ForSt file cache

2025-04-10 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37628: --- Summary: Wrong reference counting in ForSt file cache Key: FLINK-37628 URL: https://issues.apache.org/jira/browse/FLINK-37628 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-519: Introduce async lookup key ordered mode

2025-04-09 Thread Zakelly Lan
Hi all, I have also added a 'Follow up' section at the end of the FLIP-425[1] describing this. [1] https://cwiki.apache.org/confluence/x/S4p3EQ Best, Zakelly On Wed, Apr 9, 2025 at 12:42 PM Zakelly Lan wrote: > Thanks for driving this! > > +1 for the FLIP given there i

[jira] [Created] (FLINK-37642) Use the mailboxExecutor for operator in Async state processing

2025-04-09 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37642: --- Summary: Use the mailboxExecutor for operator in Async state processing Key: FLINK-37642 URL: https://issues.apache.org/jira/browse/FLINK-37642 Project: Flink

Re: [DISCUSS] FLIP-519: Introduce async lookup key ordered mode

2025-04-08 Thread Zakelly Lan
Thanks for driving this! +1 for the FLIP given there is a solid user case behind. Shuai and I had a discussion and we agree that `KeyedAsyncWaitOperator` in current FLIP shares similar functionality with the `Asynchronous Execution Model (AEC)` introduced in FLIP-425[1]. We think it is better to

Re: [VOTE] Release flink-connector-kudu v2.0.0, release candidate #1

2025-04-07 Thread Zakelly Lan
+1 (binding) I have verified: - Signatures and checksum - There are no binaries in the source archive - Release tag and staging jars - Built from source - Web PR and release notes Best, Zakelly On Sat, Apr 5, 2025 at 11:22 PM Gyula Fóra wrote: > +1 (binding) > > Verified: > - Checkpo

Re: [VOTE] Release flink-connector-elasticsearch v4.0.0, release candidate #1

2025-04-07 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - There are no binaries in the source archive - Release tag and staging jars - Built from source - Release notes and web PR not a blocker: better update the NOTICE to year 2025 On Thu, Apr 3, 2025 at 2:12 PM weijie guo wrote: > Hi ev

Re: [VOTE] Release flink-connector-elasticsearch v3.1.0, release candidate #1

2025-04-07 Thread Zakelly Lan
+1 (binding) I have verified: - Checksum and signature - There are no binaries in the source archive - Release tag and staging jars - Built from source - Release notes and web PR Best, Zakelly On Thu, Apr 3, 2025 at 12:18 PM weijie guo wrote: > Hi everyone, > > > Please review and vote

[jira] [Created] (FLINK-37624) Support enableAsyncState and switch operator after datastream transformation

2025-04-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37624: --- Summary: Support enableAsyncState and switch operator after datastream transformation Key: FLINK-37624 URL: https://issues.apache.org/jira/browse/FLINK-37624 Project

[jira] [Created] (FLINK-37623) Async state support for `process()` in Datastream API

2025-04-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37623: --- Summary: Async state support for `process()` in Datastream API Key: FLINK-37623 URL: https://issues.apache.org/jira/browse/FLINK-37623 Project: Flink Issue

[jira] [Created] (FLINK-37620) ForSt Sync mode support remote storage and provide configurable options

2025-04-06 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37620: --- Summary: ForSt Sync mode support remote storage and provide configurable options Key: FLINK-37620 URL: https://issues.apache.org/jira/browse/FLINK-37620 Project: Flink

Re: [VOTE] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

2025-04-05 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Thu, Apr 3, 2025 at 1:33 PM Yuan Mei wrote: > Thanks for driving this :-) > > +1 > > > > On Thu, Apr 3, 2025 at 12:34 PM Han Yin wrote: > > > Hi everyone, > > > > I'd like to start a vote on the FLIP-432: Faster Checkpoint & Recovery > for > > Disaggregated State

Re: [ANNOUNCE] New Apache Flink PMC Member - Sergey Nuyanzin

2025-04-04 Thread Zakelly Lan
Congratulations, Sergey! Best, Zakelly On Thu, Apr 3, 2025 at 3:10 PM Dawid Wysakowicz wrote: > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC > Member > - Sergey Nuyanzin. > > Sergey has been a dedicated and invaluable contributor to the Flink > community for several

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-03 Thread Zakelly Lan
_email> > > > On Tue, Apr 1, 2025 at 3:53 AM Yuan Mei wrote: > > > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC > > Member > > - Zakelly Lan. > > > > Zakelly has been a dedicated and invaluable contributor to the Flink

[jira] [Created] (FLINK-37597) Use ResourceGuard to make sure snapshot quit before ForSt dispose

2025-04-01 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37597: --- Summary: Use ResourceGuard to make sure snapshot quit before ForSt dispose Key: FLINK-37597 URL: https://issues.apache.org/jira/browse/FLINK-37597 Project: Flink

Re: Re: [VOTE] FLIP-512: Add meta information to SQL state connector

2025-03-31 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Mon, Mar 31, 2025 at 3:05 PM Yuepeng Pan wrote: > +1 (non-binding) > > Thanks for driving it ! > > Best regards, > > Yuepeng Pan. > > > > > > > > > > > > > > > > > > At 2025-03-31 15:03:14, "Gyula Fóra" wrote: > >+1 (binding) > > > >Gyula > > > >On Mon, Mar 31, 2

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-31 Thread Zakelly Lan
> > https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/modules/ > > >> > > >> Gabor Somogyi 于2025年3月28日周五 00:26写道: > > >> > > >>> Just found out that PTF in batch mode is not supported, plz see the > dev > > >>>

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-28 Thread Zakelly Lan
s://lists.apache.org/thread/ytm9m1qt4pq2q2gjngfktrn8vrlvkf07 >>> >>> BR, >>> G >>> >>> >>> On Thu, Mar 27, 2025 at 3:38 PM Gabor Somogyi >> > >>> wrote: >>> >>> > In the meantime I've just updated the FLIP acc

Re: [DISCUSS] FLIP-XXX: Checkpoint supports the Operator to customize asynchronous operation

2025-03-28 Thread Zakelly Lan
Hi all, Yes, we already had a discussion under the jira[1], here's my thought: I'd +1 for the motivation, since there might be some long operations for operators (source or sink) which should be done before checkpoint materialization. One suggestion regarding the API design: Instead of introduci

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-25 Thread Zakelly Lan
han happy since they > expect manual intervention with full control. So all in all one can count > on my +1 when CLI FLIP would come up... > > BR, > G > > > On Thu, Mar 20, 2025 at 8:20 AM Gyula Fóra wrote: > >> Hi! >> >> @Zakelly Lan >> I think

Re: [ANNOUNCE] Apache Flink 2.0.0 released

2025-03-24 Thread Zakelly Lan
Congratulations! Thanks Xintong, Jark, Jiangjie and Martijn for driving the 2.0. Thanks everyone for the great work! Best, Zakelly On Mon, Mar 24, 2025 at 4:24 PM Xintong Song wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 2.0.0, which is the first

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-19 Thread Zakelly Lan
ne-time information instead of a > > > streaming > > > > > > data that changes all > > > > > > the time, so a single connector seems to be an overkill. > > > > > > > > > > > > State da

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-18 Thread Zakelly Lan
Backend architecture does not permit operators to encode > > > > > TypeInformation into the state—it only preserves the Serializer. > This > > > > > limitation creates an asymmetry, as operators alone retain > knowledge > > of > > > > the &

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-11 Thread Zakelly Lan
+1 (non-binding) - verified signatures & checksums - built from source using jdk11 - reviewed the website PR - run several Nexmark queries with disaggregated state on oss, and tried rescaling, everything looks fine. On Mon, Mar 10, 2025 at 5:06 PM Xintong Song wrote: > Hi everyone, > > There we

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-11 Thread Zakelly Lan
outputs > > > user-defined > > > > > values in its records. This approach feels somewhat redundant to > me. > > > > > > > > > > > > > If we would add a new `savepoint-metadata` connector then this can be > > > > addressed. > > > >

[jira] [Created] (FLINK-37434) Incremental checkpoint not configurable for ForSt's sync mode

2025-03-11 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37434: --- Summary: Incremental checkpoint not configurable for ForSt's sync mode Key: FLINK-37434 URL: https://issues.apache.org/jira/browse/FLINK-37434 Project:

[jira] [Created] (FLINK-37442) Properly delete the directories for ForSt remote storage

2025-03-08 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37442: --- Summary: Properly delete the directories for ForSt remote storage Key: FLINK-37442 URL: https://issues.apache.org/jira/browse/FLINK-37442 Project: Flink Issue

[jira] [Created] (FLINK-37439) Missing file creation with overwrite semantic in ForSt wrapped file system

2025-03-08 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37439: --- Summary: Missing file creation with overwrite semantic in ForSt wrapped file system Key: FLINK-37439 URL: https://issues.apache.org/jira/browse/FLINK-37439 Project

[jira] [Created] (FLINK-37437) ForSt checkpoint failure due to file not visible when writing

2025-03-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37437: --- Summary: ForSt checkpoint failure due to file not visible when writing Key: FLINK-37437 URL: https://issues.apache.org/jira/browse/FLINK-37437 Project: Flink

[jira] [Created] (FLINK-37435) Kryo related perf regression since March 5th

2025-03-06 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37435: --- Summary: Kryo related perf regression since March 5th Key: FLINK-37435 URL: https://issues.apache.org/jira/browse/FLINK-37435 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37425) Sanity check before ForSt cache created

2025-03-05 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37425: --- Summary: Sanity check before ForSt cache created Key: FLINK-37425 URL: https://issues.apache.org/jira/browse/FLINK-37425 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-02 Thread Zakelly Lan
Hi Gabor, +1 for this. Will the metadata column use `METADATA VIRTUAL` as key words for definition, or `METADATA FROM xxx VIRTUAL` for renaming, just like the Kafka table? Best, Zakelly On Sat, Mar 1, 2025 at 1:31 PM Gabor Somogyi wrote: > Hi All, > > I'd like to start a discussion of FLIP-5

[jira] [Created] (FLINK-37400) Redundant serializer duplication during value serialization of ForSt states

2025-02-27 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37400: --- Summary: Redundant serializer duplication during value serialization of ForSt states Key: FLINK-37400 URL: https://issues.apache.org/jira/browse/FLINK-37400 Project

Re: [DISCUSSION] Upgrade to Kryo 5 for Flink 2.0

2025-02-26 Thread Zakelly Lan
Sry for the late reply, also +1 to have this in 2.0 given that we don't guarantee backwards compatibility, and it is already not compatible in many ways. Looking forward to this. Best, Zakelly On Thu, Feb 27, 2025 at 9:20 AM Xintong Song wrote: > Thank you both for the efforts. The progress so

[jira] [Created] (FLINK-37379) Lack of state cache load for ForSt after recovery

2025-02-24 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37379: --- Summary: Lack of state cache load for ForSt after recovery Key: FLINK-37379 URL: https://issues.apache.org/jira/browse/FLINK-37379 Project: Flink Issue Type

[jira] [Created] (FLINK-37367) Properly inherit uploaded SST files after ForSt restore

2025-02-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37367: --- Summary: Properly inherit uploaded SST files after ForSt restore Key: FLINK-37367 URL: https://issues.apache.org/jira/browse/FLINK-37367 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink Committer - Xuyang

2025-02-19 Thread Zakelly Lan
Congratulations, Xuyang! Best, Zakelly On Thu, Feb 20, 2025 at 10:21 AM Jacky Lau wrote: > Congratulations, you deserve it. > > Best, > Jacky > > yh z 于2025年2月20日周四 10:01写道: > > > Congratulations > > > > Best, > > Ron > > > > Ron Liu 于2025年2月20日周四 09:56写道: > > > > > Congratulations, you dese

Re: [DISCUSS] FLIP-432: Faster Checkpoint & Recovery for Disaggregated State

2025-02-16 Thread Zakelly Lan
Hi Han, Thanks for driving this! The FLIP is in good shape, here are my comments: 1. The FLIP introduces the file reusing during snapshot and recovery. Could you please provide some common use cases from the user's perspective? e.g. Periodic checkpoint, native savepoint. 2. Does the current desi

[jira] [Created] (FLINK-37301) Fix wrong flag returned by ForStStateBackend#supportsSavepointFormat

2025-02-11 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37301: --- Summary: Fix wrong flag returned by ForStStateBackend#supportsSavepointFormat Key: FLINK-37301 URL: https://issues.apache.org/jira/browse/FLINK-37301 Project: Flink

[jira] [Created] (FLINK-37276) Missing interfaces in `RuntimeContext`

2025-02-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37276: --- Summary: Missing interfaces in `RuntimeContext` Key: FLINK-37276 URL: https://issues.apache.org/jira/browse/FLINK-37276 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37222) Table planner exception when sql client submit job

2025-01-24 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37222: --- Summary: Table planner exception when sql client submit job Key: FLINK-37222 URL: https://issues.apache.org/jira/browse/FLINK-37222 Project: Flink Issue Type

[jira] [Created] (FLINK-37208) Properly notify a new key is selected for async state operators

2025-01-22 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37208: --- Summary: Properly notify a new key is selected for async state operators Key: FLINK-37208 URL: https://issues.apache.org/jira/browse/FLINK-37208 Project: Flink

[jira] [Created] (FLINK-37206) Initialization issue of batching timer service in async state operators

2025-01-22 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37206: --- Summary: Initialization issue of batching timer service in async state operators Key: FLINK-37206 URL: https://issues.apache.org/jira/browse/FLINK-37206 Project: Flink

[jira] [Created] (FLINK-37164) Speed up state v2 synchronous methods execution

2025-01-17 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37164: --- Summary: Speed up state v2 synchronous methods execution Key: FLINK-37164 URL: https://issues.apache.org/jira/browse/FLINK-37164 Project: Flink Issue Type

[jira] [Created] (FLINK-37157) Enable daily benchmark for Java 21

2025-01-16 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37157: --- Summary: Enable daily benchmark for Java 21 Key: FLINK-37157 URL: https://issues.apache.org/jira/browse/FLINK-37157 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37130) Provide a util converting future of StateIterator to Iterable

2025-01-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37130: --- Summary: Provide a util converting future of StateIterator to Iterable Key: FLINK-37130 URL: https://issues.apache.org/jira/browse/FLINK-37130 Project: Flink

[jira] [Created] (FLINK-37115) [Benchmark] Compile error related with SerializerConfig

2025-01-13 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37115: --- Summary: [Benchmark] Compile error related with SerializerConfig Key: FLINK-37115 URL: https://issues.apache.org/jira/browse/FLINK-37115 Project: Flink Issue

Re: [VOTE] FLIP-501: Support Window Extension in DataStream V2 API

2025-01-13 Thread Zakelly Lan
+1 (binding) Windows are necessary for datastream API. Thanks for driving this. Best, Zakelly On Tue, Jan 14, 2025 at 10:56 AM Junrui Lee wrote: > +1(binding) > > Best, > Junrui > > weijie guo 于2025年1月14日周二 10:32写道: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Xu Huang

[jira] [Created] (FLINK-37107) Allow buffer overdraft in async state processing

2025-01-13 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37107: --- Summary: Allow buffer overdraft in async state processing Key: FLINK-37107 URL: https://issues.apache.org/jira/browse/FLINK-37107 Project: Flink Issue Type

[jira] [Created] (FLINK-37089) Advanced scheduling for derived async state processing

2025-01-09 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37089: --- Summary: Advanced scheduling for derived async state processing Key: FLINK-37089 URL: https://issues.apache.org/jira/browse/FLINK-37089 Project: Flink Issue

Re: [VOTE] FLIP-496: SQL connector for keyed state data

2025-01-09 Thread Zakelly Lan
+1 (binding) Thanks for driving this. Best, Zakelly On Thu, Jan 9, 2025 at 8:57 PM Gabor Somogyi wrote: > Hi All, > > I'd like to start a vote of FLIP-496: SQL connector for keyed state data > [1]. > The discussion thread can be found here [2]. > > The vote will be open for at least 72 hours u

[jira] [Created] (FLINK-37045) Expose state v2 creation APIs to datastream user

2025-01-08 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37045: --- Summary: Expose state v2 creation APIs to datastream user Key: FLINK-37045 URL: https://issues.apache.org/jira/browse/FLINK-37045 Project: Flink Issue Type

[jira] [Created] (FLINK-37030) Support lazy initialization for state serializer in State V2

2025-01-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37030: --- Summary: Support lazy initialization for state serializer in State V2 Key: FLINK-37030 URL: https://issues.apache.org/jira/browse/FLINK-37030 Project: Flink

[jira] [Created] (FLINK-37028) Datastream Window operator with async state processing

2025-01-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37028: --- Summary: Datastream Window operator with async state processing Key: FLINK-37028 URL: https://issues.apache.org/jira/browse/FLINK-37028 Project: Flink Issue

Re: Full Checkpoint information in UI and API

2025-01-07 Thread Zakelly Lan
Hi, I would +1 for this. As for the name: incremental: true vs. false sounds good to me, which is aligned with the config name 'execution.checkpointing.incremental'. Best, Zakelly On Tue, Dec 17, 2024 at 12:01 PM Ryan van Huuksloot wrote: > Hello, > > Would the community be open to adding ad

[jira] [Created] (FLINK-37010) Unify KeyedProcessFunction and the async one

2025-01-05 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37010: --- Summary: Unify KeyedProcessFunction and the async one Key: FLINK-37010 URL: https://issues.apache.org/jira/browse/FLINK-37010 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-37003) Implement async state version of Datastream Interval join

2025-01-03 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37003: --- Summary: Implement async state version of Datastream Interval join Key: FLINK-37003 URL: https://issues.apache.org/jira/browse/FLINK-37003 Project: Flink

[jira] [Created] (FLINK-36963) Wrong context maintain around `asyncProcessWithKey`

2024-12-25 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36963: --- Summary: Wrong context maintain around `asyncProcessWithKey` Key: FLINK-36963 URL: https://issues.apache.org/jira/browse/FLINK-36963 Project: Flink Issue Type

[jira] [Created] (FLINK-36949) Make getCurrentKey of async state operators return the ground truth

2024-12-22 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36949: --- Summary: Make getCurrentKey of async state operators return the ground truth Key: FLINK-36949 URL: https://issues.apache.org/jira/browse/FLINK-36949 Project: Flink

[jira] [Created] (FLINK-36944) Introduce 'enableAsycState' in DataStream v1 interfaces

2024-12-20 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36944: --- Summary: Introduce 'enableAsycState' in DataStream v1 interfaces Key: FLINK-36944 URL: https://issues.apache.org/jira/browse/FLINK-36944 Project: Flink

[jira] [Created] (FLINK-36943) FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs

2024-12-20 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36943: --- Summary: FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs Key: FLINK-36943 URL: https://issues.apache.org/jira/browse/FLINK-36943

[RESULT][VOTE] FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs

2024-12-20 Thread Zakelly Lan
Hi all, I'm glad to announce that the FLIP-488[1] has been accepted. The voting thread is here[2]. The proposal received 6 approving votes, 5 of which are binding: - Yanfei Lei (binding) - Yunfeng Zhou - Gabor Somogyi (binding) - Hangxiang Yu (binding) - Yuan Mei (binding) - Zakell

Re: [VOTE] FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs

2024-12-20 Thread Zakelly Lan
gt; > > > > > > wrote: > > > > > > > +1(non-binding) > > > > > > > > Best, > > > > Yunfeng > > > > > > > > > 2024年12月17日 12:17,Zakelly Lan 写道: > > > > > > > > > > Hi all, >

Re: [DISCUSS] FLIP-496: SQL connector for keyed state data

2024-12-19 Thread Zakelly Lan
ator? > I'm fine with this. > > BR, > G > > > On Thu, Dec 19, 2024 at 10:31 AM Zakelly Lan > wrote: > > > Hi Gabor, > > > > The proposed configs look good to me. I also suggest that 'operator' can > > serve as an equival

[jira] [Created] (FLINK-36938) Provide hooks before and after the watermark processing

2024-12-19 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36938: --- Summary: Provide hooks before and after the watermark processing Key: FLINK-36938 URL: https://issues.apache.org/jira/browse/FLINK-36938 Project: Flink Issue

Re: [DISCUSS] FLIP-496: SQL connector for keyed state data

2024-12-19 Thread Zakelly Lan
the proper keyed/non-keyed option + the config pair > will > exactly tell that savepoint metadata is going to be read. > > BR, > G > > > On Thu, Dec 19, 2024 at 4:11 AM Zakelly Lan wrote: > > > Hi Gabor, > > > > Thanks for your answers! > > > &

Re: [DISCUSS] FLIP-496: SQL connector for keyed state data

2024-12-18 Thread Zakelly Lan
ly, > > Thanks for your comments, please find my answers inline. > > BR, > G > > > On Wed, Dec 18, 2024 at 2:42 PM Zakelly Lan wrote: > > > Hi Gabor, > > > > Thanks for the FLIP! It's very convenient for users to use SQL to read > > checkpoint data,

Re: [DISCUSS] FLIP-496: SQL connector for keyed state data

2024-12-18 Thread Zakelly Lan
Hi Gabor, Thanks for the FLIP! It's very convenient for users to use SQL to read checkpoint data, so overall I'd +1 for this FLIP. Here are my thoughts/questions: 1. I see this connector is designed to read the checkpoint/savepoint data, so I'd suggest naming this connector as 'checkpoint'

[jira] [Created] (FLINK-36928) Split the action of Epoch into two parts (trigger & final)

2024-12-17 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36928: --- Summary: Split the action of Epoch into two parts (trigger & final) Key: FLINK-36928 URL: https://issues.apache.org/jira/browse/FLINK-36928 Project: F

[VOTE] FLIP-488: Expose Async State Processing and New State APIs in Datastream(V1) APIs

2024-12-16 Thread Zakelly Lan
Hi all, I'd like to start a vote on FLIP-488 [1], which has been discussed here [2]. The vote will remain open for at least 72 hours. Best, Zakelly [1] https://cwiki.apache.org/confluence/x/yIrREw [2] https://lists.apache.org/thread/66py06hgwwfbtsz8o9jtm1t33w2byxf9

  1   2   3   4   5   >