[jira] [Created] (FLINK-30137) LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory failed due to NoSuchFileException

2022-11-21 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30137: - Summary: LocalRecoveryITCase.testRecoverLocallyFromProcessCrashWithWorkingDirectory failed due to NoSuchFileException Key: FLINK-30137 URL: https://issues.apache.org/jira/brows

[jira] [Created] (FLINK-30136) ElasticsearchSinkITCase.testElasticsearchSink failed on azure due to ES service unavailable

2022-11-21 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-30136: -- Summary: ElasticsearchSinkITCase.testElasticsearchSink failed on azure due to ES service unavailable Key: FLINK-30136 URL: https://issues.apache.org/jira/browse/FLINK-30136

[jira] [Created] (FLINK-30135) RMQSourceITCase failed on azure with exit code 143

2022-11-21 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-30135: -- Summary: RMQSourceITCase failed on azure with exit code 143 Key: FLINK-30135 URL: https://issues.apache.org/jira/browse/FLINK-30135 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-30134) Annotate all the public classes for the delegation token framework

2022-11-21 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-30134: - Summary: Annotate all the public classes for the delegation token framework Key: FLINK-30134 URL: https://issues.apache.org/jira/browse/FLINK-30134 Project: Flink

[jira] [Created] (FLINK-30133) HadoopModuleFactory creates error if the security module cannot be loaded

2022-11-21 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-30133: - Summary: HadoopModuleFactory creates error if the security module cannot be loaded Key: FLINK-30133 URL: https://issues.apache.org/jira/browse/FLINK-30133 Project:

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Sergey Nuyanzin
Congratulations, Matyas! On Tue, Nov 22, 2022 at 8:31 AM Steven Wu wrote: > Congrats, Matyas! > > On Mon, Nov 21, 2022 at 11:19 PM godfrey he wrote: > > > Congratulations, Matyas! > > > > Matthias Pohl 于2022年11月22日周二 13:40写道: > > > > > > Congratulations, Matyas :) > > > > > > On Tue, Nov 22, 2

[jira] [Created] (FLINK-30132) Test LocalRecoveryITCase#testRecoverLocallyFromProcessCrashWithWorkingDirectory failed on azure due to File not exists

2022-11-21 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-30132: -- Summary: Test LocalRecoveryITCase#testRecoverLocallyFromProcessCrashWithWorkingDirectory failed on azure due to File not exists Key: FLINK-30132 URL: https://issues.apache.org/jira/b

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Steven Wu
Congrats, Matyas! On Mon, Nov 21, 2022 at 11:19 PM godfrey he wrote: > Congratulations, Matyas! > > Matthias Pohl 于2022年11月22日周二 13:40写道: > > > > Congratulations, Matyas :) > > > > On Tue, Nov 22, 2022 at 11:44 AM Xingbo Huang > wrote: > > > > > Congrats Matyas! > > > > > > Best, > > > Xingbo

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread godfrey he
Congratulations, Matyas! Matthias Pohl 于2022年11月22日周二 13:40写道: > > Congratulations, Matyas :) > > On Tue, Nov 22, 2022 at 11:44 AM Xingbo Huang wrote: > > > Congrats Matyas! > > > > Best, > > Xingbo > > > > Yanfei Lei 于2022年11月22日周二 11:18写道: > > > > > Congrats Matyas! 🍻 > > > > > > Zheng Yu Che

[jira] [Created] (FLINK-30131) flink iterate will suspend when record is a bit large

2022-11-21 Thread Lu (Jira)
Lu created FLINK-30131: -- Summary: flink iterate will suspend when record is a bit large Key: FLINK-30131 URL: https://issues.apache.org/jira/browse/FLINK-30131 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-30130) Table.select lose watermark

2022-11-21 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-30130: Summary: Table.select lose watermark Key: FLINK-30130 URL: https://issues.apache.org/jira/browse/FLINK-30130 Project: Flink Issue Type: Bug Compone

[jira] [Created] (FLINK-30129) Push projection through ChangelogNormalize

2022-11-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-30129: --- Summary: Push projection through ChangelogNormalize Key: FLINK-30129 URL: https://issues.apache.org/jira/browse/FLINK-30129 Project: Flink Issue Type: New Feature

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Matthias Pohl
Thanks Fabian for driving this release. +1 (non-binding) * Downloaded artifacts * Verified checksums/GPG signatures * Compared checkout with provided sources * Verified pom file versions * Went over NOTICE file/pom file changes without finding anything suspicious * Build Flink from sources * Depl

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Matthias Pohl
Congratulations, Matyas :) On Tue, Nov 22, 2022 at 11:44 AM Xingbo Huang wrote: > Congrats Matyas! > > Best, > Xingbo > > Yanfei Lei 于2022年11月22日周二 11:18写道: > > > Congrats Matyas! 🍻 > > > > Zheng Yu Chen 于2022年11月22日周二 11:15写道: > > > > > Congratulations ~ 🍻 > > > > > > Márton Balassi 于2022年11

[jira] [Created] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-11-21 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-30128: -- Summary: Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path Key: FLINK-30128 URL: https://issues.apache.org/jira/browse/FLINK-30128

[jira] [Created] (FLINK-30127) Correct the packaging of HadoopRecoverableWriter and related issues

2022-11-21 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-30127: -- Summary: Correct the packaging of HadoopRecoverableWriter and related issues Key: FLINK-30127 URL: https://issues.apache.org/jira/browse/FLINK-30127

Re: FRocksDB Some Question

2022-11-21 Thread Yanfei Lei
Hi ConradJam, Thanks for bringing this up. In fact, @Sebastian has tried to update RocksDB to 6.29.5[1], but there are some regressions on MapState[2]. If you want to use the newest feature of RocksDB, I think you can refer to this release document[3] to release your own version. > I would like t

[jira] [Created] (FLINK-30126) Delay registration of the catalog, register the catalog as needed

2022-11-21 Thread melin (Jira)
melin created FLINK-30126: - Summary: Delay registration of the catalog, register the catalog as needed Key: FLINK-30126 URL: https://issues.apache.org/jira/browse/FLINK-30126 Project: Flink Issue Ty

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Xingbo Huang
Congrats Matyas! Best, Xingbo Yanfei Lei 于2022年11月22日周二 11:18写道: > Congrats Matyas! 🍻 > > Zheng Yu Chen 于2022年11月22日周二 11:15写道: > > > Congratulations ~ 🍻 > > > > Márton Balassi 于2022年11月21日周一 22:18写道: > > > > > Hi everyone, > > > > > > On behalf of the PMC, I'm very happy to announce Matyas O

FRocksDB Some Question

2022-11-21 Thread Zheng Yu Chen
Hi community, I want to ask a question about frocksdb I noticed that frocksdb seems to have been inactive for a long time. flink-statebackend-rocksdb is depend https://github.com/ververica/frocksdb to run state backend This Rocksdb is stuck at 6.20.3.But the current upstream version https://github

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Yanfei Lei
Congrats Matyas! 🍻 Zheng Yu Chen 于2022年11月22日周二 11:15写道: > Congratulations ~ 🍻 > > Márton Balassi 于2022年11月21日周一 22:18写道: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > > Flink > > committer. > > > > Matyas has over a decade of experience of

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Zheng Yu Chen
Congratulations ~ 🍻 Márton Balassi 于2022年11月21日周一 22:18写道: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the Big Data ecosystem and has > been working with Flink full time for the past

[jira] [Created] (FLINK-30125) Projection pushdown is not work for partial update

2022-11-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30125: Summary: Projection pushdown is not work for partial update Key: FLINK-30125 URL: https://issues.apache.org/jira/browse/FLINK-30125 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Hang Ruan
Congrats Matyas! Geng Biao 于2022年11月22日周二 10:06写道: > Congratulations Matyas! > > Best, > Biao Geng > > From: Leonard Xu > Date: Tuesday, November 22, 2022 at 10:03 AM > To: dev > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi > Congratulations Matyas, well deserved! > > Bes

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Geng Biao
Congratulations Matyas! Best, Biao Geng From: Leonard Xu Date: Tuesday, November 22, 2022 at 10:03 AM To: dev Subject: Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi Congratulations Matyas, well deserved! Best, Leonard > On Nov 22, 2022, at 9:38 AM, Dian Fu wrote: > > Congrats Mat

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Leonard Xu
Congratulations Matyas, well deserved! Best, Leonard > On Nov 22, 2022, at 9:38 AM, Dian Fu wrote: > > Congrats Matyas! > > On Tue, Nov 22, 2022 at 9:00 AM Tony Wei wrote: > >> Congrats Matyas! >> >> Thomas Weise 於 2022年11月22日 週二 上午8:56寫道: >> >>> Congrats Matyas! >>> >>> >>> On Mon, Nov

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Dian Fu
Congrats Matyas! On Tue, Nov 22, 2022 at 9:00 AM Tony Wei wrote: > Congrats Matyas! > > Thomas Weise 於 2022年11月22日 週二 上午8:56寫道: > > > Congrats Matyas! > > > > > > On Mon, Nov 21, 2022 at 6:28 PM Őrhidi Mátyás > > wrote: > > > > > Thanks folks, > > > > > > So proud and honored to be part of the

[jira] [Created] (FLINK-30124) GenericType is not supported in PyFlink currently

2022-11-21 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-30124: Summary: GenericType is not supported in PyFlink currently Key: FLINK-30124 URL: https://issues.apache.org/jira/browse/FLINK-30124 Project: Flink Issue Type

[jira] [Created] (FLINK-30123) Optimize ApplicationDeployer API design

2022-11-21 Thread melin (Jira)
melin created FLINK-30123: - Summary: Optimize ApplicationDeployer API design Key: FLINK-30123 URL: https://issues.apache.org/jira/browse/FLINK-30123 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-30122) Flink ML KMeans getting model data throws TypeError

2022-11-21 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-30122: Summary: Flink ML KMeans getting model data throws TypeError Key: FLINK-30122 URL: https://issues.apache.org/jira/browse/FLINK-30122 Project: Flink Issue Typ

[jira] [Created] (FLINK-30121) Support Stored procedures

2022-11-21 Thread melin (Jira)
melin created FLINK-30121: - Summary: Support Stored procedures Key: FLINK-30121 URL: https://issues.apache.org/jira/browse/FLINK-30121 Project: Flink Issue Type: New Feature Components: Tab

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Tony Wei
Congrats Matyas! Thomas Weise 於 2022年11月22日 週二 上午8:56寫道: > Congrats Matyas! > > > On Mon, Nov 21, 2022 at 6:28 PM Őrhidi Mátyás > wrote: > > > Thanks folks, > > > > So proud and honored to be part of the pack! > > > > Cheers, > > Matyas > > > > On Mon, Nov 21, 2022 at 12:32 PM Danny Cranmer >

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Thomas Weise
Congrats Matyas! On Mon, Nov 21, 2022 at 6:28 PM Őrhidi Mátyás wrote: > Thanks folks, > > So proud and honored to be part of the pack! > > Cheers, > Matyas > > On Mon, Nov 21, 2022 at 12:32 PM Danny Cranmer > wrote: > > > Congrats Matyas! > > > > On Mon, 21 Nov 2022, 17:51 ramkrishna vasudevan

Re: Stack Overflow Question re compressing broadcast state

2022-11-21 Thread Ken Krugler
Hi Dawid, Thanks for following up on this. Let me know if you’d like me to update the documentation, that seems pretty straightforward :) Adding support for compressing broadcast state feels like something more challenging, but I could take a swing at it if you’d like. Regards, — Ken PS - r

[jira] [Created] (FLINK-30120) Flink Statefun Task Failure causes restart of all tasks

2022-11-21 Thread Stephan Weinwurm (Jira)
Stephan Weinwurm created FLINK-30120: Summary: Flink Statefun Task Failure causes restart of all tasks Key: FLINK-30120 URL: https://issues.apache.org/jira/browse/FLINK-30120 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Őrhidi Mátyás
Thanks folks, So proud and honored to be part of the pack! Cheers, Matyas On Mon, Nov 21, 2022 at 12:32 PM Danny Cranmer wrote: > Congrats Matyas! > > On Mon, 21 Nov 2022, 17:51 ramkrishna vasudevan, > wrote: > > > Congrats Matayas > > > > On Mon, Nov 21, 2022 at 10:06 PM Jim Busche wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Danny Cranmer
Congrats Matyas! On Mon, 21 Nov 2022, 17:51 ramkrishna vasudevan, wrote: > Congrats Matayas > > On Mon, Nov 21, 2022 at 10:06 PM Jim Busche wrote: > > > Congratulations Matyas! > > > > Jim > > -- > > James Busche | Sr. Software Engineer, Watson AI and Data Open Technology > | > > 408-460-0737 |

Re: [VOTE] FLIP-272: Generalized delegation token support

2022-11-21 Thread Danny Cranmer
+1 (binding). Danny, On Mon, Nov 21, 2022 at 4:23 PM Ferenc Csaky wrote: > +1 (non-binding) > > Best, > F > > > --- Original Message --- > On Friday, November 18th, 2022 at 16:11, Márton Balassi < > balassi.mar...@gmail.com> wrote: > > > > > > > > +1 (binding) > > > > On Thu, Nov 17, 20

Re: [DISCUSS] FLIP-272: Generalized delegation token support

2022-11-21 Thread Danny Cranmer
Hey, > All the rest which is public can be considered accidental leak (for example "DelegationTokenManager" where Java doesn't support internal interfaces). If the classes are internal, then they should be annotated @Internal. This is a Flink thing [1]. My explicit recommendation is to ensure all

Re: SQL Gateway and SQL Client

2022-11-21 Thread Jim Hughes
Hi Yu, Shengkai, As a quick update, I've had a chance to try out Yu's POC and it is working for me. (Admittedly, I haven't tried it too extensively; I only tried basic operations.) >From my experiments, I did leave a few comments on https://github.com/apache/flink/pull/20958. Overall, the PRs I

[DISCUSS] OLM Bundles for Flink Kubernetes Operator

2022-11-21 Thread Hao t Chang
Hi Gyula, We will let you decide the bundle should be an artifact or not. In my opinion, the easiest way people may test the bundle is that the catalog and bundle images are already in a registry. This way, people only need to apply the catsrc, og, and sub(https://github.com/tedhtchang/olm/bl

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread ramkrishna vasudevan
Congrats Matayas On Mon, Nov 21, 2022 at 10:06 PM Jim Busche wrote: > Congratulations Matyas! > > Jim > -- > James Busche | Sr. Software Engineer, Watson AI and Data Open Technology | > 408-460-0737 | jbus...@us.ibm.com > > > > > From: Márton Balassi > Date: Monday, N

Re: [DISCUSS] FLIP-272: Generalized delegation token support

2022-11-21 Thread Gabor Somogyi
Hi Danny, Thanks for spending your time to make the design better. My comments added inline. Please share your opinion or just correct me if I've misunderstood your suggestions. G On Mon, Nov 21, 2022 at 5:10 PM Danny Cranmer wrote: > Thanks for the FLIP Gabor. > > Generally looks good, have

[jira] [Created] (FLINK-30119) (Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending

2022-11-21 Thread Clara Xiong (Jira)
Clara Xiong created FLINK-30119: --- Summary: (Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending Key: FLINK-30119 URL: https://issues.apac

[jira] [Created] (FLINK-30118) Move DDB connector Integration Tests/ITCase to E2E test

2022-11-21 Thread Daren Wong (Jira)
Daren Wong created FLINK-30118: -- Summary: Move DDB connector Integration Tests/ITCase to E2E test Key: FLINK-30118 URL: https://issues.apache.org/jira/browse/FLINK-30118 Project: Flink Issue Typ

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Jim Busche
Congratulations Matyas! Jim -- James Busche | Sr. Software Engineer, Watson AI and Data Open Technology | 408-460-0737 | jbus...@us.ibm.com From: Márton Balassi Date: Monday, November 21, 2022 at 6:18 AM To: Flink Dev , morh...@apache.org Subject: [EXTERNAL] [ANNO

Re: [VOTE] FLIP-272: Generalized delegation token support

2022-11-21 Thread Ferenc Csaky
+1 (non-binding) Best, F --- Original Message --- On Friday, November 18th, 2022 at 16:11, Márton Balassi wrote: > > > +1 (binding) > > On Thu, Nov 17, 2022 at 9:06 AM Gabor Somogyi gabor.g.somo...@gmail.com > > wrote: > > > Hi All, > > > > I'm hereby opening a vote for FLIP-27

Re: [DISCUSS] FLIP-272: Generalized delegation token support

2022-11-21 Thread Danny Cranmer
Thanks for the FLIP Gabor. Generally looks good, have a couple of comments. If I understand correctly we plan on pulling the current implementation apart and adding an extra layer of abstraction, to allow arbitrary implementations. I notice that most of the delegation token classes [1] are missin

[jira] [Created] (FLINK-30117) Evaluate error whitelist entries added in FLINK-29475

2022-11-21 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-30117: - Summary: Evaluate error whitelist entries added in FLINK-29475 Key: FLINK-30117 URL: https://issues.apache.org/jira/browse/FLINK-30117 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Sriram Ganesh
Congrats Matayas! On Mon, Nov 21, 2022, 20:15 Jing Ge wrote: > Congrats Matyas! > > Best Regards, > Jing > > On Mon, Nov 21, 2022 at 3:43 PM Ferenc Csaky > wrote: > > > Congrats Matyas! > > > > Best, > > F > > > > > > > > --- Original Message --- > > On Monday, November 21st, 2022 at 15

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Jing Ge
Congrats Matyas! Best Regards, Jing On Mon, Nov 21, 2022 at 3:43 PM Ferenc Csaky wrote: > Congrats Matyas! > > Best, > F > > > > --- Original Message --- > On Monday, November 21st, 2022 at 15:17, Márton Balassi < > mbala...@apache.org> wrote: > > > > > > > > Hi everyone, > > > > On beh

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Ferenc Csaky
Congrats Matyas! Best, F --- Original Message --- On Monday, November 21st, 2022 at 15:17, Márton Balassi wrote: > > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Gyula Fóra
Welcome Matyas! Gyula On Mon, Nov 21, 2022 at 3:26 PM Gabor Somogyi wrote: > Congrats! :) > > G > > > On Mon, Nov 21, 2022 at 3:18 PM Márton Balassi > wrote: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > > Flink > > committer. > > > > Maty

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Gabor Somogyi
Congrats! :) G On Mon, Nov 21, 2022 at 3:18 PM Márton Balassi wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the Big Data ecosystem and has > been working with Flink full time

[ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

2022-11-21 Thread Márton Balassi
Hi everyone, On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new Flink committer. Matyas has over a decade of experience of the Big Data ecosystem and has been working with Flink full time for the past 3 years. In the open source community he is one of the key driving members

[jira] [Created] (FLINK-30116) Don't Show Env Vars in Web UI

2022-11-21 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-30116: Summary: Don't Show Env Vars in Web UI Key: FLINK-30116 URL: https://issues.apache.org/jira/browse/FLINK-30116 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Sergey Nuyanzin
Hey Fabian, thanks for clarification, sorry I missed it +1 (non-binding) - Verified checksums and signatures - Built source with Maven - Verified version in pom - Verified licenses - Started cluster, checked some jobs and queries On Mon, Nov 21, 2022 at 1:58 PM Danny Cranmer wrote: > Hey Fabia

Re: Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-21 Thread Yun Gao
Hi all, Very thanks for the warm discussion! First of all I listed all the scenarios of processing timers in the current code in the FLIP (see the second section, and very thanks @Dian Fu for helping verifying the CEP cases). Based on the listed scenarios and the discussion thread, some points

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Danny Cranmer
Hey Fabian, +1 (binding) - Verified signatures - Contents of nexus look good - No binaries in the source archive - Contents of source archive looks correct - Git tag/pom versions look correct - Compared contents of binary dist against 1.15.2 and looks good - Built src successfully - NOTICE diff t

Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-21 Thread Dawid Wysakowicz
I see the problem differently. I really don't think this should be looked at from the perspective of timers, but rather from the semantics of endOfInput. If a proc time timer is set for 10s, the 10s are "real-time" and the delay is important. One particularly important example is "wait

[jira] [Created] (FLINK-30115) Include log4j-layout-template-json jar in the default operator image

2022-11-21 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-30115: - Summary: Include log4j-layout-template-json jar in the default operator image Key: FLINK-30115 URL: https://issues.apache.org/jira/browse/FLINK-30115

Re: [DISCUSS] Updating Flink HBase Connectors

2022-11-21 Thread Ferenc Csaky
Hi! Sure, thank you both for the input. If the repo is ready, I'll start the work. Best, F --- Original Message --- On Thursday, November 17th, 2022 at 09:39, Gabor Somogyi wrote: > > > Hi All, > > +1 to go. Since we are refurbishing the HBase area maybe we can move the > token p

[jira] [Created] (FLINK-30114) Introduce PyFlink example for table store

2022-11-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30114: Summary: Introduce PyFlink example for table store Key: FLINK-30114 URL: https://issues.apache.org/jira/browse/FLINK-30114 Project: Flink Issue Type: New Fea

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Fabian Paul
Hi Sergey, Sorry for the confusion, but the links in the initial mail are, unfortunately, broken. I already sent out a new mail in this thread with the new links. I've shared below the correct links again. In general, we are still looking for PMC members who verify the release. Please try to find

Re: [Vote] Remove FlinkKafkaConsumer and graduate related Source APIs

2022-11-21 Thread Jing Ge
Hi Dong, Thanks again for the clarification. Since a important feature is missing with the KafkaSource, this vote is cancelled and will be started again once the feature has been implemented with the KafkaSource. Best regards, Jing On Thu, Nov 17, 2022 at 4:37 PM Dong Lin wrote: > Hi Jing, > >

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-21 Thread Jing Ge
Hi Dong, Thanks for the heads-up. It was really nice to be aware of this issue before removing FlinkKafkaConsumer. I will check FLIP-208 and work on it. Thanks! Best regards, Jing On Thu, Nov 17, 2022 at 4:34 PM Dong Lin wrote: > Hi Jing, > > Thanks for opening the discussion. I am not sure w

Re: [VOTE] Release 1.15.3, release candidate #1

2022-11-21 Thread Sergey Nuyanzin
Maybe I'm doing something wrong... however when I'm trying to go to links mentioned in the first email I receive 404 for these links https://dist.apache.org/repos/dist/dev/flink/flink-1.15.3-r c1

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-21 Thread Maximilian Michels
>Do we think the scaler could be a plugin or hard coded ? +1 For pluggable scaling logic. On Mon, Nov 21, 2022 at 3:38 AM Chen Qin wrote: > On Sun, Nov 20, 2022 at 7:25 AM Gyula Fóra wrote: > > > Hi Chen! > > > > I think in the long term it makes sense to provide some pluggable > > mechanisms

Re: [DISCUSS] FLIP-273: Improve Catalog API to Support ALTER TABLE syntax

2022-11-21 Thread Jingsong Li
Thanks Shengkai for the proposal! This should be very useful! > In some cases, users might need to modify the nested column. Our proposal is > able to express the idea by introducing a new class named. My concern is that the connector needs to be implemented multiple times. Can we define classe

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-21 Thread Paul Lam
Dong’s proposal LGTM. Best, Paul Lam > 2022年11月19日 10:50,Dong Lin 写道: > > Hey Weihua, > > Thanks for proposing the new strategy! > > If I understand correctly, the main issue is that different failover > regions can be restarted independently, but they share the same counter > when counting t

Re: Stack Overflow Question re compressing broadcast state

2022-11-21 Thread Dawid Wysakowicz
And yes, I read "Compression works on the granularity of key-groups in keyed state” as meaning “When compressing keyed state, it’s done per key-group” and not “Compression only works on keyed state” :) Totally agree. Docs could definitely be more straightforward about that. I created FLINK-

[jira] [Created] (FLINK-30113) Compression for operator state

2022-11-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-30113: Summary: Compression for operator state Key: FLINK-30113 URL: https://issues.apache.org/jira/browse/FLINK-30113 Project: Flink Issue Type: Improvemen

[jira] [Created] (FLINK-30112) Improve docs re state compression

2022-11-21 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-30112: Summary: Improve docs re state compression Key: FLINK-30112 URL: https://issues.apache.org/jira/browse/FLINK-30112 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-30111) CacheRead fails with Intermediate data set with ID not found

2022-11-21 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-30111: - Summary: CacheRead fails with Intermediate data set with ID not found Key: FLINK-30111 URL: https://issues.apache.org/jira/browse/FLINK-30111 Project: Flink