[jira] [Created] (FLINK-35079) MongoConnector failed to resume token when current collection removed

2024-04-11 Thread Xiqian YU (Jira)
Xiqian YU created FLINK-35079: - Summary: MongoConnector failed to resume token when current collection removed Key: FLINK-35079 URL: https://issues.apache.org/jira/browse/FLINK-35079 Project: Flink

[jira] [Created] (FLINK-35080) Allow to specify additional pushdown filter in table properties

2024-04-11 Thread Jira
Grzegorz Kołakowski created FLINK-35080: --- Summary: Allow to specify additional pushdown filter in table properties Key: FLINK-35080 URL: https://issues.apache.org/jira/browse/FLINK-35080 Project

Re: [DISCUSS] FLIP-438: Amazon SQS Sink Connector

2024-04-11 Thread Ahmed Hamdy
Thanks Priya the FLIP now looks much better, I would move out some of the implementation details . Just highlight how the writer actually uses the client (the subitRequestEntries part) and how the Sink itself exposes its API to users (the Sink & builder part), other parts should not be part of the

[jira] [Created] (FLINK-35081) CompileException when watermark definition contains coalesce and to_timestamp built-in functions

2024-04-11 Thread Jira
Grzegorz Kołakowski created FLINK-35081: --- Summary: CompileException when watermark definition contains coalesce and to_timestamp built-in functions Key: FLINK-35081 URL: https://issues.apache.org/jira/browse

Re: Two potential bugs in Flink ML

2024-04-11 Thread Komal M
Hi Yunfeng, Thank you for the prompt action on resolving this bug. I have compiled the latest Flink ML source code and can confirm the problem has indeed been solved. Regarding the second bug relating to the IterationListener interface, it seems that the methods in the IterationListener interf

[jira] [Created] (FLINK-35088) watermark alignment maxAllowedWatermarkDrift and updateInterval param need check

2024-04-11 Thread elon_X (Jira)
elon_X created FLINK-35088: -- Summary: watermark alignment maxAllowedWatermarkDrift and updateInterval param need check Key: FLINK-35088 URL: https://issues.apache.org/jira/browse/FLINK-35088 Project: Flink

Testing with custom generated data

2024-04-11 Thread lorenzo . affetti
Hello DEV! I am currently working on issue [1]. The contribution consists in migrating the batch SQL test from a bash implementation to a Java one. After a couple of rounds of review we agreed to proceed by removing the existing deprecations due to how the source table is generated. The main su

Re: Question around Flink's AdaptiveBatchScheduler

2024-04-11 Thread Venkatakrishnan Sowrirajan
Gentle bump on this question. cc @Becket Qin as well. Regards Venkata krishnan On Tue, Mar 12, 2024 at 10:11 PM Venkatakrishnan Sowrirajan < vsowr...@asu.edu> wrote: > Thanks for the response Lijie and Junrui. Sorry for the late reply. Few > follow up questions. > > > Source can actually ignor

Re: [DISCUSS] FLIP-438: Amazon SQS Sink Connector

2024-04-11 Thread Dhingra, Priya
Hi Ahmed, Thanks for reviewing it. I have updated the FLIP again. On your question of concerns on adding Table API support right now, the only reason I don't want to commit for it is that I am really not sure about the effort it involves and how to do/test it since I never worked with Table API

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-11 Thread Martijn Visser
+1 (binding) On Wed, Apr 10, 2024 at 4:34 AM Jing Ge wrote: > +1(binding) > > Best regards, > Jing > > On Tue, Apr 9, 2024 at 8:54 PM Feng Jin wrote: > > > +1 (non-binding) > > > > Best, > > Feng > > > > On Tue, Apr 9, 2024 at 5:56 PM gongzhongqiang > > > wrote: > > > > > +1 (non-binding) > >

[jira] [Created] (FLINK-35089) Two input AbstractStreamOperator may throw NPE when receiving RecordAttributes

2024-04-11 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-35089: -- Summary: Two input AbstractStreamOperator may throw NPE when receiving RecordAttributes Key: FLINK-35089 URL: https://issues.apache.org/jira/browse/FLINK-35089 Project: F

[jira] [Created] (FLINK-35090) Doris sink fails to create table when database does not exist

2024-04-11 Thread Xiqian YU (Jira)
Xiqian YU created FLINK-35090: - Summary: Doris sink fails to create table when database does not exist Key: FLINK-35090 URL: https://issues.apache.org/jira/browse/FLINK-35090 Project: Flink Issu

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

2024-04-11 Thread Rui Fan
Hi Xuannan, > Regarding the new classes, we propose updating the > `ConfigOptionsDocGenerator` to throw an exception and fail the build > if it detects any new class missing the proper annotation in the > future. Thanks for your feedback, it sounds good to me. Best, Rui On Fri, Apr 12, 2024 at

[jira] [Created] (FLINK-35091) Incorrect Warning msg in JM when use influxdb

2024-04-11 Thread sanqingleo (Jira)
sanqingleo created FLINK-35091: -- Summary: Incorrect Warning msg in JM when use influxdb Key: FLINK-35091 URL: https://issues.apache.org/jira/browse/FLINK-35091 Project: Flink Issue Type: Improve

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Jinzhong Li
+1 (non binding) Bests, Jinzhong On Thu, Apr 11, 2024 at 7:26 AM Muhammet Orazov wrote: > Hey Rui, > > +1 (non-binding). > > Thanks for driving it! > > Best, > Muhammet > > On 2024-04-10 04:36, Rui Fan wrote: > > Hi devs, > > > > Thank you to everyone for the feedback on FLIP-441: Show > > the

[jira] [Created] (FLINK-35092) Add integrated test for Doris sink pipeline connector

2024-04-11 Thread Xiqian YU (Jira)
Xiqian YU created FLINK-35092: - Summary: Add integrated test for Doris sink pipeline connector Key: FLINK-35092 URL: https://issues.apache.org/jira/browse/FLINK-35092 Project: Flink Issue Type: I

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Hangxiang Yu
+1 (binding) On Fri, Apr 12, 2024 at 10:22 AM Jinzhong Li wrote: > +1 (non binding) > > Bests, > Jinzhong > > On Thu, Apr 11, 2024 at 7:26 AM Muhammet Orazov > wrote: > > > Hey Rui, > > > > +1 (non-binding). > > > > Thanks for driving it! > > > > Best, > > Muhammet > > > > On 2024-04-10 04:36

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Yanfei Lei
Hi Rui, Thanks for driving it! +1 (binding) Hangxiang Yu 于2024年4月12日周五 10:26写道: > > +1 (binding) > > On Fri, Apr 12, 2024 at 10:22 AM Jinzhong Li > wrote: > > > +1 (non binding) > > > > Bests, > > Jinzhong > > > > On Thu, Apr 11, 2024 at 7:26 AM Muhammet Orazov > > wrote: > > > > > Hey Rui

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Yuepeng Pan
Hi Rui, Thanks for driving it! +1 (non-binding) Best, Yuepeng Pan At 2024-04-12 10:31:19, "Yanfei Lei" wrote: >Hi Rui, > >Thanks for driving it! > >+1 (binding) > >Hangxiang Yu 于2024年4月12日周五 10:26写道: >> >> +1 (binding) >> >> On Fri, Apr 12, 2024 at 10:22 AM Jinzhong Li >> wrote: >> >> > +1

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Zakelly Lan
+1 non-binding Best, Zakelly On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan wrote: > Hi Rui, > > Thanks for driving it! > +1 (non-binding) > Best, > Yuepeng Pan > > At 2024-04-12 10:31:19, "Yanfei Lei" wrote: > >Hi Rui, > > > >Thanks for driving it! > > > >+1 (binding) > > > >Hangxiang Yu 于2

[jira] [Created] (FLINK-35093) Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot.

2024-04-11 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35093: - Summary: Postgres source connector support SPECIFIC_OFFSETS start up mode from an existed replication slot. Key: FLINK-35093 URL: https://issues.apache.org/jira/browse/FLINK-350

Re: Question around Flink's AdaptiveBatchScheduler

2024-04-11 Thread Junrui Lee
Hello Venkata krishnan, I think the term "semantic inconsistency" defined by jobmanager.adaptive-batch-scheduler.max-parallelism refers to maintaining a uniform upper limit on parallelism across all vertices within a job. As the source vertices are part of the global execution graph, they should a

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Lijie Wang
+1 (binding) Thanks for driving. Best, Lijie Zakelly Lan 于2024年4月12日周五 11:08写道: > +1 non-binding > > > Best, > Zakelly > > On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan > wrote: > > > Hi Rui, > > > > Thanks for driving it! > > +1 (non-binding) > > Best, > > Yuepeng Pan > > > > At 2024-04-12 1

Re: [DISCUSS] FLIP-438: Amazon SQS Sink Connector

2024-04-11 Thread Samrat Deb
Hi priya , I can help you with adding table api support and add patch for it . Let me know if that works for you to add it as part of this flip . Thank you Bests, Samrat On Fri, 12 Apr 2024 at 3:11 AM, Dhingra, Priya wrote: > Hi Ahmed, > > Thanks for reviewing it. I have updated the FLIP aga

Re: [VOTE] FLIP-441: Show the JobType and remove Execution Mode on Flink WebUI

2024-04-11 Thread Junrui Lee
+1 (non-binding) Best, Junrui Lijie Wang 于2024年4月12日周五 12:43写道: > +1 (binding) > > Thanks for driving. > > Best, > Lijie > > Zakelly Lan 于2024年4月12日周五 11:08写道: > > > +1 non-binding > > > > > > Best, > > Zakelly > > > > On Fri, Apr 12, 2024 at 11:05 AM Yuepeng Pan > > wrote: > > > > > Hi Rui,