[jira] [Created] (FLINK-33865) exponential-delay.attempts-before-reset-backoff doesn't work when it's set in Job Configuration

2023-12-17 Thread Rui Fan (Jira)
Rui Fan created FLINK-33865: --- Summary: exponential-delay.attempts-before-reset-backoff doesn't work when it's set in Job Configuration Key: FLINK-33865 URL: https://issues.apache.org/jira/browse/FLINK-33865

Re: Question on lookup joins

2023-12-17 Thread Hang Ruan
Hi, David. I think you are right that the value with NULL should not be returned if the filter push down is closed. Maybe you should explain this sql to make sure this filter not be pushed down to the lookup source. I see the configuration 'table.optimizer.source.predicate-pushdown-enabled' reli

Re: [DISCUSS] FLIP-377: Support configuration to disable filter push down for Table/SQL Sources

2023-12-17 Thread Jiabao Sun
Thanks Becket, I apologize for not being able to continue with this proposal due to being too busy during this period. The viewpoints you shared about the design of Flink Source make sense to me The native configuration ‘ignore.filter.pushdown’ is good to me. Having a unified name or naming st

Re: [DISCUSS] FLIP-377: Support configuration to disable filter push down for Table/SQL Sources

2023-12-17 Thread Jiabao Sun
Hi Becket, The FLIP document has been updated as well. Please take a look when you have time. Thanks, Jiabao > 2023年12月17日 22:54,Jiabao Sun 写道: > > Thanks Becket, > > I apologize for not being able to continue with this proposal due to being > too busy during this period. > > The viewpoint

[jira] [Created] (FLINK-33866) KafkaSinkBuilder in flink-connector-kafka references DeliveryGuarantee in flink-connector-base

2023-12-17 Thread Kurt Ostfeld (Jira)
Kurt Ostfeld created FLINK-33866: Summary: KafkaSinkBuilder in flink-connector-kafka references DeliveryGuarantee in flink-connector-base Key: FLINK-33866 URL: https://issues.apache.org/jira/browse/FLINK-33866

Re: Question on lookup joins

2023-12-17 Thread Hang Ruan
Hi, David. The FLIP-377[1] is about this part. You could take a look at it. Best, Hang [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=276105768 Hang Ruan 于2023年12月17日周日 20:56写道: > Hi, David. > > I think you are right that the value with NULL should not be returned if >

FLIP-403: High Availability Services for OLAP Scenarios

2023-12-17 Thread Yangze Guo
Hi, there, We would like to start a discussion thread on "FLIP-403: High Availability Services for OLAP Scenarios"[1]. Currently, Flink's high availability service consists of two mechanisms: leader election/retrieval services for JobManager and persistent services for job metadata. However, thes

[jira] [Created] (FLINK-33867) Add checkpoint metrics: the rate of file write

2023-12-17 Thread Jufang He (Jira)
Jufang He created FLINK-33867: - Summary: Add checkpoint metrics: the rate of file write Key: FLINK-33867 URL: https://issues.apache.org/jira/browse/FLINK-33867 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33868) Add checkpoint metrics: the latency to write the file

2023-12-17 Thread Jufang He (Jira)
Jufang He created FLINK-33868: - Summary: Add checkpoint metrics: the latency to write the file Key: FLINK-33868 URL: https://issues.apache.org/jira/browse/FLINK-33868 Project: Flink Issue Type: S

[jira] [Created] (FLINK-33869) Add checkpoint metrics: the latency to close the file

2023-12-17 Thread Jufang He (Jira)
Jufang He created FLINK-33869: - Summary: Add checkpoint metrics: the latency to close the file Key: FLINK-33869 URL: https://issues.apache.org/jira/browse/FLINK-33869 Project: Flink Issue Type: S

Re: [DISCUSS] FLIP-398: Improve Serialization Configuration And Usage In Flink

2023-12-17 Thread Xintong Song
Hi Ken, I think the main purpose of this FLIP is to change how users interact with the knobs for customizing the serialization behaviors, from requiring code changes to working with pure configurations. Redesigning the knobs (i.e., names, semantics, etc.), on the other hand, is not the purpose of

Re:Re: [DISCUSS] FLIP-400: AsyncScalarFunction for asynchronous scalar function support

2023-12-17 Thread Xuyang
Hi, Alan and Timo. Thanks for your reply. >Would it make a difference if it were exposed by the explain >method (the operator having "syncMode" vs not)? @Alan: I think this is a good way to tell the user what mode these async udx are currently in. >A regular SQL user doesn't care whether the funct

[jira] [Created] (FLINK-33870) Split the HighAvailabilityServices into LeaderServices and PersistentServices

2023-12-17 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-33870: -- Summary: Split the HighAvailabilityServices into LeaderServices and PersistentServices Key: FLINK-33870 URL: https://issues.apache.org/jira/browse/FLINK-33870 Project: Fl

Re: [VOTE] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-17 Thread Lijie Wang
+1 (binding) Best, Lijie Yuxin Tan 于2023年12月15日周五 17:14写道: > +1 (non-binding) > > Best, > Yuxin > > > weijie guo 于2023年12月15日周五 10:05写道: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Wencong Liu 于2023年12月15日周五 09:13写道: > > > > > Hi dev, > > > > > > I'd like to start a vot

Re: [VOTE] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-12-17 Thread Xintong Song
+1 (binding) Best, Xintong On Fri, Dec 15, 2023 at 5:15 PM weijie guo wrote: > +1 (binding) > > Best regards, > > Weijie > > > Wencong Liu 于2023年12月15日周五 09:15写道: > > > Hi dev, > > > > I'd like to start a vote on FLIP-380. > > > > Discussion thread: > > https://lists.apache.org/thread/nn7m

Re: [VOTE] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-17 Thread Xintong Song
+1 (binding) Best, Xintong On Mon, Dec 18, 2023 at 3:05 PM Lijie Wang wrote: > +1 (binding) > > Best, > Lijie > > Yuxin Tan 于2023年12月15日周五 17:14写道: > > > +1 (non-binding) > > > > Best, > > Yuxin > > > > > > weijie guo 于2023年12月15日周五 10:05写道: > > > > > +1(binding) > > > > > > Best regards,

Re: [DISCUSS] FLIP-377: Support configuration to disable filter push down for Table/SQL Sources

2023-12-17 Thread Becket Qin
Hi JIabao, Thanks for updating the FLIP. Maybe I did not explain it clearly enough. My point is that given there are various good flavors of behaviors handling filters pushed down, we should not have a common config of "ignore.filter.pushdown", because the behavior is not *common*. It looks like

Re: [DISCUSS] FLIP-377: Support configuration to disable filter push down for Table/SQL Sources

2023-12-17 Thread Jiabao Sun
Hi Becket, The MySQL connector is currently in the flink-connector-jdbc repository and is not a standalone connector. Is it too unique to use "mysql" as the configuration option prefix? Also, I would like to ask about the difference in behavior between AUTO and ALWAYS. It seems that we canno