[jira] [Created] (FLINK-30546) WindowDeduplicate didn't write result to sink timely

2023-01-03 Thread kevinshin (Jira)
kevinshin created FLINK-30546: - Summary: WindowDeduplicate didn't write result to sink timely Key: FLINK-30546 URL: https://issues.apache.org/jira/browse/FLINK-30546 Project: Flink Issue Type: Bu

Re: [DISCUSS] Extending the feature freezing date of Flink 1.17

2023-01-03 Thread Matthias Pohl
+1 for extending to Jan 31 On Tue, Jan 3, 2023 at 8:33 AM Yu Li wrote: > +1 for the proposal (extending the 1.17 feature freeze date to Jan 31st). > > Best Regards, > Yu > > > On Tue, 3 Jan 2023 at 15:11, Zhu Zhu wrote: > > > +1 to extend the feature freeze date to Jan 31st. > > > > Thanks, > >

Fw:WindowDeduplicate didn't write result to sink effectiveness as expected

2023-01-03 Thread lk_hadoop
hi,all : need some help thanks. A more detailed description is here: https://issues.apache.org/jira/browse/FLINK-30546 Forwarding messages From: "lk_hadoop" Date: 2023-01-03 09:15:22 To: "u...@flink.apache.org" Subject: WindowDeduplicate didn't write result to sink effectiven

[jira] [Created] (FLINK-30547) Flink-table-runtime free for flink-table-store-common

2023-01-03 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30547: Summary: Flink-table-runtime free for flink-table-store-common Key: FLINK-30547 URL: https://issues.apache.org/jira/browse/FLINK-30547 Project: Flink Issue T

[jira] [Created] (FLINK-30548) In some cases AvroDeserializationSchema buffer is not reset

2023-01-03 Thread heyu dou (Jira)
heyu dou created FLINK-30548: Summary: In some cases AvroDeserializationSchema buffer is not reset Key: FLINK-30548 URL: https://issues.apache.org/jira/browse/FLINK-30548 Project: Flink Issue Ty

[VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-03 Thread Yuxin Tan
Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a consensus, so I would like to start a vote on FLIP-266: Simplify network memory configurations for TaskManager[2]. The vote will last for at least 72 hours (Jan 6th at 11:00 GMT) unless there is an objection

Re: [DISCUSS] Extending the feature freezing date of Flink 1.17

2023-01-03 Thread Jingsong Li
+1 On Tue, Jan 3, 2023 at 4:40 PM Matthias Pohl wrote: > > +1 for extending to Jan 31 > > On Tue, Jan 3, 2023 at 8:33 AM Yu Li wrote: > > > +1 for the proposal (extending the 1.17 feature freeze date to Jan 31st). > > > > Best Regards, > > Yu > > > > > > On Tue, 3 Jan 2023 at 15:11, Zhu Zhu wro

Re: [DISCUSS] FLIP-280: Introduce a new explain mode to provide SQL advice

2023-01-03 Thread Jingsong Li
Thanks Jane for the FLIP! It looks very nice! Can you give examples of other systems for the syntax? In other systems, is EXPLAIN ANALYZE already PHYSICAL_PLAN? `EXPLAIN ANALYZED_PHYSICAL_PLAN ` looks a bit strange, and even stranger that it contains `advice`. The purpose of FLIP seems to be a b

[jira] [Created] (FLINK-30549) Remove flink-connector-firehose from Flink master branch

2023-01-03 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30549: - Summary: Remove flink-connector-firehose from Flink master branch Key: FLINK-30549 URL: https://issues.apache.org/jira/browse/FLINK-30549 Project: Flink Is

[jira] [Created] (FLINK-30550) Flink master to integrate KDS/KDF docs from flink-connector-aws

2023-01-03 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-30550: - Summary: Flink master to integrate KDS/KDF docs from flink-connector-aws Key: FLINK-30550 URL: https://issues.apache.org/jira/browse/FLINK-30550 Project: Flink

Re: [DISCUSS] Extending the feature freezing date of Flink 1.17

2023-01-03 Thread Xingbo Huang
+1 for extending the freeze date to Jan 31st Best, Xingbo Jingsong Li 于2023年1月3日周二 17:58写道: > +1 > > On Tue, Jan 3, 2023 at 4:40 PM Matthias Pohl > wrote: > > > > +1 for extending to Jan 31 > > > > On Tue, Jan 3, 2023 at 8:33 AM Yu Li wrote: > > > > > +1 for the proposal (extending the 1.17 f

[jira] [Created] (FLINK-30551) Add open method to PartitionCommitPolicy

2023-01-03 Thread Aitozi (Jira)
Aitozi created FLINK-30551: -- Summary: Add open method to PartitionCommitPolicy Key: FLINK-30551 URL: https://issues.apache.org/jira/browse/FLINK-30551 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-274 : Introduce metric group for OperatorCoordinator

2023-01-03 Thread Jark Wu
Hi Dong, Regarding “SplitEnumeratorContext#metricGroup”, my only concern is that this is a core interface for the FLIP. It’s hard to tell how sources use metric group without mentioning this interface. Even if this is an existing API, I think it’s worth introducing the interface again and decla

Re: [DISCUSS] Extending the feature freezing date of Flink 1.17

2023-01-03 Thread Jark Wu
+1 for extending the feature freeze date. Best, Jark > 2023年1月3日 19:13,Xingbo Huang 写道: > > +1 for extending the freeze date to Jan 31st > > Best, > Xingbo > > Jingsong Li 于2023年1月3日周二 17:58写道: > >> +1 >> >> On Tue, Jan 3, 2023 at 4:40 PM Matthias Pohl >> wrote: >>> >>> +1 for extending

Re: [DISCUSS] Adding a option for planner to decide which join reorder rule to choose

2023-01-03 Thread Jark Wu
Hi Yuhong, Thanks for driving the feature. I just have one question. Is the bushy join reorder optimization enabled by default? Does the bushy join reorder will replace the existing Lopt join reorder rule? Besides, I guess the option "table.oprimizer.busy-join-reorder-threshold” should be "t

[jira] [Created] (FLINK-30552) Pulsar connector shouldn't assert the BatchMessageId size.

2023-01-03 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-30552: --- Summary: Pulsar connector shouldn't assert the BatchMessageId size. Key: FLINK-30552 URL: https://issues.apache.org/jira/browse/FLINK-30552 Project: Flink Issu

[DISCUSS] FLIP-284: Making AsyncSinkWriter Flush triggers adjustable

2023-01-03 Thread Hamdy, Ahmed
Hi all I want to initiate discussion around FLIP-284[1]. The purpose of the FLIP is making AsyncSinkWriter[2] buffer controls adjustable as this was discovered to be sink dependant during the implementation for DDB sink[3]. Currently the async sink buffer control logic can be classified into buff

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.3.1, release candidate #1

2023-01-03 Thread Márton Balassi
Thank you, Gyula. +1 (binding) - Verified Helm repo works as expected, points to correct image tag, build, version - Verified basic examples + checked operator logs everything looks as expected - Verified hashes, signatures and source release contains no binaries - Ran built-in tests, built jars

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.3.1, release candidate #1

2023-01-03 Thread Jim Busche
Thanks Gyula for the release. +1 (non-binding) I tested the following: * Helm repo install from flink-kubernetes-operator-1.3.1-helm.tgz * podman Dockerfile build from source looks good *twistlock security scans of the proposed image look good, no currently known vulnerabilities w

Re: [DISCUSS] Adding a option for planner to decide which join reorder rule to choose

2023-01-03 Thread yh z
Hi Jark, Thanks for your reply. We are going to use bushy join reorder rule and Lopt join reorder rule at the same time. By setting the threshold "table.optimizer.bushy-join-reorder-threshold", when the number of tables need to be reordered is less than/equals this threshold, bushy join reorder r

[VOTE] FLIP-274: Introduce metric group for OperatorCoordinator

2023-01-03 Thread Hang Ruan
Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a consensus, so I would like to start a vote on FLIP-274: Introduce metric group for OperatorCoordinator[2]. The vote will last for at least 72 hours (Jan 7th at 11:00 GMT) unless there is an objection or insu

Re: [VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-03 Thread Xintong Song
+1 (binding) Best, Xintong On Tue, Jan 3, 2023 at 5:57 PM Yuxin Tan wrote: > Hi all, > > Thanks for all the feedback so far. > Based on the discussion[1], we have come to a consensus, > so I would like to start a vote on FLIP-266: Simplify network > memory configurations for TaskManager[2].

Re: [DISCUSS] FLIP-282: Introduce Delete & Update API

2023-01-03 Thread yuxia
Hi, Jingsong, thanks for your comments. ## About RowLevelDeleteMode That's really a good suggestion, now I have updated the FLIP to make RowLevelDeleteMode a higer level. ## About scope of addContextParameter Sorry for the confusing, now I have updated the FLIP to add more comments for it. The

Re: [VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-03 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Xintong Song 于2023年1月4日周三 10:36写道: > > +1 (binding) > > Best, > > Xintong > > > > On Tue, Jan 3, 2023 at 5:57 PM Yuxin Tan wrote: > > > Hi all, > > > > Thanks for all the feedback so far. > > Based on the discussion[1], we have come to a consensus, > > so I would like t

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-03 Thread Lijie Wang
Hi Biao, Thanks for the explanation of how SinkV2 knows the right subtask attempt. I have no more questions, +1 for the proposal. Best, Lijie Biao Liu 于2022年12月28日周三 17:22写道: > Thanks for all your feedback! > > To @Yuxia, > > > What the sink expect to do to isolate data produced by speculativ

Re:[VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-03 Thread 17610775726
+1 (no binding) Best JasonLee Replied Message | From | Yuxin Tan | | Date | 01/3/2023 17:56 | | To | | | Subject | [VOTE]FLIP-266: Simplify network memory configurations for TaskManager | Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a co

Re: [DISCUSS] FLIP-283: Use adaptive batch scheduler as default scheduler for batch jobs

2023-01-03 Thread JunRui Lee
Hi, Yuxia Thanks for the reply. > 1. About the configuration renaming. The old configurations ... Thanks for your suggestion. And this explanation has been updated to the FLIP to describe this change more clearly. The old configurations will be deprecated after the configuration renaming, and it

[jira] [Created] (FLINK-30553) checkpoint always IN-PROGRESS because of hdfs

2023-01-03 Thread linqichen (Jira)
linqichen created FLINK-30553: - Summary: checkpoint always IN-PROGRESS because of hdfs Key: FLINK-30553 URL: https://issues.apache.org/jira/browse/FLINK-30553 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-03 Thread Jing Zhang
Hi Biao, Thanks for explanation. +1 for the proposal. Best, Jing Zhang Lijie Wang 于2023年1月4日周三 12:11写道: > Hi Biao, > > Thanks for the explanation of how SinkV2 knows the right subtask > attempt. I have no more questions, +1 for the proposal. > > Best, > Lijie > > Biao Liu 于2022年12月28日周三 17:

[jira] [Created] (FLINK-30554) Remove useless session id in the Sql Client Executor

2023-01-03 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-30554: - Summary: Remove useless session id in the Sql Client Executor Key: FLINK-30554 URL: https://issues.apache.org/jira/browse/FLINK-30554 Project: Flink Issue

[jira] [Created] (FLINK-30555) Hive cluster can not read oss/s3 tables

2023-01-03 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30555: Summary: Hive cluster can not read oss/s3 tables Key: FLINK-30555 URL: https://issues.apache.org/jira/browse/FLINK-30555 Project: Flink Issue Type: Bug