[jira] [Created] (FLINK-27808) Allow "kubernetes" as setting for HA_MODE

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27808: Summary: Allow "kubernetes" as setting for HA_MODE Key: FLINK-27808 URL: https://issues.apache.org/jira/browse/FLINK-27808 Project: Flink Issue Type:

[jira] [Created] (FLINK-27809) Clarify that cluster-id is mandatory for Kubernetes HA in standalone mode

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27809: Summary: Clarify that cluster-id is mandatory for Kubernetes HA in standalone mode Key: FLINK-27809 URL: https://issues.apache.org/jira/browse/FLINK-27809 Pro

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

2022-05-27 Thread Becket Qin
I had an offline discussion with Piotr and here is the summary. Please correct me if I miss something, Piotr. There are two things we would like to seek more opinions from the community, so we can make progress on this FLIP. 1. The General pattern to add obligatory features to existing interfaces

[jira] [Created] (FLINK-27810) Elasticsearch e2e jars bundle way more than they should

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27810: Summary: Elasticsearch e2e jars bundle way more than they should Key: FLINK-27810 URL: https://issues.apache.org/jira/browse/FLINK-27810 Project: Flink

[jira] [Created] (FLINK-27811) Remove netty dependency in flink-test-utils

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27811: Summary: Remove netty dependency in flink-test-utils Key: FLINK-27811 URL: https://issues.apache.org/jira/browse/FLINK-27811 Project: Flink Issue Typ

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-27 Thread Jingsong Li
Hi all, I think the problem now is below: 1. AllCache and PartialCache interface on the non-uniform, one needs to provide LookupProvider, the other needs to provide CacheBuilder. 2. AllCache definition is not flexible, for example, PartialCache can use any custom storage, while the AllCache can no

[jira] [Created] (FLINK-27812) Support Dynamic change of watched namespaces

2022-05-27 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-27812: - Summary: Support Dynamic change of watched namespaces Key: FLINK-27812 URL: https://issues.apache.org/jira/browse/FLINK-27812 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-27813) java.lang.IllegalStateException: afte migration from statefun 3.1.1 to 3.2.0

2022-05-27 Thread Oleksandr (Jira)
Oleksandr created FLINK-27813: - Summary: java.lang.IllegalStateException: afte migration from statefun 3.1.1 to 3.2.0 Key: FLINK-27813 URL: https://issues.apache.org/jira/browse/FLINK-27813 Project: Flink

[jira] [Created] (FLINK-27814) Add an abstraction layer for connectors to read and write row data instead of key-values

2022-05-27 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-27814: --- Summary: Add an abstraction layer for connectors to read and write row data instead of key-values Key: FLINK-27814 URL: https://issues.apache.org/jira/browse/FLINK-27814

[jira] [Created] (FLINK-27815) Improve the join reorder strategy for batch sql job

2022-05-27 Thread godfrey he (Jira)
godfrey he created FLINK-27815: -- Summary: Improve the join reorder strategy for batch sql job Key: FLINK-27815 URL: https://issues.apache.org/jira/browse/FLINK-27815 Project: Flink Issue Type:

[jira] [Created] (FLINK-27816) file source reader has Some requirements

2022-05-27 Thread jinshuangxian (Jira)
jinshuangxian created FLINK-27816: - Summary: file source reader has Some requirements Key: FLINK-27816 URL: https://issues.apache.org/jira/browse/FLINK-27816 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-27817) TaskManager metaspace OOM for session cluster

2022-05-27 Thread godfrey he (Jira)
godfrey he created FLINK-27817: -- Summary: TaskManager metaspace OOM for session cluster Key: FLINK-27817 URL: https://issues.apache.org/jira/browse/FLINK-27817 Project: Flink Issue Type: New Fea

[jira] [Created] (FLINK-27818) Model enums as references in OpenAPI spec

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27818: Summary: Model enums as references in OpenAPI spec Key: FLINK-27818 URL: https://issues.apache.org/jira/browse/FLINK-27818 Project: Flink Issue Type:

[jira] [Created] (FLINK-27819) Generate better operationIds for OpenAPI spec

2022-05-27 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27819: Summary: Generate better operationIds for OpenAPI spec Key: FLINK-27819 URL: https://issues.apache.org/jira/browse/FLINK-27819 Project: Flink Issue T

Re: [DISCUSS] FLIP-234: Support Retryable Lookup Join To Solve Delayed Updates Issue In External Systems

2022-05-27 Thread Jark Wu
Hi Lincoln, Delayed Dim Join is a frequently requested feature, it's exciting to see this feature is on the road. The FLIP looks good to me in general. I only left some minor comments. 1) support retry for sync lookup I'm also fine with the idea proposed by Jingsong. But this doesn't conflict wit

[jira] [Created] (FLINK-27820) Handle Upgrade/Deployment errors gracefully

2022-05-27 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-27820: -- Summary: Handle Upgrade/Deployment errors gracefully Key: FLINK-27820 URL: https://issues.apache.org/jira/browse/FLINK-27820 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-27821) Cannot delete flinkdeployment when the pod and deployment deleted manually

2022-05-27 Thread Hector Miuler Malpica Gallegos (Jira)
Hector Miuler Malpica Gallegos created FLINK-27821: -- Summary: Cannot delete flinkdeployment when the pod and deployment deleted manually Key: FLINK-27821 URL: https://issues.apache.org/jira/browse

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-27 Thread Jing Ge
Thanks all for the valuable discussion. The new feature looks very interesting. According to the FLIP description: "*Currently we have JDBC, Hive and HBase connector implemented lookup table source. All existing implementations will be migrated to the current design and the migration will be trans

Re: [DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-27 Thread godfrey he
Hi, everyone. Thanks for all the inputs. If there is no more feedback, I think we can start the vote next monday. Best, Godfrey Martijn Visser 于2022年5月25日周三 19:46写道: > > Hi Godfrey, > > Thanks for creating the FLIP. I have no comments. > > Best regards, > > Martijn > > > On Tue, 17 May 2022 at

RE: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #2

2022-05-27 Thread Jim Busche
Hi Yang, Oh, I’ve been using podman on Red Hat for testing: podman version Client: Podman Engine Version: 4.0.2 API Version: 4.0.2 If I use Docker (version 20.10.13 for me right now) then it builds fine with that COPY git line. Nice! To use podman, I need to either comment

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.0.0, release candidate #2

2022-05-27 Thread Gyula Fóra
Hi Devs! We have been performing extensive manual testing on the release. We have found some very infrequent savepoint upgrade issues with Flink 1.15 deployments that we could not reliably reproduce so far. I have added a fix that hopefully eliminates the root cause ( https://issues.apache.org/ji

[jira] [Created] (FLINK-27822) Translate the doc of checkpoint/savepoint guarantees

2022-05-27 Thread fanrui (Jira)
fanrui created FLINK-27822: -- Summary: Translate the doc of checkpoint/savepoint guarantees Key: FLINK-27822 URL: https://issues.apache.org/jira/browse/FLINK-27822 Project: Flink Issue Type: Improvem

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-05-27 Thread Zhu Zhu
Hi Chesnay, Would you share your thoughts in the discussion thread if there are still concerns? Thanks, Zhu Chesnay Schepler 于2022年5月27日周五 14:54写道: > > -1 to put a lid on things for now, because I'm not quite done yet with > the discussion. > > On 27/05/2022 05:25, Yangze Guo wrote: > > +1 (bin

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-05-27 Thread Zhu Zhu
Regarding the concern of the SlotManager, my two cents: 1. it is necessary for the SlotManager to host blocked slots, in 2 cases: a. In standalone mode, a taskmanager may be temporarily added to the blocklist. We do not want the TM to get disconnected and shut down. So we need to keep its connect