Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-02-20 Thread Matthias Pohl
>>>> do we need to look into supporting AclProviders as well? >>>> >>>> Best, >>>> Matthias >>>> >>>> [1] >>>> >>>> https://flink.apache.org/how-to-contribute/code-style-and-quality-formatting/#naming >>>

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-24 Thread Zhu Zhu
no way to authorise Flink via the Curator >>> > framework, which is probably an important feature which is missing. >>> Since >>> > public configuration change requires a Flip, current Flip is proposing >>> to >>> > add several more potentially important Curator configurations. &

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-23 Thread Matthias Pohl
; >> > Kind regards >> > Oleksandr >> > >> > On Thu, Jan 4, 2024 at 4:57 AM Zhanghao Chen > > >> > wrote: >> > >> > > Thanks for driving this. I'm not familiar with the listed advanced >> > Curator >> > > configs, but t

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-22 Thread Alex Nitavsky
t being said, +1 for the overall idea, these > > > configs may help users in certain scenarios sooner or later. > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-31780 > > > > > > Best, > > > Zhanghao Chen > > > __

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-22 Thread Matthias Pohl
r or later. > > > > [1] https://issues.apache.org/jira/browse/FLINK-31780 > > > > Best, > > Zhanghao Chen > > ________________ > > From: Alex Nitavsky > > Sent: Thursday, December 14, 2023 21:20 > > To: dev@flink.apache.org &g

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-08 Thread Alex Nitavsky
> From: Alex Nitavsky > Sent: Thursday, December 14, 2023 21:20 > To: dev@flink.apache.org > Subject: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations > > Hi all, > > I would like to start a discussion thread for: *FLIP-402: Extend Z

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Zhanghao Chen
nfigs may help users in certain scenarios sooner or later. [1] https://issues.apache.org/jira/browse/FLINK-31780 Best, Zhanghao Chen From: Alex Nitavsky Sent: Thursday, December 14, 2023 21:20 To: dev@flink.apache.org Subject: [DISCUSS] FLIP-402: Extend ZooK

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Martijn Visser
Hi Oleksandr, You're right, I was misreading the POM files because Curator is coming in via Flink-Shaded and not directly. So the POM files only contain references directly to Curator as test dependencies. Then I'll defer to others with experience on this topic to chime in. Cheers, Martijn On W

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-03 Thread Alex Nitavsky
Hello Martjin, Thank you for reviewing the document. I'm under the impression that Flink utilizes Apache Curator to handle high-availability leader elections for Job Managers with Zookeeper Services [0]. In the most recent master version, it seems that Curator is instantiated at [1] ZooKeeperUtil

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2023-12-28 Thread Martijn Visser
Hi Oleksandr, The FLIP talks about Curator, but outside of flink test utils, the usage of Curator is only for test purposes. I don't think there's anything preventing you right now from providing these additional parameters as values in the flink-conf.yaml ? Best regards, Martijn On Thu, Dec 14

[DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2023-12-14 Thread Alex Nitavsky
Hi all, I would like to start a discussion thread for: *FLIP-402: Extend ZooKeeper Curator configurations *[1] * Problem statement * Currently Flink misses several Apache Curator configurations, which could be useful for Flink deployment with ZooKeeper as HA provider. * Proposed solution * We ha