Re: How does Flink plugin system work?

2023-01-02 Thread Matthias Pohl via user
Yes, Ruibin confirmed in a private message that using the factory class works. But thanks for digging into it once more Yanfei. I missed to consider in my previous message that the plugin classes are loaded using their own class loaders which, indeed, can result in a ClassNotFoundException being th

Re: How does Flink plugin system work?

2023-01-02 Thread Yanfei Lei
Hi Ruibin, "metrics.reporter.prom.class" is deprecated in 1.16, maybe " metrics.reporter.prom.factory.class"[1] can solve your problem. After reading the related code[2], I think the root cause is that " metrics.reporter.prom.class" would load the code via flink's classpath instead of MetricRepor

WindowDeduplicate didn't write result to sink effectiveness as expected

2023-01-02 Thread lk_hadoop
hi,all I'm using flink 1.15.3 , I want use WindowDeduplicate to drop duplicate record. my stream table schema is : ( `userName` STRING, `userMAC` STRING, `bssid` STRING, `ssid` STRING, `apName` STRING, `radioID` STRING, `vlanid` STRING, `action` STRING, `ddate` STRING,

Re: Flink Forward Session Question

2023-01-02 Thread Márton Balassi
Hi Rion, Unlike the previous Flink Forwards to the best of my knowledge the latest edition was not uploaded to YouTube. It might make sense to reach out to the authors directly. On Sat, Dec 31, 2022 at 5:35 PM Rion Williams wrote: > Hey Flinkers, > > Firstly, early Happy New Year’s to everyone

Re: The use of zookeeper in flink

2023-01-02 Thread Matthias Pohl via user
And I screwed up the reply again. -.- Here's my previous response for the ML thread and not only spoon_lz: Hi spoon_lz, Thanks for reaching out to the community and sharing your use case. You're right about the fact that Flink's HA feature relies on the leader election. The HA backend not being re

Re: How does Flink plugin system work?

2023-01-02 Thread Matthias Pohl via user
Hi Ruibin, could you switch to using the currently supported way for instantiating reporters using the factory configuration parameter [1][2]? Based on the ClassNotFoundException, your suspicion might be right that the plugin didn't make it onto the classpath. Could you share the startup logs of t