Inquiry about ActiveResourceManager and StandaloneResourceManager in Flink

2023-11-02 Thread Steven Chen
Dear Flink Community, I am currently using Flink for my project and have a question regarding ActiveResourceManager and StandaloneResourceManager. What does "active" mean in ActiveResourceManager and why is StandaloneResourceManager not considered an active resource manager? Thank you fo

Re: flink-kubernetes-operator cannot handle SPECCHANGE for 100+ FlinkDeployments concurrently

2023-11-02 Thread Tony Chen
One of the operator pods logged the following exception before the container restarted: �[m�[33m2023-11-01 14:24:21,260�[m �[36mo.a.f.s.n.i.n.c.AbstractChannel�[m �[33m[WARN ] Force-closing a channel whose registration task was not accepted by an event loop: [id: 0x1a7718c1] java.util.concurrent.R

Re: Issues about removed topics with KafkaSource

2023-11-02 Thread Hector Rios
Hi Emily One workaround that might help is to leverage the state-processor-api[1]. You would have to do some upfront work to create a state-processor job to wipe the state (offsets) of the topic you want to remove and use the newly generated savepoint without the removed state of the topic or topi