退订

Rate Limit / Throttle Data to Send

Hi, I have a requirement that I need to send data to a third party with a limit number of elements with flow below. kafkasource mapToVendorPojo processfunction sinkToVendor My implementation is I continuously add the elements to my list state ListState in ProcessFunction and once it reaches 100

Re: In Flink, is there a way to merge two streams in stateful manner

If you need a specific output order, then merge the three streams, key by a constant (like 1), and run that into a KeyedProcessFunction. That function can buffer out-of-order records, and set up a timer to fire when it gets a MAX_WATERMARK (which indicates that all streams are finished) so that

回复: InaccessibleObjectException issue

Thanks for your advice, Alexey I will try adding JDK 11 to my server later... it is little annoying to manage different jvms on one server. maybe i should fall back to flink k8s again... Best regards, Bill 发件人: Alexey Novakov 发送时间: 2023年8月29日 23:05 收件人: Xu Bill 抄送: user@flink.apache.org 主题:

Re: InaccessibleObjectException issue

H Bill, I would recommend you to try that example with JDK 11. Support of JDK 17 is coming in Flink 1.18 https://issues.apache.org/jira/browse/FLINK-15736 Best regards, Alexey On Tue, Aug 29, 2023 at 11:50 AM Xu Bill wrote: > Hello, > > I'm new to Apache Flink. > I followed the instrunctions t

InaccessibleObjectException issue

Hello, I'm new to Apache Flink. I followed the instrunctions to run examples after installation (as described here: https://nightlies.apache.org/flink/flink-docs-stable/docs/try-flink/local_installation/#submitting-a-flink-job) and also tried running an example java app (as described here: ht

Re: Uneven TM Distribution of Flink on YARN

Maybe you can check if you have set yarn.taskmanager.node-label for some flink jobs? Best, Biao Geng 发送自 Outlook for iOS 发件人: Chen Zhanghao 发送时间: Tuesday, August 29, 2023 12:14:53 PM 收件人: Lu Niu ; Weihua Hu 抄送: Kenan Kılıçtepe ; user 主题:

RE: Checkpoint/savepoint _metadata

Hi Frederic, I’ve once (upon a time 😊) had a similar situation when we changed from Flink 1.8 to Flink 1.13 … It took me a long time to figure out. Some hints where to start to look: * _metadata file is used for * Job manager state * Smallish keyed state (in order to avoid too