Re: Pods are OOMKilled with RocksDB backend after a few checkpoints

Hi Alex, Since current default checkpoint policy in RocksDB state backend is still full snapshot, which is actually creating savepoint format. Current savepoint would scan the whole RocksDB with iterators to write data out, and some intermediate data would be kept in memory. I think you could u

Re: Flink failure rate restart not work as expect

Hi, from a first glance it looks like the exception was thrown very rapidly so it exceeded the maxFailuresPerInterval and the FailureRestartStrategy decided not to restart. Why do you think this is different from the expected behavior? Best, Alex On Tue, Mar 1, 2022 at 3:23 AM 刘 家锹 wrote: > Hi,

Re: pyflink object to java object

Hi Xingbo, I think that might work for me, I'll give it a try On Tue, 1 Mar 2022 at 15:06, Xingbo Huang wrote: > Hi, > With py4j, you can call any Java method. On how to create a Java Row, you > can call the `createRowWithNamedPositions` method of `RowUtils`[1]. > > [1] > https://github.com/apa

[no subject]

退订 获取 Outlook for iOS

Re: pyflink object to java object

Hi, With py4j, you can call any Java method. On how to create a Java Row, you can call the `createRowWithNamedPositions` method of `RowUtils`[1]. [1] https://github.com/apache/flink/blob/master/flink-core/src/main/java/org/apache/flink/types/RowUtils.java# Best, Xingbo Francis Conroy 于2022年2月25

退订

退订 获取 Outlook for iOS

Flink failure rate restart not work as expect

Hi, all We encounter some problem with FailureRateRestartStrategy, which confuse us and don't know how to solove it. Here's the situation: Flink version: 1.10.1 Development env: on Yarn FailureRateRestartStrategy: failuresIntervalMS=6,backoffTimeMS=15000,maxFailuresPerInterval=4 One of our

[no subject]

退订

processwindowfunction output Iterator

Hi, Can processwindowfunction output an Iterator? I need to sort and subtract timestamps from keyed events and then output them all with added elapsed times. Regards Hans

Re: Kafka order info to MySQL discard middle status and guarantee final correctness

Hi, Lei Wang I think you could use a custom filter, the logic is as follows: 1. If the status is a final status, then return true 2. If the status is a final status, perform random sampling return true > 2022年2月28日 上午10:16，Lei Wang 写道： > > Receive order message from kafka, every message has a