How to get checkpoint stats after job has terminated

Hi, Flink User Group I want to retrieve the last few completed checkpoints' stats even if the job has terminated, these stats are useful for restarting the job manually. Because we prefer to restore job from retained checkpoint rather than savepoint. Doc Monitoring Checkpointing

Re: Does reduce function on keyed window gives any guarantee on the order of elements?

Hi Qing, > Does it guarantee that it will be called in the same order of elements in the stream, where value2 is always 1 element after value1? Order is maintained within each parallel stream partition. If the reduce operator only has one sending- sub-task, the answer is YES, but if reduce operato

Question about UDF randomly processed input row twice

Hi all, I found a weird UDF behavior, and it's a single thread that processes UDF twice, see FLINK-29855 for more details. Basically, I created a datagen table with a random integer (1 row per second) and passed this value into the UDF. Inside UDF

Does reduce function on keyed window gives any guarantee on the order of elements?

Hi, Flink User Group I am trying to use Reduce function, I wonder does it guarantee order when its called? The signature is as follow: T reduce(T value1, T value2) throws Exception; Does it guarantee that it will be called in the same order of elements in the stream, where value2 is always 1

Re: question about Async IO

Thanks, that makes sense and matches my understanding of how it works. In my case, I don't actually need access to keyed *state*; I just want to make sure that all elements with the same key are routed to the same instance of the async function. (Without going into too much detail, the reason for

Re: question about Async IO

Hi Galen I was thinking about the same thing recently and reached a point where I see that async io does not have access to the keyed state because: "* State related apis in [[org.apache.flink.api.common.functions.RuntimeContext]] are not supported * yet because the key may get changed while acc

Re: Regarding Flink Upgrades

Hi, What you linked to is what the community agreed to support. So far we've been able to support three versions at all times (e.g. currently we merge bugfixes to 1.17.x, 1.16.x, 1.15.x), which is one extra version than what is described in the docs. I don't think this will ever decrease. As

Re: Regarding Flink Upgrades

Hello Prasanna, 1) Of course we would always recommend you keep up to date. To receive support and fixes from the Flink community you should try to stick to the current/previous minor version, as per the policy. Releases for older versions are rare and typically only performed under exceptional ci

Re: [Security] - Critical OpenSSL Vulnerability

I saw the update from them as well, so +1, the downgrade in severity makes it less urgent for us now and I’m fine with waiting for the next regular Flink docker release. We would need to wait for the upstream image provider to patch it as well. Thanks! Best, Mason On Tue, Nov 1, 2022 at 9:18 AM M

Re: Flink CEP Incremental Checkpoint Issue

Hi Yun Tang, Thank you for the response and yes went through some articles which explained rocksdb incremental checkpointing mechanism and makes sense w.r.t. metrics that i am seeing. Regards, Puneet > On 22-Oct-2022, at 1:26 PM, Yun Tang wrote: > > compaction

Re: 【SQL Gateway - HiveServer2】UnsupportedOperationException: Unrecognized TGetInfoType value: CLI_ODBC_KEYWORDS.

Hi, Sorry for slow reply. I have debugged and found why the error occurs. Please try using Hive2’s Beeline to connect to the SQL Gateway. I think it is a quick solution. The ‘CLI_ODBC_KEYWORDS' is new in Hive3, and in Initialization phase of connection, Beeline will send a request using t