Hi,
I managed to work around the JobID issues, by first starting the task that
queries the state, pauzing it, and then using env.executeAsync.getJobID to
get the proper jobID to use when querying the state, and passing that to the
(pauzed) query state task, which can then continue.
However, the Q
Hi Gordon,
Yes we are well aware of the inconsistencies that can (and will) emerge
while using queryable state like this. However, we will treat them manually
for ensuring the correctness of our targeting applications.
Therefore, could you help with Annemarie's question or are you aware of
someon
This in general is not a good idea, as the state you query using queryable
state within a job does not provide any consistency guarantees at all.
Would it be possible to have some trigger that emits state of the windows,
and join the states downstream?
In general, that is a better approach for wha
Hi,
That in general is not a good idea, with the problem you mentioned as well
as the fact that the state you
query within the same job using queryable state does not provide any means
of consistency guarantee.
When it comes to "querying state from another operator", it is a hint that
your use ca
Hi,
So what I meant was that I have a keyed stream, and from each
thread/keygroup/PU I want to query the state of the other
threads/keygroups/PUs.
Does anybody have any experience with this?
I'm currently working on it, and the main problem seems to be that the
Queryable State Client requires
they
could query each other, which provide better performance.
Best
Yun Tang
From: Annemarie Burger
Sent: Thursday, May 21, 2020 19:45
To: user@flink.apache.org
Subject: Re: Using Queryable State within 1 job + docs suggestion
Hi,
Thanks for your response!
What i
Hi,
Thanks for your response!
What if I'm using regular state instead of windowState, is there any way to
use query this state of a PU from another PU in the same Flink job?
Best,
Annemarie
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi Annemarie
First of all, I'm afraid Flink does not support to make window state as
queryable currently. It was planed to support but haven't implemented as lack
of continuous development in this area for Flink community.
Secondly, I think the doc just want to tell user how to enable this feat
