Hi.
I use ingestion time.
I didn’t use timing window.
I've used a GlobalWindow with custom Trigger as below.
My apply() logic is same as before and no complaint.
Thanks.
class HandTrigger extends Trigger[(String, String, String, String, Long),
GlobalWindow] {
override def onElement(t
Hi!
Concerning your latest questions
- There should not be multiple threads accessing the same state.
- With "using a regular Java Map" I mean keeping everything as it is,
except instead of using "ValueState" in the RichFlatMapFunction, you use a
java.util.HashMap
- If the program works wit
Hi. Stephan.
do you mean using map on local excution?
I’ve tested it but not works at all.
Thanks.
> On Aug 15, 2016, at 4:56 PM, Dong-iL, Kim wrote:
>
> Hi.
> I've tested the program with window function(keyBy->window->collect). it has
> no problem.
>
> my old program. (keyBy-> state process
Hi.
I've tested the program with window function(keyBy->window->collect). it has no
problem.
my old program. (keyBy-> state processing). can it be processed by multiple
thread within a key?
Thank you.
> On Aug 12, 2016, at 8:27 PM, Stephan Ewen wrote:
>
> Hi!
>
> So far we are not aware of
Hi!
So far we are not aware of a state loss bug in Flink. My guess is that it
is some subtlety in the program.
The check that logs also has other checks, like "handHistoryInfo.playType
== PlayType.Cash" and "players.size > 1". Is one of them maybe the problem?
To debug this, you can try and do
Hi.
I checked order of data. but it is alright.
Is there any other possibilities?
Thank you.
> On Aug 12, 2016, at 7:09 PM, Stephan Ewen wrote:
>
> Hi!
>
> Its not that easy to say at a first glance.
>
> One thing that is important to bear in mind is what ordering guarantees Flink
> gives, an
Hi!
Its not that easy to say at a first glance.
One thing that is important to bear in mind is what ordering guarantees
Flink gives, and where the ordering guarantees are not given.
When you use keyBy() or redistribute(), order is preserved per parallel
source/target pair only.
Have a look here:
Nope.
I added log in End.
but there is same log.
is there any fault in my code?
thank you.
> On Aug 12, 2016, at 6:42 PM, Maximilian Michels wrote:
>
> You're clearing the "handState" on "GameEndHistory". I'm assuming this
> event comes in before "CommCardHistory" where you check the state.
>
You're clearing the "handState" on "GameEndHistory". I'm assuming this
event comes in before "CommCardHistory" where you check the state.
On Fri, Aug 12, 2016 at 6:59 AM, Dong-iL, Kim wrote:
> in my code, is the config of ExecutionEnv alright?
>
>
>> On Aug 11, 2016, at 8:47 PM, Dong-iL, Kim wro
in my code, is the config of ExecutionEnv alright?
> On Aug 11, 2016, at 8:47 PM, Dong-iL, Kim wrote:
>
>
> my code and log is as below.
>
>
>val getExecuteEnv: StreamExecutionEnvironment = {
>val env =
> StreamExecutionEnvironment.getExecutionEnvironment.enableCheckpointing(100
my code and log is as below.
val getExecuteEnv: StreamExecutionEnvironment = {
val env =
StreamExecutionEnvironment.getExecutionEnvironment.enableCheckpointing(1)
env.setStreamTimeCharacteristic(TimeCharacteristic.IngestionTime)
env.getCheckpointConfig.setCheckp
What do you mean with lost exactly?
You call value() and it returns a value (!= null/defaultValue) and you
call it again and it returns null/defaultValue for the same key with
no update in between?
On Thu, Aug 11, 2016 at 11:59 AM, Kostas Kloudas
wrote:
> Hello,
>
> Could you share the code of t
Hello,
Could you share the code of the job you are running?
With only this information I am afraid we cannot help much.
Thanks,
Kostas
> On Aug 11, 2016, at 11:55 AM, Dong-iL, Kim wrote:
>
> Hi.
> I’m using flink 1.0.3 on aws EMR.
> sporadically value of ValueState is lost.
> what is starting
Hi.
I’m using flink 1.0.3 on aws EMR.
sporadically value of ValueState is lost.
what is starting point for solving this problem.
Thank you.
14 matches
Mail list logo
