Re: How to use Lo-level Joins API

2019-08-06 Thread Yuta Morisawa
Hi Victor > Is it possible stream1 and stream2 don't have common keys? You may verify this by logging out the key of current processed element. I misunderstood the usage. I thought stream1 and 2 have different contexts and they can access both state stores each other. But actually, processEl

Re: How to use Lo-level Joins API

2019-08-06 Thread Victor Wong
Hi Yuta, > I made sure the 'ValueState data' has data from stream1 with the IDE debugger but in spite of that, processElement2 can't access it. Since `processElement1` and `processElement2` use the same `Context`, I think there is no state access issue. Is it possible stream1 and stream2 don't

Re: How to use Lo-level Joins API

2019-08-06 Thread Yuta Morisawa
Hi Yun Thank you for replying. >Have you set a default value for the state ? Actually, the constructor of the ValueStateDescriptor with default value is deprecated so I don't set it. The problem occurs when the stream1 comes first. I made sure the 'ValueState data' has data from stream

Re: How to use Lo-level Joins API

2019-08-06 Thread Yun Gao
Hi Yuta, Have you set a default value for the state ? If the state did not have a default value and the records from stream2 comes first for a specific key, then the state would never be set with a value, thus the return value will be null. Best, Yun

How to use Lo-level Joins API

2019-08-06 Thread Yuta Morisawa
Hi I am trying to use low-level joins. According to the doc, the way is creating a state and access it from both streams, but I can't. https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/operators/process_function.html This is a snippet of my code. It seems that the process