What do you get form the sys out printing in CoFlatMapFunImpl? Could it be that
all the elements are being processed before the control input element arrives
and that they are therefore dropped?
> On 17 Mar 2017, at 09:14, Tarandeep Singh wrote:
>
> Hi Gordon,
>
> When I use getInput (input c
Hi Gordon,
When I use getInput (input created via collection), then watermarks are
always Long.MAX_VALUE:
WM: Watermark @ 9223372036854775807
This is understandable as input source has finished so a watermark of value
Long.MAX_VALUE is emitted.
When I use getKafkaInput, I get this watermark:
WM:
Hi Tarandeep,
Thanks for clarifying.
For the next step, I would recommend taking a look at
https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/debugging_event_time.html
and try to find out what exactly is wrong with the watermark progression.
Flink 1.2 exposes watermarks as
Anyone?
Any suggestions what could be going wrong or what I am doing wrong?
Thanks,
Tarandeep
On Thu, Mar 16, 2017 at 7:34 AM, Tarandeep Singh
wrote:
> Data is read from Kafka and yes I use different group id every time I run
> the code. I have put break points and print statements to verify t
Data is read from Kafka and yes I use different group id every time I run the
code. I have put break points and print statements to verify that.
Also, if I don't connect with control stream the window function works.
- Tarandeep
> On Mar 16, 2017, at 1:12 AM, Tzu-Li (Gordon) Tai wrote:
>
> H
Hi Tarandeep,
I haven’t looked at the rest of the code yet, but my first guess is that you
might not be reading any data from Kafka at all:
private static DataStream readKafkaStream(String topic,
StreamExecutionEnvironment env) throws IOException {
Properties properties = new Propertie
