WindowFunction is stuck until next message is processed although Watermark with idle timeout is applied.

Hello, I have a question about watermark with idle timeout. I made an example about it, https://github.com/skonmeme/rare_stream/blob/main/src/main/scala/com/skonuniverse/flink/RareStreamWithIdealTimeout.scala

UnsupportedOperatorException with TensorFlow on checkpointing

Hi, Following codes have a UnsupportedOperatorException on checkpointing (every time). Could you suggest any solution? Example code: A.java -- public class A extends RichWindowFunction { private transient MapState state; @Override

Re: Maximal watermark when two streams are connected

t;. > One way to solve this problem is you should call > ".assignTimestampsAndWatermarks()" before the condition to make sure there > are messages. > > Best, > Jark > > On Thu, 22 Aug 2019 at 13:52, Sung Gon Yi <mailto:skonmem...@mac.com>> wrote: &g

Maximal watermark when two streams are connected

Hello, Originally, watermark of connected stream is set by minimum of watermarks two streams when two streams are connected. I wrote a code to connect two streams but one of streams does not have any message by a condition. In this situation, watermark is never increased and processing is stuck.

Parallelism issue

Hello. I wrote below codes. It works extraordinarily. Processing performs after SourceFunction generates all data and quit. If SourceFunction works infinitely, processing is never performed. But, it works well when parallelismForTimestamp is given other value (eg. 3), I want to know the mecha

Re: Checkpointing & File stream with

/projects/flink/flink-docs-release-1.8/dev/datastream_api.html#data-sources> > > Best > Yun Tang > From: Sung Gon Yi > Sent: Tuesday, June 18, 2019 14:13 > To: user@flink.apache.org > Subject: Checkpointing & File stream with > > Hello, > > I work on joining t

Checkpointing & File stream with

Hello, I work on joining two streams, one is from Kafka and another is from a file (small size). Stream processing works well, but checkpointing is failed with following message. The file only has less than 100 lines and the pipeline related file reading is finished with “FINISHED’ o as soon as

Re: POJO with private fields and toApeendStream of StreamTableEnvironment

Regards, > Timo > > > Am 29.04.19 um 15:44 schrieb Sung Gon Yi: >> In >> https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/common.html#convert-a-table-into-a-datastream-or-dataset >> >> <https://ci.apache.org/projects/flink/flink-docs-r

Re: POJO with private fields and toApeendStream of StreamTableEnvironment

lection. > > Regards, > Timo > > > Am 29.04.19 um 15:44 schrieb Sung Gon Yi: >> In >> https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/common.html#convert-a-table-into-a-datastream-or-dataset >> >> <https://ci.apache.org/projects/flink

POJO with private fields and toApeendStream of StreamTableEnvironment

In https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/common.html#convert-a-table-into-a-datastream-or-dataset , POJO data type is available to conve