Please help, I need to bootstrap keyed state into a stream

2020-08-08 Thread Marco Villalobos
According to the documentation, and various blogs, it is possible to use the Batch Execution Environment to bootstrap state into a save point, and then load that state in a Stream Execution Environment. I am trying to use that feature. State Processor API documentation states that "you can read

How to write WatermarkStrategy in Scala?

2020-08-08 Thread Lu Weizheng
Hi there, Flink 1.11 comes with the new WatermarkStrategy API to assign timestamp and watermark. I find there is no example in Scala. I have a (String, Long) Stream, can anyone help implement WatermarkStrategy? I will be really gratefully! val input: DataStream[(String, Long)] = ... val water

Re: API Performance

2020-08-08 Thread Arvid Heise
Hi Jiazhi, could you be more specific as to what you want to achieve? In general, if you write relational queries, Table API will be a tad slower on startup as it generates codes, but execution is faster as a result. It also performs logical and physical optimizations. So if your query has optimi

API Performance

2020-08-08 Thread ?g???U?[????
Hi all  I want to know which performance is faster, the DataStream API or the Table API + SQL. Thanks, Jiazhi