Unsubscribe

2023-07-25 Thread Lu Weizheng
Unsubscribe

Scala: Static methods in interface require -target:jvm-1.8

2020-09-28 Thread Lu Weizheng
Hi all, I recently upgraded Intellij IEDA from 2019 to 2020.2 Community Edition. I didn’t do anything to Maven. My code could compile correctly before. But now I get the following error: Static methods in interface require -target:jvm-1.8 Probably because I use new WatermarkStrategy Scala API:

Re: Flink 1.11 SQL error: No operators defined in streaming topology. Cannot execute.

2020-08-13 Thread Lu Weizheng
at has `execute` in its name will immediately execute a job. Therefore your > `env.execute` has an empty pipeline. > > Regards, > Timo > > [1] https://wiki.apache.org/confluence/pages/viewpage.action?pageId=134745878 > > On 13.08.20 09:34, Lu Weizheng wrote: >> Hi,

Flink 1.11 SQL error: No operators defined in streaming topology. Cannot execute.

2020-08-13 Thread Lu Weizheng
Hi, I am using Flink 1.11 SQL using java. All my operations are in SQL. I create source tables and insert result into sink tables. No other Java operators. I execute it in Intellij. I can get the final result in the sink tables. However I get the following error. I am not sure it is a bug or th

Re: How to write WatermarkStrategy in Scala?

2020-08-10 Thread Lu Weizheng
2) ) I create a ticket to improve the situation here: https://issues.apache.org/jira/browse/FLINK-18873 Best, Dawid On 08/08/2020 10:18, Lu Weizheng wrote: Hi there, Flink 1.11 comes with the new WatermarkStrategy API to assign timestamp and watermark. I find there is no example in Sca

How to write WatermarkStrategy in Scala?

2020-08-08 Thread Lu Weizheng
Hi there, Flink 1.11 comes with the new WatermarkStrategy API to assign timestamp and watermark. I find there is no example in Scala. I have a (String, Long) Stream, can anyone help implement WatermarkStrategy? I will be really gratefully! val input: DataStream[(String, Long)] = ... val water

回复: Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Lu Weizheng
); default: throw new UnsupportedOperationException("Unrecognized Checkpointing Mode: " + config.getCheckpointMode()); } } 发件人: Zhijiang 发送时间: 2020年6月22日 10:41 收件人: Lu Weizheng ; user@flink.apache.org 主题: Re: Unaligned Checkpoint and Exactl

Unaligned Checkpoint and Exactly Once

2020-06-21 Thread Lu Weizheng
Hi there, The new feature in Flink 1.11 will provide us the Unaligned Checkpoint which means a operator subtask does not need to wait all the Checkpoint barrier and will not block some channels. As the Checkpoint barrier is the key mechanism for Exactly Once guarantee, I am not sure Unaligned C

回复: Table API connect method timestamp watermark assignment problem

2020-03-02 Thread Lu Weizheng
Thanks a lot, hope it will be fixed soon! 发件人: Jark Wu 发送时间: 2020年3月3日 11:25 收件人: Lu Weizheng 抄送: user@flink.apache.org 主题: Re: Table API connect method timestamp watermark assignment problem Hi Lu, DDL and Schema descriptor do not share the same code path. I

Table API connect method timestamp watermark assignment problem

2020-03-02 Thread Lu Weizheng
Hey guys, I am using Flink Table API recently. I want to use EventTime and use a Kakfa Table Connector. I think in my code Flink cannot recognize event time timestamp field. Here is my code : public static void main(String[] args) throws Exception { EnvironmentSettings fsSettings = En

回复: Get Tumbling Window Top-K using SQL

2020-03-01 Thread Lu Weizheng
ons] thanks anyway. 发件人: Lu Weizheng 发送时间: 2020年3月1日 17:48 收件人: user@flink.apache.org 主题: Get Tumbling Window Top-K using SQL Hi, I find a question on StackOverflow(https://stackoverflow.com/questions/49191326/flink-stream-sql-order-by) about how to get To

Get Tumbling Window Top-K using SQL

2020-03-01 Thread Lu Weizheng
Hi, I find a question on StackOverflow(https://stackoverflow.com/questions/49191326/flink-stream-sql-order-by) about how to get Top-K using Flink SQL, it was written by Fabian. It was backed in 2018. The main idea is using a RANK to get the Top K of filed 'a': SELECT a, b, c FROM ( SELECT

回复: Difference between JobManager and JobMaster

2020-01-31 Thread Lu Weizheng
4319 Best Yun Tang ____ From: Lu Weizheng Sent: Friday, January 31, 2020 10:25 To: user@flink.apache.org Subject: Difference between JobManager and JobMaster Hi all, Recently I am reading source code of Flink. There are both JobManager and JobMaster in flink-runti

Difference between JobManager and JobMaster

2020-01-30 Thread Lu Weizheng
Hi all, Recently I am reading source code of Flink. There are both JobManager and JobMaster in flink-runtime project. And JobManagerRunner interface says it is a runner which executes a JobMaster. So how to distinguish the two concepts? Is JobMaster a subset of JobManager? Or JobMaster is a new

回复: DataStream API min max aggregation on other fields

2019-12-19 Thread Lu Weizheng
! 发件人: Biao Liu 发送时间: 2019年12月19日 18:10 收件人: vino yang 抄送: Lu Weizheng ; user@flink.apache.org 主题: Re: DataStream API min max aggregation on other fields Hi Lu, @vino yang<mailto:yanghua1...@gmail.com> I think what he means is that the "max" s

DataStream API min max aggregation on other fields

2019-12-19 Thread Lu Weizheng
Hi all, On a KeyedStream, when I use maxBy or minBy, I will get the max or min element. It means other fields will be kept as the max or min element. This is quite clear. However, when I use max or min, how do Flink do on other fields? val tupleStream = senv.fromElements( (0, 0, 0), (0, 1, 1