答复: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread 潘 功森
to:fhue...@gmail.com>> 发送时间: 2018年4月25日 10:56 收件人: Timo Walther 抄送: user 主题: Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired? Hi, This sounds like one of the partitions does not receive data. Watermark generation is data driven, i.e., the watermark can only ad

Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread 周思华
order,I don't know why one of the partitions does not receive data if not change parallelism? 发件人: Fabian Hueske 发送时间: 2018年4月25日 10:56 收件人: Timo Walther 抄送: user 主题: Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired? Hi, This sounds like one of the partition

Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread TechnoMage
e time in order,I don't know why one of the > partitions does not receive data if not change parallelism? > > > 发件人: Fabian Hueske > 发送时间: 2018年4月25日 10:56 > 收件人: Timo Walther > 抄送: user > 主题: Re: Why assignTimestampsAndWatermarks parallelism same as map,it will no

答复: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread 潘 功森
The event is running all the time in order,I don't know why one of the partitions does not receive data if not change parallelism? 发件人: Fabian Hueske 发送时间: 2018年4月25日 10:56 收件人: Timo Walther 抄送: user 主题: Re: Why assignTimestampsAndWatermarks parallelism sa

答复: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread 潘 功森
Yes. 发件人: Timo Walther 发送时间: 2018年4月25日 8:43 收件人: user@flink.apache.org 主题: Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired? Hi, did you set your time characteristics to even-time? env.setStreamTimeCharacteristic

Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread Fabian Hueske
Hi, This sounds like one of the partitions does not receive data. Watermark generation is data driven, i.e., the watermark can only advance if the TimestampAndWatermarkAssigner sees events. By changing the parallelism between the map and the assigner, the events are shuffled across and hence there

Re: Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-25 Thread Timo Walther
Hi, did you set your time characteristics to even-time? env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime); Regards, Timo Am 25.04.18 um 05:15 schrieb 潘 功森: Hi all, I use the same parallelism between map and assignTimestampsAndWatermarks , and it not fired, I saw the extractTime

Why assignTimestampsAndWatermarks parallelism same as map,it will not fired?

2018-04-24 Thread 潘 功森
Hi all, I use the same parallelism between map and assignTimestampsAndWatermarks , and it not fired, I saw the extractTimestamp and generateWatermark all is fine, but watermark is always not change and keep as min long value. And then I changed parallelism and different with map, and windows f