Re: Difference between windows in Spark and Flink

2019-10-11 Thread Felipe Gutierrez
runtime/io/network/api/writer/ChannelSelectorRecordWriter.java#L60 > > Best > Yun Tang > > -- > *From:* Felipe Gutierrez > *Sent:* Friday, October 11, 2019 15:47 > *To:* Yun Tang > *Cc:* user > *Subject:* Re: Difference between windows in Spark an

Re: Difference between windows in Spark and Flink

2019-10-11 Thread Yun Tang
: Felipe Gutierrez Sent: Friday, October 11, 2019 15:47 To: Yun Tang Cc: user Subject: Re: Difference between windows in Spark and Flink Hi Yun, that is a very complete answer. Thanks! I was also wondering about the mini-batches that Spark creates when we have to create a SparkStream cont

Re: Difference between windows in Spark and Flink

2019-10-11 Thread Felipe Gutierrez
eaming-queries > [7] https://issues.apache.org/jira/browse/FLINK-12692 > > Best > Yun Tang > > > > ---------- > *From:* Felipe Gutierrez > *Sent:* Thursday, October 10, 2019 20:39 > *To:* user > *Subject:* Difference between windows in Spark

Re: Difference between windows in Spark and Flink

2019-10-10 Thread Yun Tang
LINK-12692 Best Yun Tang From: Felipe Gutierrez Sent: Thursday, October 10, 2019 20:39 To: user Subject: Difference between windows in Spark and Flink Hi all, I am trying to think about the essential differences between operators in Flink and Spark. Especially when I am using Keyed Window

Difference between windows in Spark and Flink

2019-10-10 Thread Felipe Gutierrez
Hi all, I am trying to think about the essential differences between operators in Flink and Spark. Especially when I am using Keyed Windows then a reduce operation. In Flink we develop an application that can logically separate these two operators. Thus after a keyed window I can use .reduce/aggre