Re: Difference between windows in Spark and Flink

2019-10-11 Thread Felipe Gutierrez
runtime/io/network/api/writer/ChannelSelectorRecordWriter.java#L60 > > Best > Yun Tang > > -- > *From:* Felipe Gutierrez > *Sent:* Friday, October 11, 2019 15:47 > *To:* Yun Tang > *Cc:* user > *Subject:* Re: Difference between windows in Spark an

Re: Difference between windows in Spark and Flink

2019-10-11 Thread Yun Tang
: Felipe Gutierrez Sent: Friday, October 11, 2019 15:47 To: Yun Tang Cc: user Subject: Re: Difference between windows in Spark and Flink Hi Yun, that is a very complete answer. Thanks! I was also wondering about the mini-batches that Spark creates when we have to create a SparkStream cont

Re: Difference between windows in Spark and Flink

2019-10-11 Thread Felipe Gutierrez
eaming-queries > [7] https://issues.apache.org/jira/browse/FLINK-12692 > > Best > Yun Tang > > > > ---------- > *From:* Felipe Gutierrez > *Sent:* Thursday, October 10, 2019 20:39 > *To:* user > *Subject:* Difference between windows in Spark

Re: Difference between windows in Spark and Flink

2019-10-10 Thread Yun Tang
LINK-12692 Best Yun Tang From: Felipe Gutierrez Sent: Thursday, October 10, 2019 20:39 To: user Subject: Difference between windows in Spark and Flink Hi all, I am trying to think about the essential differences between operators in Flink and Spark. Especially when I am using Keyed Window

Difference between windows in Spark and Flink

2019-10-10 Thread Felipe Gutierrez
Hi all, I am trying to think about the essential differences between operators in Flink and Spark. Especially when I am using Keyed Windows then a reduce operation. In Flink we develop an application that can logically separate these two operators. Thus after a keyed window I can use .reduce/aggre

Re: using a Yarn cluster for both Spark and Flink

2018-01-17 Thread Georg Heiler
o set up a Yarn cluster for running both Spark > and Flink applications? >

using a Yarn cluster for both Spark and Flink

2018-01-17 Thread Soheil Pourbafrani
Is it standard approach to set up a Yarn cluster for running both Spark and Flink applications?

Re: Spark and Flink

2015-05-21 Thread Pa Rö
se.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64) >>>>>> at >>>>>> org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95) >>>>>> at org.eclipse.jetty.server.Server.doStart(Server.java:282

Re: Spark and Flink

2015-05-19 Thread Alexander Alexandrov
ifeCycle.start(AbstractLifeCycle.java:64) >>>>> at >>>>> org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:199) >>>>> at >>>>> org.apache.spark.ui.JettyUtils$$anonfun$4.apply(JettyUtils.sca

Re: Spark and Flink

2015-05-19 Thread Till Rohrmann
$sp(Range.scala:141) >>>> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1450) >>>> at >>>> org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:209) >>>> at org.apache.spark.ui.WebUI.bind(WebUI.scala:102) >&

Re: Spark and Flink

2015-05-19 Thread Alexander Alexandrov
oKmeans.Spark.SparkMain.main(SparkMain.java:37) >>> ... >>> >>> what i do wrong? >>> >>> best regards >>> paul >>> >>> 2015-05-13 15:43 GMT+02:00 Ted Yu : >>> >>>> You can use exclusion to remove the undesired jetty

Re: Spark and Flink

2015-05-19 Thread Pa Rö
>> >>> You can use exclusion to remove the undesired jetty version. >>> Here is syntax: >>> >>> com.fasterxml.jackson.module >>> jackson-module-scala_2.10 >>> ${fasterxml.jackson.version} >>> >>>

Re: Spark and Flink

2015-05-18 Thread Robert Metzger
>> com.google.guava >> guava >> >> >> >> >> On Wed, May 13, 2015 at 6:41 AM, Paul Röwer < >> paul.roewer1...@googlemail.com> wrote: >> >>> Okay. And how i get it clean in my maven

Fwd: Spark and Flink

2015-05-18 Thread Pa Rö
ai 2015 15:15:34 MESZ, schrieb Ted Yu : >>> >>> You can run the following command: >>> mvn dependency:tree >>> >>> And see what jetty versions are brought in. >>> >>> Cheers >>> >>> >>> >>> On M

Re: Spark and Flink

2015-05-13 Thread Ted Yu
You can run the following command: mvn dependency:tree And see what jetty versions are brought in. Cheers > On May 13, 2015, at 6:07 AM, Pa Rö wrote: > > hi, > > i use spark and flink in the same maven project, > > now i get a exception on working with spark, fli

Spark and Flink

2015-05-13 Thread Pa Rö
hi, i use spark and flink in the same maven project, now i get a exception on working with spark, flink work well the problem are transitiv dependencies. maybe somebody know a solution, or versions, which work together. best regards paul ps: a cloudera maven repo flink would be desirable my