Re: Spark Streaming: BatchDuration and Processing time

2016-01-22 Thread Lin Zhao
To: user@spark.apache.org >Subject: Spark Streaming: BatchDuration and Processing time > >Hi, > >If BatchDuration is set to 1 second in StreamingContext and the actual >processing time is longer than one second, then how does Spark handle >that? > >For example, I am receiving

Re: Spark Streaming: BatchDuration and Processing time

2016-01-18 Thread Ricardo Paiva
cond? What happens in the next batch duration? > > Thanks. > Amit > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-BatchDuration-and-Pro

Re: Spark Streaming: BatchDuration and Processing time

2016-01-17 Thread Silvio Fiorito
ssure support. See: http://spark.apache.org/docs/latest/configuration.html#spark-streaming (1.5+). From: pyspark2555 Sent: Sunday, January 17, 2016 11:32 AM To: user@spark.apache.org Subject: Spark Streaming: BatchDuration and Processing time Hi

Spark Streaming: BatchDuration and Processing time

2016-01-17 Thread pyspark2555
is longer than 1 second? What happens in the next batch duration? Thanks. Amit -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-BatchDuration-and-Processing-time-tp25986.html Sent from the Apache Spark User List mailing list archive at