Re: spark streaming window operations on a large window size

2015-02-24 Thread Avi Levi
fective window, if the memory is not enough, >>>> BlockManager will discard the blocks at LRU policy, so something unexpected >>>> will be occurred. >>>> >>>> Thanks >>>> Jerry >>>> >>>> -Original Message- &

Re: spark streaming window operations on a large window size

2015-02-23 Thread Tathagata Das
gt;> Thanks >>> Jerry >>> >>> -Original Message- >>> From: avilevi3 [mailto:avile...@gmail.com] >>> Sent: Monday, February 23, 2015 12:57 AM >>> To: user@spark.apache.org >>> Subject: spark streaming window operations on a large

Re: spark streaming window operations on a large window size

2015-02-23 Thread Avi Levi
t enough, >> BlockManager will discard the blocks at LRU policy, so something unexpected >> will be occurred. >> >> Thanks >> Jerry >> >> -Original Message- >> From: avilevi3 [mailto:avile...@gmail.com] >> Sent: Monday, February 23, 2

Re: spark streaming window operations on a large window size

2015-02-23 Thread Tathagata Das
2015 12:57 AM > To: user@spark.apache.org > Subject: spark streaming window operations on a large window size > > Hi guys, > > does spark streaming supports window operations on a sliding window that > is data is larger than the available memory? > we would like to > curre

RE: spark streaming window operations on a large window size

2015-02-23 Thread Shao, Saisai
thing unexpected will be occurred. Thanks Jerry -Original Message- From: avilevi3 [mailto:avile...@gmail.com] Sent: Monday, February 23, 2015 12:57 AM To: user@spark.apache.org Subject: spark streaming window operations on a large window size Hi guys, does spark streaming supports window opera

spark streaming window operations on a large window size

2015-02-23 Thread avilevi3
-list.1001560.n3.nabble.com/spark-streaming-window-operations-on-a-large-window-size-tp21764.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For