RE: Questions about Stateful Operations in SS

2017-07-27 Thread Zhang, Lubo
Got you, thanks for your reply. Best regards Lubo From: Tathagata Das [mailto:tathagata.das1...@gmail.com] Sent: Thursday, July 27, 2017 3:08 AM To: Zhang, Lubo Cc: dev@spark.apache.org Subject: Re: Questions about Stateful Operations in SS Hello Lubo, The idea of timeouts is to make a best

RE: Questions about Stateful Operations in SS

2017-07-27 Thread Zhang, Lubo
From: Tathagata Das [mailto:tathagata.das1...@gmail.com] Sent: Thursday, July 27, 2017 3:08 AM To: Zhang, Lubo Cc: dev@spark.apache.org Subject: Re: Questions about Stateful Operations in SS Hello Lubo, The idea of timeouts is to make a best-effort and last-resort effort to process a key

Re: Questions about Stateful Operations in SS

2017-07-26 Thread Tathagata Das
Hello Lubo, The idea of timeouts is to make a best-effort and last-resort effort to process a key, when it has not received data for a while. With processing time timeout is 1 minute, the system guarantees that it will not timeout unless at least 1 minute has passed. Defining a precise timing on w