For future readers of this thread, Spark 1.6 adds trackStateByKey that has
native support for timeouts.
On Tue, Jul 21, 2015 at 12:00 AM, Anand Nalya wrote:
> I also ran into a similar use case. Is this possible?
>
> On 15 July 2015 at 18:12, Michel Hubert wrote:
>
>> Hi,
>>
>>
>>
>>
>>
>> I wa
I also ran into a similar use case. Is this possible?
On 15 July 2015 at 18:12, Michel Hubert wrote:
> Hi,
>
>
>
>
>
> I want to implement a time-out mechanism in de updateStateByKey(…)
> routine.
>
>
>
> But is there a way the retrieve the time of the start of the batch
> corresponding to the
