Re: Code related to spilling data to disk

2016-06-22 Thread Tae-Geon Um
: https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/state_backends.html#state-backends <https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/state_backends.html#state-backends> > > Regards, > Chiwan Park > >> On Jun 22, 2016, at 3:

Re: Code related to spilling data to disk

2016-06-21 Thread Tae-Geon Um
I have another question. Is the spilling only executed on batch mode? What happen on streaming mode? > On Jun 22, 2016, at 1:48 PM, Tae-Geon Um wrote: > > Hi, all > > As far as I know, Flink spills data (states?) to disk if the data exceeds > memory threshold or t

Code related to spilling data to disk

2016-06-21 Thread Tae-Geon Um
Hi, all As far as I know, Flink spills data (states?) to disk if the data exceeds memory threshold or there exists memory pressure. i’d like to know the detail of how Flink spills data to disk. Could you please let me know which codes do I have to investigate? Thanks, Taegeon