Re: the design of spilling to disk

2017-09-19 Thread Florin Dinu
From: Kostas Kloudas Sent: Tuesday, September 19, 2017 18:10 To: Florin Dinu Cc: user@flink.apache.org; fhue...@apache.org Subject: Re: the design of spilling to disk Hi Florin, Unfortunately, there is no design document. The UnilateralSortMerger.java is used in the batch

the design of spilling to disk

2017-09-19 Thread Florin Dinu
d how these spilling markers are used. At a higher level, I am trying to understand how much data does Flink spill to disk after it has concluded that it needs to spill to disk. Thank you very much Florin Dinu