[Flink] merge-sort for a DataStream

2017-11-14 Thread Jiewen Shao
In Flink, I have DataStream>, each list is individually pre-sorted, what I need to do is persist everything in one shot with global sort order. any ides the best to do this? Hope it makes sense. Thanks in advance!

need instruction on how the Flink metric works

2017-09-17 Thread Jiewen Shao
I'm new to flink and I have read https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/metrics.html, I am still unclear where do I read the metrics I added. for example, public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExe

Re: need instruction on how the Flink metric works

2017-09-17 Thread Jiewen Shao
toring/metrics.html>. > The easiest approach, in my opinion, is to set up a JMX reporter so that > you may see your metrics via JConsole. > > Hope this helps. > > Regrads, > > > On Mon, Sep 18, 2017 at 10:27 AM, Jiewen Shao > wrote: > >> I'm new to flink a

Re: need instruction on how the Flink metric works

2017-09-19 Thread Jiewen Shao
example which could execute > continuously. If I remember correctly, when the task is completed, the > manager would seem to release the associated resource and object. In your > example, it is only processing a few strings, which would finish in matter > of milliseconds, before bringin