Re: watermark trigger doesn't check whether element's timestamp is passed

2016-11-01 Thread aj heller
Hi Manu, Aljoscha, I had been interested in implementing FLIP-2, but I haven't been able to make time for it. There is no implementation yet that I'm aware of, and I'll gladly step aside (or help out how I can) if you or anyone is interested to take charge of it. That said, I'm also not sure if d

Re: Merging N parallel/partitioned WindowedStreams together, one-to-one, into a global window stream

2016-10-06 Thread AJ Heller
bal window for each window id and collect all > N windows. > > Best, Fabian > > 2016-10-06 22:39 GMT+02:00 AJ Heller : > >> The goal is: >> * to split data, random-uniformly, across N nodes, >> * window the data identically on each node, >> * transf

Merging N parallel/partitioned WindowedStreams together, one-to-one, into a global window stream

2016-10-06 Thread AJ Heller
The goal is: * to split data, random-uniformly, across N nodes, * window the data identically on each node, * transform the windows locally on each node, and * merge the N parallel windows into a global window stream, such that one window from each parallel process is merged into a "global wind

Re: ResourceManager not using correct akka URI in standalone cluster (?)

2016-09-28 Thread AJ Heller
Thank you Till. I was in a time crunch, and rebuilt my cluster from the ground up with hadoop installed. All works fine now, `netstat -pn | grep 6123` shows flink's pid. Hadoop may be irrelevant, I can't rule out PEBKAC yet :-). Sorry, when I have time I'll attempt to reproduce the scenario, on the

Re: ResourceManager not using correct akka URI in standalone cluster (?)

2016-09-15 Thread AJ Heller
work because I couldn't get the private IP scenario working. Running `./bin/start-local.sh` shows non-zero counts in the Flink Dashboard. Cluster setups show zero-counts all around. -aj On Thu, Sep 15, 2016 at 12:41 PM, AJ Heller wrote: > I'm running a standalone cluster on Amazon

ResourceManager not using correct akka URI in standalone cluster (?)

2016-09-15 Thread AJ Heller
I'm running a standalone cluster on Amazon EC2. Leader election is happening according to the logs, and the Flink Dashboard is up and running, accessible remotely. The issue I'm having is that the SocketWordCount example is not working, the local connection is being refused! In the Flink Dashboard