OutputFormat vs SinkFunction

2016-02-07 Thread Nick Dimiduk
Heya, Is there a plan to consolidate these two interfaces? They appear to provide identical functionality, differing only in lifecycle management. I found myself writing an adaptor so I can consume an OutputFormat where a SinkFunction is expected; there's not much to it. This seems like code that

Error while reading binary file

2016-02-07 Thread Saliya Ekanayake
Hi, I was trying to read a simple binary file using SerializedInputFormat as suggested in a different thread, but encounters the following error. I tried to do what the exception suggests, but eventhough createInput() returns a DataSet object I couldn't find how to specify which file to read. Any

Re: Flink on YARN: Stuck on "Trying to register at JobManager"

2016-02-07 Thread Pieter Hameete
I found the relevant information on the website. Ill consult with the cluster admin tomorrow, thanks for the help :-) - Pieter 2016-02-07 19:31 GMT+01:00 Robert Metzger : > Hi, > > we had other users with a similar issue as well. There is a configuration > value which allows you to specify a sin

Re: Flink on YARN: Stuck on "Trying to register at JobManager"

2016-02-07 Thread Robert Metzger
Hi, we had other users with a similar issue as well. There is a configuration value which allows you to specify a single port or a range of ports for the JobManager to allocate when running on YARN. Note that when using this with a single port, the JMs may collide. On Sun, Feb 7, 2016 at 7:25 P

Re: Flink on YARN: Stuck on "Trying to register at JobManager"

2016-02-07 Thread Pieter Hameete
Hi Stephan, surely it seems this way! I must not be the first with this issue though? I'll have to contact the cluster admins to find a solution together. What would be a way of make the JobManagers accessible from outside the network, because the IP and port number changes every time. Alternativ