Re: Turn lazy operator execution off for streaming jobs

On 22 Jan 2015, at 18:10, Stephan Ewen wrote: > So the crux is that the JobManager has a location for the sender task (and > tell that to the receivers) before the senders have registered their > transfer queues. > > Can we just establish a "happens-before" there? > - The TaskManager may send th

Re: Turn lazy operator execution off for streaming jobs

Great, thanks! It was fast :) I will try to check it out in the afternoon! Gyula On Fri, Jan 23, 2015 at 11:37 AM, Ufuk Celebi wrote: > On 22 Jan 2015, at 18:10, Stephan Ewen wrote: > > > So the crux is that the JobManager has a location for the sender task > (and > > tell that to the receive

Re: Turn lazy operator execution off for streaming jobs

Hey, I checked it with our examples, it seems to working properly and exactly how we wanted :). One minor thing, we have a jira open for this so if you could put that in the commit message that would be good. https://issues.apache.org/jira/browse/FLINK-1425 Thanks! Gyula On Fri, Jan 23, 2015 a

[jira] [Created] (FLINK-1438) ClassCastException for Custom InputSplit in local mode

Fabian Hueske created FLINK-1438: Summary: ClassCastException for Custom InputSplit in local mode Key: FLINK-1438 URL: https://issues.apache.org/jira/browse/FLINK-1438 Project: Flink Issue Ty

[jira] [Created] (FLINK-1439) Enable all YARN tests on Travis

Robert Metzger created FLINK-1439: - Summary: Enable all YARN tests on Travis Key: FLINK-1439 URL: https://issues.apache.org/jira/browse/FLINK-1439 Project: Flink Issue Type: Improvement

Tweets Custom Input Format

Hi, I have created a custom InputFormat for tweets on Flink, based on JSON-Simple event driven parser. I would like to contribute my work into Flink, Regards. -- Mustafa Elbehery EIT ICT Labs Master School +49(0)15218676094 skype: mustafaelbehery87

Re: Tweets Custom Input Format

Contributions are welcomed! Here is the link on how to contribute to Apache Flink: http://flink.apache.org/how-to-contribute.html You can start by creating JIRA ticket [1] to help describe what you wanted to do and to get feedback from community. - Henry [1] https://issues.apache.org/jira/secu

Naming of semantic annotations

Hi all, I have a pending pull request (#311) to fix and enable semantic information for functions with nested and Pojo types. Semantic information is used to tell the optimizer about the behavior of user-defined functions. The optimizer can use this information to generate more efficient execution

Re: Naming of semantic annotations

Hi, +1 for ForwardedFields. I like it much more than ConstantFields. I think it makes it clear what the feature does. It's a very cool feature and indeed not advertised a lot. I use it when I remember, but most of the times I forget it exists ;) -V. On 23 January 2015 at 22:12, Fabian Hueske w

Re: Naming of semantic annotations

+1 ForwardedFields On 23.01.2015 22:38, Vasiliki Kalavri wrote: Hi, +1 for ForwardedFields. I like it much more than ConstantFields. I think it makes it clear what the feature does. It's a very cool feature and indeed not advertised a lot. I use it when I remember, but most of the times I forg

YARN ITCases fail, master broken?

Hi all, I tried to build the current master (mvn clean install) and some tests in the flink-yarn-tests module fail: Failed tests: YARNSessionCapacitySchedulerITCase.testClientStartup:50->YarnTestBase.runWithArgs:314 During the timeout period of 60 seconds the expected string did not show up

Re: YARN ITCases fail, master broken?

Did not see that trace but do see this: --- T E S T S --- Running org.apache.flink.yarn.UtilsTest log4j:WARN No such property [append] in org.apache.log4j.ConsoleAppender. Tests run: 1, Fa

Re: YARN ITCases fail, master broken?

Hmm, I think there could be some weird dependencies to get the Flink YARN uber jar. If you do "mvn clean install -DskipTests" then call "mvn test" all the tests passed. But if you directly call "mvn clean test" then you see the stack I have seen before. - Henry On Fri, Jan 23, 2015 at 3:35 PM,

[jira] [Created] (FLINK-1440) Missing plan visualizer image for http://flink.apache.org/docs/0.8/programming_guide.html page

Henry Saputra created FLINK-1440: Summary: Missing plan visualizer image for http://flink.apache.org/docs/0.8/programming_guide.html page Key: FLINK-1440 URL: https://issues.apache.org/jira/browse/FLINK-1440