Re: Scheduling in BATCH execution mode?

2015-09-10 Thread Niklas Semmler
Hello Ufuk, thanks that makes very much sense :). Best, Niklas On 09.09.2015 23:22, Ufuk Celebi wrote: On 09 Sep 2015, at 19:31, Niklas Semmler wrote: Hello Ufuk, thanks for you amazingly quick reply. I have seen the markFinished in Execution.java, but if I get it right, this is simply

[jira] [Created] (FLINK-2651) Failing NettyServerLowAndHighWatermarkTest

2015-09-10 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-2651: -- Summary: Failing NettyServerLowAndHighWatermarkTest Key: FLINK-2651 URL: https://issues.apache.org/jira/browse/FLINK-2651 Project: Flink Issue Type: Bug Affe

[jira] [Created] (FLINK-2652) Failing PartitionRequestClientFactoryTest

2015-09-10 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-2652: -- Summary: Failing PartitionRequestClientFactoryTest Key: FLINK-2652 URL: https://issues.apache.org/jira/browse/FLINK-2652 Project: Flink Issue Type: Bug

Re: Releasing 0.10.0-milestone1

2015-09-10 Thread Fabian Hueske
I can take the role of the release manager and push the 0.10 milestone release forward. I added a list of pending fixes for 0.10 to the wiki: https://cwiki.apache.org/confluence/display/FLINK/0.10+Release Please extend the list (or respond to this thread) if you have more fixes that should go into

Re: Releasing 0.10.0-milestone1

2015-09-10 Thread Robert Metzger
Thank you very much for taking care of the release management! I'm not sure whether it makes sense to block a "preview" release on so many bug fixes. It feels like 80% of our commits are bugfixes or stability improvements anyways, so we would wait infinitely to release the milestone if we wait for

Re: Releasing 0.10.0-milestone1

2015-09-10 Thread Fabian Hueske
All these bugs reported by users and its just four of them of which 2 are already fixed. It should be possible to fix them in a day. 2015-09-10 11:19 GMT+02:00 Robert Metzger : > Thank you very much for taking care of the release management! > > I'm not sure whether it makes sense to block a "pre

Re: Build failure with maven-junction-plugin

2015-09-10 Thread Matthias J. Sax
Hi, I am picking up on this old thread, because I have the same error now. I just created a new branch from a freshly rebased master branch. mvn -DskipTests clean install > Failed to execute goal com.pyx4j:maven-junction-plugin:1.0.3:link (default) > on project flink-dist: Can't create junction

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-10 Thread Behrouz Derakhshan
Hi, So my understanding was that the changes are only meant for flink-examples package. But each package has its own set of examples. And all of them has to be changed. Is that OK? @Ufuk: I agree, I create a ticket for adding Javadocs. BR, Behrouz On Wed, Sep 9, 2015 at 3:53 PM, Maximilian Mic

Re: Build failure with maven-junction-plugin

2015-09-10 Thread Matthias J. Sax
I could resolve this by manually deleting the link "/home/mjsax/workspace_flink_asf/flink-asf/build-target" But I still don't understand why this is necessary... On 09/10/2015 12:14 PM, Matthias J. Sax wrote: > Hi, > > I am picking up on this old thread, because I have the same error now. I > ju

Re: Releasing 0.10.0-milestone1

2015-09-10 Thread Matthias J. Sax
I justed opened a PR for FLINK-2632: "Web Client does not respect the class loader of submitted jobs" https://github.com/apache/flink/pull/1114 -Matthias On 09/10/2015 11:49 AM, Fabian Hueske wrote: > All these bugs reported by users and its just four of them of which 2 are > already fixed. > I

Re: Build failure with maven-junction-plugin

2015-09-10 Thread Stephan Ewen
Did you do a "clean" together with the "install"? Then it should work. The problem occurred when you switch between versions where the link is set (0.9+) and versions prior to the link (< 0.9) ... Stephan On Thu, Sep 10, 2015 at 1:37 PM, Matthias J. Sax wrote: > I could resolve this by manual

Re: Build failure with maven-junction-plugin

2015-09-10 Thread Maximilian Michels
The junction plugin could not create the link "build-target" to the build directory in flink-dist. Maybe this is a permission problem. You could have turned on the Maven debug mode to see the underlying exception. On Thu, Sep 10, 2015 at 1:37 PM, Matthias J. Sax wrote: > I could resolve this by m

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-10 Thread Maximilian Michels
I think the primary concern was flink-examples but if you're on it, you can also modify the other examples. On Thu, Sep 10, 2015 at 12:43 PM, Behrouz Derakhshan wrote: > Hi, > > So my understanding was that the changes are only meant for flink-examples > package. But each package has its own set

[jira] [Created] (FLINK-2653) Enable object reuse in MergeIterator

2015-09-10 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2653: - Summary: Enable object reuse in MergeIterator Key: FLINK-2653 URL: https://issues.apache.org/jira/browse/FLINK-2653 Project: Flink Issue Type: Improvement

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-10 Thread Behrouz Derakhshan
Well the problem is that "YARNSessionFIFOITCase" is testing Yarn by running *word count* example using multiple jar files. So what happens is that, the test is calling this : Runner runner = startWithArgs(new String[]{"run", "-m", "yarn-cluster", "-yj", flinkUberjar.getAbsolutePath(),

[jira] [Created] (FLINK-2654) Add JavaDoc to ParameterTool class

2015-09-10 Thread Behrouz Derakhshan (JIRA)
Behrouz Derakhshan created FLINK-2654: - Summary: Add JavaDoc to ParameterTool class Key: FLINK-2654 URL: https://issues.apache.org/jira/browse/FLINK-2654 Project: Flink Issue Type: Improv

Flink ML source code

2015-09-10 Thread Hanan Meyer
Hi I would like to implement an Anova algorithm based on Flink's ML library. Unfortunately I can't find the Flink 0.10 source code . Is there a any way to get the code ? In case that I'll manage to implement my idea I'll share it with the community of course ... Thanks , Hanan Meyer

[jira] [Created] (FLINK-2655) Minimize intermediate merging of spilled buffers

2015-09-10 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2655: - Summary: Minimize intermediate merging of spilled buffers Key: FLINK-2655 URL: https://issues.apache.org/jira/browse/FLINK-2655 Project: Flink Issue Type: Improvem

Re: Flink ML source code

2015-09-10 Thread Robert Metzger
Hi, you can find the Flink ML source code here: https://github.com/apache/flink/tree/master/flink-staging/flink-ml On Thu, Sep 10, 2015 at 4:12 PM, Hanan Meyer wrote: > Hi > > I would like to implement an Anova algorithm based on Flink's ML library. > Unfortunately I can't find the Flink 0.10 s

[jira] [Created] (FLINK-2656) FlinkKafkaConsumer is failing with OutOfRangeException

2015-09-10 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2656: - Summary: FlinkKafkaConsumer is failing with OutOfRangeException Key: FLINK-2656 URL: https://issues.apache.org/jira/browse/FLINK-2656 Project: Flink Issue

Re: Build failure with maven-junction-plugin

2015-09-10 Thread Matthias J. Sax
Thanks for the feedback. I doubt that it is a permission problem, because everything is executed with the same user... Unfortunately, after deleting the link manually, I cannot reproduce the error any more... Btw: the error occurred with "mvn -DskipTests clean install" as well as "mvn clean" foll

[jira] [Created] (FLINK-2657) Fix WebClient and CLI interaction

2015-09-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2657: --- Summary: Fix WebClient and CLI interaction Key: FLINK-2657 URL: https://issues.apache.org/jira/browse/FLINK-2657 Project: Flink Issue Type: Bug Compo

Re: Releasing 0.10.0-milestone1

2015-09-10 Thread Robert Metzger
Since the vote has not been started yet, we might consider including this critical fix for the Kafka consumer into 0.10-milestone1: https://github.com/apache/flink/pull/1117 On Thu, Sep 10, 2015 at 1:54 PM, Matthias J. Sax wrote: > I justed opened a PR for FLINK-2632: "Web Client does not respec

Blog Posts

2015-09-10 Thread Matthias J. Sax
Hi, I had a look into "Writing a Blog Post" (https://cwiki.apache.org/confluence/display/FLINK/Writing+a+Blog+Post) In the Wiki the "categories" tag indicates "blog". I was looking into the existing posts and all of them have "news" instead of "blog" as "categories". Thus, I am wondering what th

Re: Blog Posts

2015-09-10 Thread Robert Metzger
Hi, I guess nobody is really following the rules ;) (and or using an existing post as a template) I think the tag determines the first part after apache.org/ in the url ( http://flink.apache.org/news/2015/08/24/introducing-flink-gelly.html). Maybe we can update the wiki article to reflect the de