Re: Extending and improving our "How to contribute" page

Thanks Fabian for starting the discussion. +1 for overall approach. About (1), expressing that consensus must be required for new feature in “How to contribute” page is very nice. Some pull requests were sent without consensus. The contributors had to rewrote their pull requests. Agree with (2

Re: [Proposal] Gelly Graph Generators

Hi Greg, thank you for this proposal! I think graph generators will be a very useful addition to Gelly. I'm not quite familiar with the state-of-the-art algorithms for distributed graph generation. I suppose that we could easily provide an efficient random graph generator and I've also seen some

[jira] [Created] (FLINK-2755) Cluster Execution - /home/user/udfs.jar

dengjie created FLINK-2755: -- Summary: Cluster Execution - /home/user/udfs.jar Key: FLINK-2755 URL: https://issues.apache.org/jira/browse/FLINK-2755 Project: Flink Issue Type: Wish Report

[jira] [Created] (FLINK-2756) start/stop scripts fail in directories with spaces

Fabian Hueske created FLINK-2756: Summary: start/stop scripts fail in directories with spaces Key: FLINK-2756 URL: https://issues.apache.org/jira/browse/FLINK-2756 Project: Flink Issue Type:

[jira] [Created] (FLINK-2757) DataSinkTaskTest fails on Windows

Fabian Hueske created FLINK-2757: Summary: DataSinkTaskTest fails on Windows Key: FLINK-2757 URL: https://issues.apache.org/jira/browse/FLINK-2757 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-2758) TaskManagerRegistrationTest fails on Windows

Fabian Hueske created FLINK-2758: Summary: TaskManagerRegistrationTest fails on Windows Key: FLINK-2758 URL: https://issues.apache.org/jira/browse/FLINK-2758 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2759) TaskManagerProcessReapingTest fails on Windows

Fabian Hueske created FLINK-2759: Summary: TaskManagerProcessReapingTest fails on Windows Key: FLINK-2759 URL: https://issues.apache.org/jira/browse/FLINK-2759 Project: Flink Issue Type: Bug

Re: [VOTE] Release Apache Flink 0.10.0-milestone-1 (RC1)

I found more issues with the release: - start/stop scripts do not work if the path contains spaces (FLINK-2756) - several tests fail when building Flink in Cygwin on Windows (FLINK-2757, FLINK-2758, FLINK-2759) The following checks passed: - Building Flink without tests in Cygwin on Windows - Sta

Flink's Checking and uploading JAR files Issue

Hello All I use Flink in order to filter data from Hdfs and write it back as CSV. I keep getting the "Checking and uploading JAR files" on every DataSet filtering action or executionEnvironment execution. I use ExecutionEnvironment.createRemoteEnvironment(ip+jars..) because I launch Flink from a

Re: Extending and improving our "How to contribute" page

Thanks everybody for feedback and comments. Regarding 1) and 2): I like the idea of keeping the discussion of new features and improvements in JIRA as Kostas proposed. Our coding guidelines [1] already request a JIRA issue for each pull request. How about we highlight this requirement more promi

Re: Flink's Checking and uploading JAR files Issue

I think there is not yet any mechanism, but it would be a good addition, I agree. Between JobManager and TaskManagers, the JARs are cached. The TaskManagers receive hashes of the JARs only, and only load them if they do not already have them. The same mechanism should be used for the Client to upl

[jira] [Created] (FLINK-2760) Avoid uploading of already existing jars from the JobClient

Till Rohrmann created FLINK-2760: Summary: Avoid uploading of already existing jars from the JobClient Key: FLINK-2760 URL: https://issues.apache.org/jira/browse/FLINK-2760 Project: Flink Is

Re: Flink's Checking and uploading JAR files Issue

Hi Hanan, you're right that currently every time you submit a job to the Flink cluster, all user code jars are uploaded and overwrite possibly existing files. This is not really necessary if they don't change. Maybe we should add a check that already existing files on the JobManager are not upload

Re: Flink 0.9 built with Scala 2.11

Just a note that FLINK-2200 has been resolved. All flink artifacts are now two times in the maven snapshot repository: one without a suffix (scala 2.10) and one with a suffix (_2.11 for scala 2.11). There is also a nightly _2.11 binary release for

Re: Flink's Checking and uploading JAR files Issue

Hi Thanks for the fast response I Have tried the walk-around by excluding the Jars from the RemoteEnvironment's init line : ExecutionEnvironment env = ExecutionEnvironment.createRemoteEnvironment(FLINK_URL, FLINK_PORT); instrad of : ExecutionEnvironment env = ExecutionEnvironment.createRemoteEnviro

Re: Flink's Checking and uploading JAR files Issue

My first guess would be that you did not put all jars into the lib folder. To help us understand this, do you start the cluster manually, or via YARN? On Thu, Sep 24, 2015 at 4:59 PM, Hanan Meyer wrote: > Hi > Thanks for the fast response > I Have tried the walk-around by excluding the Jars fro

[jira] [Created] (FLINK-2761) Prevent instantiation of new ExecutionEnvironments in the Scala Shell

Stephan Ewen created FLINK-2761: --- Summary: Prevent instantiation of new ExecutionEnvironments in the Scala Shell Key: FLINK-2761 URL: https://issues.apache.org/jira/browse/FLINK-2761 Project: Flink

[jira] [Created] (FLINK-2762) Job Runtime: -1 ms

Greg Hogan created FLINK-2762: - Summary: Job Runtime: -1 ms Key: FLINK-2762 URL: https://issues.apache.org/jira/browse/FLINK-2762 Project: Flink Issue Type: Bug Components: other Af

Re: Flink's Checking and uploading JAR files Issue

Hi I rechecked that I put all my Jars in the Lib folder . I have also noticed that it fails while loading my first Pojo class . I start the cluster via Yarn using Flink 0.9.1 . Thanks , Mr Hanan Meyer On Thu, Sep 24, 2015 at 6:08 PM, Stephan Ewen wrote: > My first guess would be that you di