Re: Adding non-core API features to Flink

2015-01-26 Thread Till Rohrmann
+1 for Robert's proposal. On Mon, Jan 26, 2015 at 5:43 AM, Henry Saputra wrote: > +1 for the idea. > > We need to make sure PMC of Flink maintains knowledge of standard > Flink distribution, hence the "flink-contrib" should not be part of > the release. > > - Henry > > On Sun, Jan 25, 2015 at 10

Re: Warning message in Scala type analysis

2015-01-26 Thread Aljoscha Krettek
The culprit seems to be this commit: https://github.com/apache/flink/commit/020b282bdc5468aa51b231e9ae8d4d3a1a76e696 It seems you took a commit from an unmerged PR of mine and changed it. Now the content does not match the Issue ID and also the LICENCE and NOTICE file are not correct anymore. The

Re: Cool project: H2O on Flink

2015-01-26 Thread Till Rohrmann
Great news. I think both project will benefit greatly from each other. I'm looking forward training some models using deep learning :-) On Sun, Jan 25, 2015 at 12:46 AM, Henry Saputra wrote: > This is great news, Kostas and Sri. > Looks like the visit was super useful =) > > I would love to hel

[jira] [Created] (FLINK-1452) Add "flink-contrib" maven module and README.md with the rules

2015-01-26 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1452: - Summary: Add "flink-contrib" maven module and README.md with the rules Key: FLINK-1452 URL: https://issues.apache.org/jira/browse/FLINK-1452 Project: Flink

Re: Adding non-core API features to Flink

2015-01-26 Thread Robert Metzger
I've added a JIRA issue to create the module: https://issues.apache.org/jira/browse/FLINK-1452 On Mon, Jan 26, 2015 at 11:39 AM, Till Rohrmann wrote: > +1 for Robert's proposal. > > On Mon, Jan 26, 2015 at 5:43 AM, Henry Saputra > wrote: > > > +1 for the idea. > > > > We need to make sure PMC

[jira] [Created] (FLINK-1453) Integration tests for YARN failing on OS X

2015-01-26 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1453: - Summary: Integration tests for YARN failing on OS X Key: FLINK-1453 URL: https://issues.apache.org/jira/browse/FLINK-1453 Project: Flink Issue Type: Bug

Re: Cool project: H2O on Flink

2015-01-26 Thread Vasiliki Kalavri
This is a very exciting project indeed! I believe there is interest from people at KTH to pick up this project. Will keep you updated ^^ Cheers, V. On 26 January 2015 at 11:58, Till Rohrmann wrote: > Great news. I think both project will benefit greatly from each other. > > I'm looking forward

Re: Adding non-core API features to Flink

2015-01-26 Thread Max Michels
+1 for having an optional flink-contrib maven dependency and an extension repository in the long run. On Mon, Jan 26, 2015 at 12:00 PM, Robert Metzger wrote: > I've added a JIRA issue to create the module: > https://issues.apache.org/jira/browse/FLINK-1452 > > > On Mon, Jan 26, 2015 at 11:39 AM,

[jira] [Created] (FLINK-1454) CliFrontend blocks for 100 seconds when submitting to a non-existent JobManager

2015-01-26 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1454: - Summary: CliFrontend blocks for 100 seconds when submitting to a non-existent JobManager Key: FLINK-1454 URL: https://issues.apache.org/jira/browse/FLINK-1454 Proje

Re: Webclient and visualizer support for streaming programs

2015-01-26 Thread Gyula Fóra
Any other comments on this? I would like to merge it soon, as it is a much more convenient testing environment than the command line :P Also we will have to start rethinking the job visualizer javascript to be able to properly graph streaming programs (more than 2 inputs etc) On Sat, Jan 24, 2015

[jira] [Created] (FLINK-1455) ExternalSortLargeRecordsITCase.testSortWithShortMediumAndLargeRecords: Potential Memory leak

2015-01-26 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1455: - Summary: ExternalSortLargeRecordsITCase.testSortWithShortMediumAndLargeRecords: Potential Memory leak Key: FLINK-1455 URL: https://issues.apache.org/jira/browse/FLINK-1455

Re: YARN ITCases fail, master broken?

2015-01-26 Thread Robert Metzger
With the help of Fabian and Ufuk, I was able to identify the issue for OS X. I already pushed the fix (see JIRA: https://issues.apache.org/jira/browse/FLINK-1453). Fabian is currently running the tests on the Ubuntu VM again. Lets see if that one is fixed as well or if its a different issue. On S

[jira] [Created] (FLINK-1456) Projection to fieldnames, keyselectors

2015-01-26 Thread JIRA
Márton Balassi created FLINK-1456: - Summary: Projection to fieldnames, keyselectors Key: FLINK-1456 URL: https://issues.apache.org/jira/browse/FLINK-1456 Project: Flink Issue Type: New Featur

Re: Warning message in Scala type analysis

2015-01-26 Thread Stephan Ewen
Ah, I see, thanks for the explanation. I picked the commit because I wanted the Joda in Scala tests in the system, but delay the serializer registration, as a discussion was still going on on the mailing list. So, the solution is simply to add the joda convert dependecy to the test scope as well?

Fwd: MODERATE for dev@flink.apache.org

2015-01-26 Thread Kostas Tzoumas
I am forwarding this as I could not approve it for some reason. Kostas -- Forwarded message -- From: Ankit Jhalaria To: "dev@flink.apache.org" Cc: Date: Mon, 26 Jan 2015 22:59:53 + (UTC) Subject: [Flink reading HDFS] : SIMPLE authentication is not enabled. Available:[TOKEN,

Re: MODERATE for dev@flink.apache.org

2015-01-26 Thread Henry Saputra
Ankit, Please subscribe to dev@ list by sending email to dev-subscr...@flink.apache.org [1] [1] http://flink.apache.org/community.html#mailing-lists On Mon, Jan 26, 2015 at 9:25 PM, Kostas Tzoumas wrote: > I am forwarding this as I could not approve it for some reason. > > Kostas > > >

Re: Future directions for Flink’s YARN support?

2015-01-26 Thread Stephan Ewen
Hi Ankit! Kerberos support is not yet in the system, but one of the Flink committers (Daniel Warneke) has made a prototype here: https://github.com/warneke/ flink/tree/security @Daniel Can you give us an update on the status? How do you think is missing before a first version is ready to be merg