Re: Building Flink takes long time now =(

2015-03-13 Thread Stephan Ewen
Hey Henry! Recently, the compilation process was changed to use the maven shade plugin for all projects. This helps to hide libraries that often conflict with versions used by user code (Guava, ASM, netty) and provide a smoother Flink experience for users. Robert documented it in the wiki as well

[jira] [Created] (FLINK-1699) Co-task sometimes returns null

2015-03-13 Thread JIRA
Gábor Hermann created FLINK-1699: Summary: Co-task sometimes returns null Key: FLINK-1699 URL: https://issues.apache.org/jira/browse/FLINK-1699 Project: Flink Issue Type: Bug Compon

Re: [DISCUSS] Make a release to be announced at ApacheCon

2015-03-13 Thread Robert Metzger
I've reopened https://issues.apache.org/jira/browse/FLINK-1650 because the issue is still occurring. On Thu, Mar 12, 2015 at 7:05 PM, Ufuk Celebi wrote: > On Thursday, March 12, 2015, Till Rohrmann > wrote: > > > Have you run the 20 builds with the new shading code? With new shading > the > > T

[jira] [Created] (FLINK-1700) Include Google Analytics in Javadocs

2015-03-13 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1700: - Summary: Include Google Analytics in Javadocs Key: FLINK-1700 URL: https://issues.apache.org/jira/browse/FLINK-1700 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-1701) Serialization problems with TestStreamEnvironment

2015-03-13 Thread JIRA
Péter Szabó created FLINK-1701: -- Summary: Serialization problems with TestStreamEnvironment Key: FLINK-1701 URL: https://issues.apache.org/jira/browse/FLINK-1701 Project: Flink Issue Type: Bug

Re: Building Flink takes long time now =(

2015-03-13 Thread Henry Saputra
Hi Stephan, Yep, i am aware abt the new shade changes. Didn't expect the latency addition would be so large :( On Friday, March 13, 2015, Stephan Ewen wrote: > Hey Henry! > > Recently, the compilation process was changed to use the maven shade plugin > for all projects. This helps to hide libra

Re: [jira] [Commented] (FLINK-1659) Rename classes and packages that contains Pact

2015-03-13 Thread Fabian Hueske
+1 for Optimizer 2015-03-13 16:01 GMT+01:00 Henry Saputra (JIRA) : > > [ > https://issues.apache.org/jira/browse/FLINK-1659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360462#comment-14360462 > ] > > Henry Saputra commented on FLINK-1659: > ---

[jira] [Created] (FLINK-1702) Authenticate via Kerberos from the client only

2015-03-13 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-1702: - Summary: Authenticate via Kerberos from the client only Key: FLINK-1702 URL: https://issues.apache.org/jira/browse/FLINK-1702 Project: Flink Issue

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-13 Thread Maximilian Michels
Hi Aljoscha, Thanks for starting the discussion. We should definitely not keep flink-expressions. I'm in favor of DataTable for the DataSet abstraction equivalent. For consistency, the package name should then be flink-table. At first sight, the name seems kind of plain but I think it is quite in

[jira] [Created] (FLINK-1703) option to balance load according to CPU available rather than slots available

2015-03-13 Thread Emmanuel Leroy (JIRA)
Emmanuel Leroy created FLINK-1703: - Summary: option to balance load according to CPU available rather than slots available Key: FLINK-1703 URL: https://issues.apache.org/jira/browse/FLINK-1703 Project

Re: Building Flink takes long time now =(

2015-03-13 Thread Henry Saputra
In my MBP (OSX) is about 40mins to do mvn clean install -DskipTests now =( Is this about ball park with others or just my machine? Somehow in my Linux box is about 8 mins, which is surprising. - Henry On Fri, Mar 13, 2015 at 1:03 AM, Stephan Ewen wrote: > Hey Henry! > > Recently, the compilati

Re: Building Flink takes long time now =(

2015-03-13 Thread Fabian Hueske
Just ran "mvn clean install -DskipTests" in 6:46min on my MBP. So 8mins on Linux sounds more reasonable than 40mins. Without skipping tests it should be around 18min. 2015-03-13 19:03 GMT+01:00 Henry Saputra : > In my MBP (OSX) is about 40mins to do mvn clean install -DskipTests now =( > > Is thi

[jira] [Created] (FLINK-1704) Change AbstractFlinkYarnClient from abstract to interface

2015-03-13 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1704: Summary: Change AbstractFlinkYarnClient from abstract to interface Key: FLINK-1704 URL: https://issues.apache.org/jira/browse/FLINK-1704 Project: Flink Issue

Re: Building Flink takes long time now =(

2015-03-13 Thread Henry Saputra
Thanks Fabian, now I know something wrong with my machine =( On Fri, Mar 13, 2015 at 11:18 AM, Fabian Hueske wrote: > Just ran "mvn clean install -DskipTests" in 6:46min on my MBP. So 8mins on > Linux sounds more reasonable than 40mins. > Without skipping tests it should be around 18min. > > 201

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-13 Thread Stephan Ewen
We already have checkstyle for Java and Scala in place (with marking violations a breaking the build). The rules in Java are very loose, though. We may make them stricter. Would require extensive passes over a lot of code, though, to fix this. The other things (choice of library) seem to be well

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-13 Thread Henry Saputra
Regarding style, yes, we already have them in place but they are very loose, especially in Java. I guess it is a "no good deed goes unpunished" scenario. To tighten up the style rules, for example following Google Java style with some documented exceptions, will require massive code changes. But w

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-13 Thread Fabian Hueske
I personally find the Google code style to be too strict/detailed. Loosening it by dropping certain rules makes only sense if the deviation does not become to large. My major concern with adding a such strict code style is that all open PRs would become invalid. We could try to reduce that effect

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-13 Thread Henry Saputra
Agree. We have make decision either to play tight or loose on the code style and guide. Once the codebase is getting too large and more committers coming in then it would be too late. We can not have our cake and eat it too. Looking forward to what others think since I already have my 2-cents ou

Re: Could not build up connection to JobManager

2015-03-13 Thread Dulaj Viduranga
Hi, Still this is no luck. I’ll upload the logs with configuration “localhost" as well as “127.0.0.1” so you can take a look. 127.0.0.1 flink-Vidura-flink-client-localhost.log localhost flink-V