Re: The newest roadmap of Flink

2015-01-18 Thread Kostas Tzoumas
Here is the google doc (currently under discussion): https://docs.google.com/document/d/1QZ0NJC03pOBqE6vbK1Ot4bXwoBcszIqzbZ8a6B5vSEo/edit#heading=h.hvpyxfkne3db On Mon, Jan 19, 2015 at 3:34 AM, zhuyuqi wrote: > Hi, developers > Could some one tell that the newest roadmap address on Google Doc?

The newest roadmap of Flink

2015-01-18 Thread zhuyuqi
Hi, developers Could some one tell that the newest roadmap address on Google Doc? Best Regards. Zhu yuqi

[jira] [Created] (FLINK-1418) Make 'print()' output on the client command line, rather than on the task manager sysout

2015-01-18 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1418: --- Summary: Make 'print()' output on the client command line, rather than on the task manager sysout Key: FLINK-1418 URL: https://issues.apache.org/jira/browse/FLINK-1418

API behavior with data sinks (lazy) and eager operations

2015-01-18 Thread Stephan Ewen
Hi there! With the upcoming more interactive extensions to the API (operations that go back to the client from a program and need to be eagerly evaluated) we need to define how different actions should behave. Currently, nothing gets executed until the "env.execute()" call is made. That allows to

[jira] [Created] (FLINK-1417) Automatically register nested types at Kryo

2015-01-18 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1417: --- Summary: Automatically register nested types at Kryo Key: FLINK-1417 URL: https://issues.apache.org/jira/browse/FLINK-1417 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-1416) Dependency versions in quickstart archetypes are wrong

2015-01-18 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1416: --- Summary: Dependency versions in quickstart archetypes are wrong Key: FLINK-1416 URL: https://issues.apache.org/jira/browse/FLINK-1416 Project: Flink Issue Type

[jira] [Created] (FLINK-1415) Akka cleanups

2015-01-18 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1415: Summary: Akka cleanups Key: FLINK-1415 URL: https://issues.apache.org/jira/browse/FLINK-1415 Project: Flink Issue Type: Improvement Reporter: Til

[jira] [Created] (FLINK-1414) Remove quickstart-*.sh from git source and put them to the website's svn

2015-01-18 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1414: - Summary: Remove quickstart-*.sh from git source and put them to the website's svn Key: FLINK-1414 URL: https://issues.apache.org/jira/browse/FLINK-1414 Project: Fli

Re: Future directions for Flink’s YARN support?

2015-01-18 Thread Stephan Ewen
Concerning (3), we could go for something like Tez does. You can configure a HDFS directory with the Tez jars, from where they are referenced. Then, the "install" would be uploading the jars and setting the config value. We could even add a script for that. Stephan On Sun, Jan 18, 2015 at 7:00 P

[jira] [Created] (FLINK-1413) Add option to YARN client to use already deployed uberjar/flink files instead of redeploying on each YARN session

2015-01-18 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1413: - Summary: Add option to YARN client to use already deployed uberjar/flink files instead of redeploying on each YARN session Key: FLINK-1413 URL: https://issues.apache.org/jira/br

Re: Future directions for Flink’s YARN support?

2015-01-18 Thread Robert Metzger
Hi Daniel, let me answer your questions: 1. Basically all features you are requesting are implemented in this pull request: https://github.com/apache/flink/pull/292 (Per Job YARN cluster & programmatical control of the cluster). Feel free to review the pull request. It is pending for more than one

Re: Future directions for Flink’s YARN support?

2015-01-18 Thread Stephan Ewen
Hi Daniel! Thank you for your thoughts, those are good comments! I am sure Robert can elaborate more, but here are some answers on how I understand things: Concerning (1) Support for that (per-job yarn sessions and programmatic setup/teardown) is in the making and a first version is on a pull req

Re: [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Henry Saputra
Ah, you are right. I was replying with my phone and did not check the subject properly =( @Marton: Mea culpa from me about the result email. It was my fault. @Robert: It is not legal requirement, but more from ASF infra to help searching and building tools to manage VOTE-RESULT threads. - Henry

Re: Future directions for Flink’s YARN support?

2015-01-18 Thread Alexander Alexandrov
Hi Daniel, I think at least regarding 3 threre is a quick fix in the pom.xml - we need to exclude the hadoop-* artifacts from the shader plugin. I think Robert can confirm whether this is the case. Regards, Alexander 2015-01-18 18:28 GMT+01:00 Daniel Warneke : > Hi, > > I just pushed my first

Future directions for Flink’s YARN support?

2015-01-18 Thread Daniel Warneke
Hi, I just pushed my first version of Flink supporting YARN environments with security/Kerberos enabled [1]. While working with the current Flink version, I was really impressed by how easy it is to deploy the software on a YARN cluster. However, there are a few things a stumbled upon and I w

Re: [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Robert Metzger
I think Marton send the result mail with a [RESULT] in the subject line. Have a look at this screenshot: http://img42.com/G3yPF It is a legal requirement by Apache to put the [RESULT] string a the beginning of the subject line? On Sun, Jan 18, 2015 at 5:43 PM, Henry Saputra wrote: > Thanks for b

Re: [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Henry Saputra
Thanks for being awesome RE. Usually the tally up vote result is sent out with modified subject by prefixing with [RESULT]. @Marton, Could you resend the result with modified subject? - Henry On Sunday, January 18, 2015, Márton Balassi wrote: > The vote has passed with +6 binding votes from t

Re: [RESULT] [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Stephan Ewen
BTW: Márton, you are allowed to +1 your own release candidate... Am 18.01.2015 06:28 schrieb "Márton Balassi" : > The vote has passed with +6 binding votes from the PMC. > +1 votes are from: > > Aljoscha Krettek > Robert Metzger > Vasiliki Kalavri > Henry Saputra > Fabian Hueske > Stephen Ewen > >

Re: [RESULT] [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Márton Balassi
The vote has passed with +6 binding votes from the PMC. +1 votes are from: Aljoscha Krettek Robert Metzger Vasiliki Kalavri Henry Saputra Fabian Hueske Stephen Ewen Thank you for checking the release. I'll publish the release now On Thu, Jan 15, 2015 at 12:10 PM, Márton Balassi wrote: > Pl

[jira] [Created] (FLINK-1412) Update Website Links - Optimizer Plan Visualization Tool

2015-01-18 Thread Felix Neutatz (JIRA)
Felix Neutatz created FLINK-1412: Summary: Update Website Links - Optimizer Plan Visualization Tool Key: FLINK-1412 URL: https://issues.apache.org/jira/browse/FLINK-1412 Project: Flink Issue

Re: [VOTE] Release Apache Flink 0.8.0 (RC3)

2015-01-18 Thread Márton Balassi
@Till: [plan visualizer] Thanks for spotting it, let's fix it for 0.8.1. @Stephan: [inception year] Sorry, my bad. Will amend the commit in question when cherry-picking it to master. Neither one is a blocker on my side and the vote is over anyway. :) On Fri, Jan 16, 2015 at 10:12 PM, Stephan Ewen