Re: Want Flink startup issues :-)

2016-02-05 Thread Dongwon Kim
Hi Fabian, Matthias, Robert! Thank you for welcoming me to the community :-) I'm taking a look at JIRA and "How to contribute" as you guys suggested. One trivial question is whether I just need to make a pull request after figuring out issues? Then I'll pick up any issue, figure it out, and then m

Re: Want Flink startup issues :-)

2016-02-05 Thread Robert Metzger
Hi Dongwon Kim, its great to see you here. I really enjoyed your talk at Flink Forward, you did very good and detailed research on the different systems! (Those who didn't see the talk: go watch it on YouTube). Maybe you are interested in working on improving our monitoring / metrics system. Peop

Re: Want Flink startup issues :-)

2016-02-05 Thread Matthias J. Sax
Hi Dongwon, very cool that you decided to join the community. Btw: very nice talk at Flink Forward! Fabian pointed out the most important things already. On more thing I wanted to add (just in case you are not aware of it already). There is a "How to contribute" section on the Flink web page: ht

Re: Want Flink startup issues :-)

2016-02-05 Thread Fabian Hueske
Hi Dongwon, welcome to the Flink mailing list! What kind of issues are you interested in? - API / library features: DataSet API, DataStream API, SQL, StreamSQL, Graphs (Gelly) - Processing runtime: Batch, Streaming - Connectors to other systems: Stream sources/sinks - Web dashboard - Compatibilit

Re: [ANNOUNCE] Please annotate public interfaces!

2016-02-05 Thread Fabian Hueske
Hi, @Experimental and @Internal have the class scope, because we need to be able to mark internal classes of @Public classes as experimental or internal. In some cases we annotated classes as @Public and all (or most) methods as @Experimental, to indicate that a class can be used, but its interna

[jira] [Created] (FLINK-3349) planVisualizer doesn't work!

2016-02-05 Thread Riccardo Diomedi (JIRA)
Riccardo Diomedi created FLINK-3349: --- Summary: planVisualizer doesn't work! Key: FLINK-3349 URL: https://issues.apache.org/jira/browse/FLINK-3349 Project: Flink Issue Type: Bug Affects

[jira] [Created] (FLINK-3348) taskmanager.memory.off-heap missing bc documentation

2016-02-05 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-3348: - Summary: taskmanager.memory.off-heap missing bc documentation Key: FLINK-3348 URL: https://issues.apache.org/jira/browse/FLINK-3348 Project: Flink

Re: DataExchangeMode.BATCH in iterations

2016-02-05 Thread Stephan Ewen
Hi! Flink has a non-batch exchange way to break pipelines, which is by now quite custom for iterations. It is used there for constructs that fork and re-join the flow. The proper batch-exchange is better, because the scheduler can exploit that, but is is not yet usable in iterations. Stephan

Re: [ANNOUNCE] Please annotate public interfaces!

2016-02-05 Thread Maximilian Michels
Hi Robert, Thanks a lot for all the work of going through the classes. At first sight, the classes look quite well chosen. One question concerning the @Public, @Experimental, and @Internal annotations: @Public may only be used for classes or interfaces. @Experimental or @Internal are used for ma

Want Flink startup issues :-)

2016-02-05 Thread Dongwon Kim
Hello, I'm Dongwon Kim and I want to get involved in Flink community. Can anyone guide me through contributing to Flink with some startup issues? Although my research interest lie in big data systems including Flink, Spark, MapReduce, and Tez, I've never participated in open source communities. F

[jira] [Created] (FLINK-3347) TaskManager ActorSystems need to restart themselves in case they notice quarantine

2016-02-05 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3347: --- Summary: TaskManager ActorSystems need to restart themselves in case they notice quarantine Key: FLINK-3347 URL: https://issues.apache.org/jira/browse/FLINK-3347 Projec

[jira] [Created] (FLINK-3346) Replace Akka death watch with own heartbeats

2016-02-05 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3346: Summary: Replace Akka death watch with own heartbeats Key: FLINK-3346 URL: https://issues.apache.org/jira/browse/FLINK-3346 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-3345) Restart TaskManager in case of a Akka quarantine event

2016-02-05 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3345: Summary: Restart TaskManager in case of a Akka quarantine event Key: FLINK-3345 URL: https://issues.apache.org/jira/browse/FLINK-3345 Project: Flink Issue Ty

[ANNOUNCE] Please annotate public interfaces!

2016-02-05 Thread Robert Metzger
Hi, tl;dr: we now have @Public, @Internal, @Experimental annotations. Check your stuff before the release! Fabian and I spend some time the last weeks to annotate all classes we consider to be userfacing and stable with the "*@Public*" annotation. I just pushed those changes to master. There is

Re: [VOTE] Release Apache Flink 0.10.2 (RC1)

2016-02-05 Thread Fabian Hueske
Fair enough 2016-02-05 14:09 GMT+01:00 Stephan Ewen : > I would also be in favor of continuing the RC, if we find nothing more > problematic > > On Fri, Feb 5, 2016 at 1:51 PM, Maximilian Michels wrote: > > > Thanks for the RC. The documentation version is a really minor issue > > which most peo

Re: [VOTE] Release Apache Flink 0.10.2 (RC1)

2016-02-05 Thread Stephan Ewen
I would also be in favor of continuing the RC, if we find nothing more problematic On Fri, Feb 5, 2016 at 1:51 PM, Maximilian Michels wrote: > Thanks for the RC. The documentation version is a really minor issue > which most people won't even notice because they use the online > documentation. I

Re: [VOTE] Release Apache Flink 0.10.2 (RC1)

2016-02-05 Thread Maximilian Michels
Thanks for the RC. The documentation version is a really minor issue which most people won't even notice because they use the online documentation. I wouldn't create a new RC just for fixing that. On Fri, Feb 5, 2016 at 12:45 PM, Ufuk Celebi wrote: > >> On 05 Feb 2016, at 12:17, Fabian Hueske wr

[jira] [Created] (FLINK-3344) EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow

2016-02-05 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-3344: -- Summary: EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow Key: FLINK-3344 URL: https://issues.apache.org/jira/browse/FLINK-3344 Project: Fli

Re: New instable test?

2016-02-05 Thread Matthias J. Sax
And another one: https://travis-ci.org/mjsax/flink/jobs/107198383 This time it's EventTimeWindowCheckpointingITCase.testPreAggregatedTumblingTimeWindow -Matthias On 02/05/2016 11:06 AM, Matthias J. Sax wrote: > Hi, > > I had a failing build last night: > https://travis-ci.org/apache/flink/jobs

[jira] [Created] (FLINK-3343) Exception while using Kafka 0.9 connector

2016-02-05 Thread Farouk Salem (JIRA)
Farouk Salem created FLINK-3343: --- Summary: Exception while using Kafka 0.9 connector Key: FLINK-3343 URL: https://issues.apache.org/jira/browse/FLINK-3343 Project: Flink Issue Type: Improvemen

Re: [VOTE] Release Apache Flink 0.10.2 (RC1)

2016-02-05 Thread Ufuk Celebi
> On 05 Feb 2016, at 12:17, Fabian Hueske wrote: > > I compared the RC1 branch to the release-0.10.2 tag and went over the diff > (less than 2k changed lines, mostly added tests). > > Issues: > - the docs/_config.yml needs to be updated to version 0.10.2 > > Added / changed dependencies in pom

Re: [VOTE] Release Apache Flink 0.10.2 (RC1)

2016-02-05 Thread Fabian Hueske
I compared the RC1 branch to the release-0.10.2 tag and went over the diff (less than 2k changed lines, mostly added tests). Issues: - the docs/_config.yml needs to be updated to version 0.10.2 Added / changed dependencies in pom files: - Kryo was added to flink-storm - ASM was added to flink-gel

[jira] [Created] (FLINK-3342) Operator checkpoint statistics state size overflow

2016-02-05 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-3342: -- Summary: Operator checkpoint statistics state size overflow Key: FLINK-3342 URL: https://issues.apache.org/jira/browse/FLINK-3342 Project: Flink Issue Type: Bug

New instable test?

2016-02-05 Thread Matthias J. Sax
Hi, I had a failing build last night: https://travis-ci.org/apache/flink/jobs/107116079 > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 21.782 sec > <<< FAILURE! - in org.apache.flink.runtime.client.JobClientActorRecoveryITCase > testJobClientRecovery(org.apache.flink.runtime.c