[jira] [Created] (FLINK-1830) java.io.IOException: Network stream corrupted

2015-04-06 Thread Stefan Bunk (JIRA)
Stefan Bunk created FLINK-1830: -- Summary: java.io.IOException: Network stream corrupted Key: FLINK-1830 URL: https://issues.apache.org/jira/browse/FLINK-1830 Project: Flink Issue Type: Bug A

[QUESTION] Sort Key Types

2015-04-06 Thread Stephan Ewen
I as that a recent commit introduced the notion of sort key types, which have a well defined order. What is the difference to a regular key? Regular keys are also sortable, so why the distinction?

Re: Should collect() and count() be treated as data sinks?

2015-04-06 Thread Stephan Ewen
count() and collect() need to immediately trigger an execution, because the driver program cannot proceed otherwise. They are "eager". Regular sinks are "lazy", they wait until the program is triggered anyways. BTW: Should "print()" be also an "eager" statement? I think it needs to be, if we want

Re: Parquet Article / Tutorial

2015-04-06 Thread Stephan Ewen
Wow, very nice work! It looks impressive at first sight, no comments :-) Just one question: Do you want this to be a standalone tutorial, or are you thinking of putting this into the Flink wiki, or some code even into "flink-contrib" ? Stephan On Sun, Apr 5, 2015 at 3:30 PM, Felix Neutatz wro

Re: Storm compatibility layer for Flink (first beta available)

2015-04-06 Thread Matthias J. Sax
Done. Shall I open a pull request? -Matthias On 04/03/2015 09:32 PM, Robert Metzger wrote: > As far as I understood git rebase [1], cherry-picking all changes in order > to the current master is exactly equal to "git rebase flink/master". > The problem is that you have to resolve all conflicts a

Re: Storm compatibility layer for Flink (first beta available)

2015-04-06 Thread Márton Balassi
Thanks, Matthias. Yes, please. :) On Mon, Apr 6, 2015 at 3:40 PM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Done. Shall I open a pull request? > > -Matthias > > > On 04/03/2015 09:32 PM, Robert Metzger wrote: > > As far as I understood git rebase [1], cherry-picking all changes in

Re: Parquet Article / Tutorial

2015-04-06 Thread Felix Neutatz
The intention was to post it on the blog, but if you think it would better fit into the wiki, that would be also fine :) About the code: I have not thought about putting it to contrib-package, but I can. What do you think is suitable for flink-contrib? Best regards, Felix 2015-04-06 14:57 GMT+0

Too many log4j.properties files

2015-04-06 Thread Stephan Ewen
Hi all! I see that a lot of people are committing log4j.properties files in the compile scope of various projects. By now, when you start a flink application, you have multiple log4j.properties files in the classpath. ./flink-examples/flink-java-examples/src/main/resources/log4j.properties ./flin

Gelly message type

2015-04-06 Thread Yi ZHOU
I have a question about Gelly, can i use Tuple2 as message type?

Re: Gelly message type

2015-04-06 Thread Vasiliki Kalavri
Hi Yi Zhou, are you referring to the VertexCentricIteration's message type? If yes, sure, you can certainly use a Tuple2 there. For example, look at the community Detection library method [1]. It uses a Tuple2 as message type. -Vasia. [1]: https://github.com/apache/flink/blob/master/flink-stagin