Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Henry Saputra
Ah the Tweet infra bot just announce extended downtime for Confluence [1] - Henry [1] https://twitter.com/infrabot/status/578983473970475008 On Fri, Mar 20, 2015 at 11:27 AM, Stephan Ewen wrote: > For me as well. Earlier today it said "down for maintenance" > > On Fri, Mar 20, 2015 at 7:14 PM,

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Stephan Ewen
For me as well. Earlier today it said "down for maintenance" On Fri, Mar 20, 2015 at 7:14 PM, Kostas Tzoumas wrote: > it's down for me as well > > On Fri, Mar 20, 2015 at 7:12 PM, Henry Saputra > wrote: > > > Is the wiki down for any of you? > > > > I can't access > > https://cwiki.apache.org/c

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Kostas Tzoumas
it's down for me as well On Fri, Mar 20, 2015 at 7:12 PM, Henry Saputra wrote: > Is the wiki down for any of you? > > I can't access > https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home > > 404 > > - Henry > > On Fri, Mar 20, 2015 at 4:46 AM, Kostas Tzoumas > wrote: > > I added

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Henry Saputra
Is the wiki down for any of you? I can't access https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home 404 - Henry On Fri, Mar 20, 2015 at 4:46 AM, Kostas Tzoumas wrote: > I added a document for data exchange between tasks: > https://cwiki.apache.org/confluence/display/FLINK/Data

[jira] [Created] (FLINK-1765) Reducer grouping is skippted when parallelism is one

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1765: --- Summary: Reducer grouping is skippted when parallelism is one Key: FLINK-1765 URL: https://issues.apache.org/jira/browse/FLINK-1765 Project: Flink Issue Type:

[jira] [Created] (FLINK-1764) Rework record copying logic in streaming API

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1764: --- Summary: Rework record copying logic in streaming API Key: FLINK-1764 URL: https://issues.apache.org/jira/browse/FLINK-1764 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-1763) Remove "cancel" from streaming SinkFunction

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1763: --- Summary: Remove "cancel" from streaming SinkFunction Key: FLINK-1763 URL: https://issues.apache.org/jira/browse/FLINK-1763 Project: Flink Issue Type: Improveme

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Henry Saputra
I don't think so. But adding new contributors wiki username to edit is much easier to merging changes to website, I hope. - Henry On Fri, Mar 20, 2015 at 8:53 AM, Maximilian Michels wrote: > +1 for the initiative and for the wiki. > > At the moment, the wiki's barrier to entry is like the git re

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Maximilian Michels
+1 for the initiative and for the wiki. At the moment, the wiki's barrier to entry is like the git repository's. Contributors need to explicitly ask comitters for access to the wiki. Is there a way we could open up the wiki for contributors without having to face too much spam? (e.g. have changes

[jira] [Created] (FLINK-1762) Make Statefulness of a Streaming Function explicit

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1762: --- Summary: Make Statefulness of a Streaming Function explicit Key: FLINK-1762 URL: https://issues.apache.org/jira/browse/FLINK-1762 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-1761) IndexOutOfBoundsException when receiving empty buffer at remote channel

2015-03-20 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1761: -- Summary: IndexOutOfBoundsException when receiving empty buffer at remote channel Key: FLINK-1761 URL: https://issues.apache.org/jira/browse/FLINK-1761 Project: Flink

[jira] [Created] (FLINK-1760) Add support for building Flink with Scala 2.11

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1760: --- Summary: Add support for building Flink with Scala 2.11 Key: FLINK-1760 URL: https://issues.apache.org/jira/browse/FLINK-1760 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-1759) Execution statistics for vertex-centric iterations

2015-03-20 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1759: Summary: Execution statistics for vertex-centric iterations Key: FLINK-1759 URL: https://issues.apache.org/jira/browse/FLINK-1759 Project: Flink Issue Type:

[jira] [Created] (FLINK-1758) Extend Gelly's neighborhood methods

2015-03-20 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1758: Summary: Extend Gelly's neighborhood methods Key: FLINK-1758 URL: https://issues.apache.org/jira/browse/FLINK-1758 Project: Flink Issue Type: Improvement

Re: [jira] [Created] (FLINK-1757) java.lang.ClassCastException is thrown while summing Short values on window

2015-03-20 Thread Szabó Péter
This issue is basically solved. Will be committed soon. Peter 2015-03-20 13:45 GMT+01:00 Péter Szabó (JIRA) : > Péter Szabó created FLINK-1757: > -- > > Summary: java.lang.ClassCastException is thrown while summing > Short values on window >

[jira] [Created] (FLINK-1757) java.lang.ClassCastException is thrown while summing Short values on window

2015-03-20 Thread JIRA
Péter Szabó created FLINK-1757: -- Summary: java.lang.ClassCastException is thrown while summing Short values on window Key: FLINK-1757 URL: https://issues.apache.org/jira/browse/FLINK-1757 Project: Flink

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Ufuk Celebi
Thanks. I will have a look later :-) +1 for the Wiki. I think the low overhead does not only make it easier to contribute for newcomers, but for committers as well. :-) On 20 Mar 2015, at 12:46, Kostas Tzoumas wrote: > I added a document for data exchange between tasks: > https://cwiki.apache.

Re: Improve the documentation of the Flink Architecture and internals

2015-03-20 Thread Kostas Tzoumas
I added a document for data exchange between tasks: https://cwiki.apache.org/confluence/display/FLINK/Data+exchange+between+tasks Feel free to edit. I plan to link the class names to the class files in github. On Tue, Mar 17, 2015 at 11:17 AM, Kostas Tzoumas wrote: > +1 for the Wiki. > > When t

Re: [Delta Iterations] The dirty insides(insights)

2015-03-20 Thread Andra Lungu
Hi Stephan, What I am trying to do, among other things, is to make the vertex's inDegree and outDegree available in the vertexUpdate and sendMessages functions via vertex.getInDegrees(). That is almost done: https://github.com/andralungu/flink/tree/spargelExt Only the problem is that the inDegree

Re: [Delta Iterations] The dirty insides(insights)

2015-03-20 Thread Stephan Ewen
Hi Andra! I am not sure I am getting exactly what the question is. The code you pasted is from the Spargel API - specifically just forwarding registered broadcast variables. What do you mean with "the vertex values get reset" ? Stephan PS: The delta iterations are based in this paper: http://ar

[jira] [Created] (FLINK-1756) Rename Stream Monitoring to Stream Checkpointing

2015-03-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1756: --- Summary: Rename Stream Monitoring to Stream Checkpointing Key: FLINK-1756 URL: https://issues.apache.org/jira/browse/FLINK-1756 Project: Flink Issue Type: Bug