New to Apache Flink

2016-01-06 Thread Arjun Rao
Hi, I am new to Apache Flink and I really like the look of the API. I have been working with Storm for the past year and have questions about the DataStream API among others. 1. What are the interactions of the actor system in the flink ecosystem? Where can I find more information? 2. Is there a

Re: JavaScript Bindings

2016-01-06 Thread Chiwan Park
Really good news! New language binding would be helpful to extend user pool of Flink. If you have any questions, please feel free send a email to this mailing list. > On Jan 7, 2016, at 2:01 AM, Adam Dutko wrote: > > I would like to explore adding JavaScript bindings to empower users to > write

[gelly] partition-centric iterations

2016-01-06 Thread Vasiliki Kalavri
Hi squirrels, here's some more Gelly iteration love for you ;) Together with Kien and Nikola (students at KTH, cc-ed), we looked into partition-centric iterations for Gelly. The idea of the partition-centric model is to expose the graph partition structure to the user (not just a single vertex, b

Re: [gelly] Spargel model rework

2016-01-06 Thread Vasiliki Kalavri
issue created: https://issues.apache.org/jira/browse/FLINK-3207 If anyone has any other suggestion about the renaming, let me know :) -V. On 5 January 2016 at 11:52, Aljoscha Krettek wrote: > Nice to hear. :D > > I think you can go ahead and add the Jira. About the renaming: I also > think tha

Re: [gelly] Spargel model rework

2016-01-06 Thread Stephan Ewen
+1 for the renaming! On Wed, Jan 6, 2016 at 8:01 PM, Vasiliki Kalavri wrote: > issue created: https://issues.apache.org/jira/browse/FLINK-3207 > > If anyone has any other suggestion about the renaming, let me know :) > > -V. > > On 5 January 2016 at 11:52, Aljoscha Krettek wrote: > > > Nice to

[jira] [Created] (FLINK-3208) Rename Gelly vertex-centric model to scatter-gather

2016-01-06 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-3208: Summary: Rename Gelly vertex-centric model to scatter-gather Key: FLINK-3208 URL: https://issues.apache.org/jira/browse/FLINK-3208 Project: Flink Issue Type:

[jira] [Created] (FLINK-3207) Add a Pregel iteration abstraction to Gelly

2016-01-06 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-3207: Summary: Add a Pregel iteration abstraction to Gelly Key: FLINK-3207 URL: https://issues.apache.org/jira/browse/FLINK-3207 Project: Flink Issue Type: New Fea

JavaScript Bindings

2016-01-06 Thread Adam Dutko
I would like to explore adding JavaScript bindings to empower users to write code in JavaScript and leverage Apache Flink. I'm somewhat familiar with the Python API and have started exploring adding support for JavaScript using the Python code as a template. I would like to continue explore adding

[jira] [Created] (FLINK-3206) Heap size for non-pre-allocated off-heap memory

2016-01-06 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-3206: - Summary: Heap size for non-pre-allocated off-heap memory Key: FLINK-3206 URL: https://issues.apache.org/jira/browse/FLINK-3206 Project: Flink Issue Type: Bug

Re: Serialization Bug ?

2016-01-06 Thread Robert Metzger
The user was able to resolve the issue by disabling the closure cleaner. Apparently, the closure cleaner is stumbling across the static variable. @Aljoscha: I think you've added the ClosureCleaner, what do you think about this? On Tue, Jan 5, 2016 at 4:09 PM, Matthias J. Sax wrote: > Hi, > > to

Re: Pulling Streaming out of staging and project restructure

2016-01-06 Thread Fabian Hueske
Stephan already opened a PR for restructuring the examples: --> https://github.com/apache/flink/pull/1482 Otherwise +1! 2016-01-06 16:21 GMT+01:00 Robert Metzger : > The renaming hasn't been done completely. I would like to fix this before > the 1.0.0 release. > > I think the following issues a

[jira] [Created] (FLINK-3205) Remove the flink-staging module

2016-01-06 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3205: - Summary: Remove the flink-staging module Key: FLINK-3205 URL: https://issues.apache.org/jira/browse/FLINK-3205 Project: Flink Issue Type: Task Co

Re: Pulling Streaming out of staging and project restructure

2016-01-06 Thread Robert Metzger
The renaming hasn't been done completely. I would like to fix this before the 1.0.0 release. I think the following issues are still open: - Merge flink-java-examples, flink-scala-examples and flink-streaming-examples into "flink-examples" + build the streaming examples for the binary build as well

Re: Tagging Flink classes with InterfaceAudience and InterfaceStability

2016-01-06 Thread Robert Metzger
Fabian took another look into the interface stability PR for flink-core. There are the following issues which we need to decide upon: 1) The "ExecutionMode" class name is misleading because its for batch-jobs only. I suggest to make the ExecutionMode class an "@Experimental" interface (and the E

Re: LabeledVector with label vector

2016-01-06 Thread Till Rohrmann
Hi, yes, initially we thought about introducing a LabeledVector where the label can be a vector. However, for the sake of simplicity we decided to first implement a LabeledVector with a single double value as label. A simple double value should take 8 bytes of memory space. The DenseVector(Array(

[jira] [Created] (FLINK-3204) TaskManagers are not shutting down properly on YARN

2016-01-06 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3204: - Summary: TaskManagers are not shutting down properly on YARN Key: FLINK-3204 URL: https://issues.apache.org/jira/browse/FLINK-3204 Project: Flink Issue Typ