Introduction of new Gelly developper

Hello, everyone, I am ZHOU Yi, a student working in graph algorithm, especially graph combinatorial algorithms. I am glad to join the Flink devlopping group. I am working on Gelly graph library, hopping to devote improvements and new features to Gelly graph library (algorithms library, graph

Introduction of new Gelly developper

Hello, everyone, I am ZHOU Yi, a student working in graph algorithm, especially graph combinatorial algorithms. I am glad to join the Flink devlopping group. I am working on Gelly graph library, hopping to devote improvements and new features to Gelly graph library (algorithms library, graph

Re: Improve the documentation of the Flink Architecture and internals

I have put my suggested version of an outline for the docs into the wiki. Regardless where the docs end up (wiki or repository), we can use the wiki to outline the docs. https://cwiki.apache.org/confluence/display/FLINK/Flink+Internals Some pages contain some stub or outline, others are completel

Re: Improve the documentation of the Flink Architecture and internals

I think the Wiki has a much lower barrier of entry to fix docs, especially for external people. The docs, with the Jekyll setup, is rather tricky. I would very much like that all kinds of people contribute to the docs about the internals, not just the usual three suspects that have done this so far

Re: Improve the documentation of the Flink Architecture and internals

Why do you wan't to split stuff between the doc in the repository and the wiki. I for one would always be to lazy to check stuff in a wiki when there is also a documentation. Plus, this would lead to additional overhead in deciding what goes where and syncing between the two places for documentatio

Re: [DISCUSS] Issues with heterogeneity of the code

No, but I don't know whether that's possible. The style guide prescribes, for example, this: def foo( a: Int, b: String, c: String) for methods with long parameter lists while a lot of people do this: def foo(a: Int, b: String, c: String) (IntelliJ also does this)

Re: Improve the documentation of the Flink Architecture and internals

Ah, I totally forgot to add to the internals: - Fault tolerance in Batch mode - Fault Tolerance in Streaming Mode, with state handling On Mon, Mar 16, 2015 at 7:51 PM, Stephan Ewen wrote: > Hi all! > > I would like to kick of an effort to improve the documentation of the > Flink Architectu

Improve the documentation of the Flink Architecture and internals

Hi all! I would like to kick of an effort to improve the documentation of the Flink Architecture and internals. This also means making the streaming architecture more prominent in the docs. Being quite a sophisticated stack, we need to improve the presentation of how Flink works - to an extend ne

Re: Documentation in the master

Awesome! Thanks for the update - Henry On Mon, Mar 16, 2015 at 10:40 AM, Maximilian Michels wrote: > SVG image display has been fixed by the build team. > > http://ci.apache.org/projects/flink/flink-docs-master/internal_general_arch.html > > On Wed, Mar 4, 2015 at 4:38 PM, Maximilian Michels wr

Re: DEV, Indebtedness for driving on toll road #0000872019

Somebody moderated this email through to this list. That was an error. Let's be more accurate here. On Mon, Mar 16, 2015 at 6:31 AM, E-ZPass Agent wrote: > Dear Dev, > > You have not paid for driving on a toll road. > You are kindly asked to pay your debt as soon as possible. > > The copy of

Re: Streaming topology tests to use CollectionEnvironment

The CollectionsEnvironment is a different execution backend for the Batch API - based entirely on Java Collections. The use case for this backend is to embed Flink programs into other programs in an extremely lightweight fashion, without threading overheads, serialization, anything. The tests are

Re: Documentation in the master

SVG image display has been fixed by the build team. http://ci.apache.org/projects/flink/flink-docs-master/internal_general_arch.html On Wed, Mar 4, 2015 at 4:38 PM, Maximilian Michels wrote: > (2) I found out, it's actually not the SVG but the Webserver which > sets the wrong content type for s

Re: Could not build up connection to JobManager

Could you please upload the logs? They would be really helpful. On Mon, Mar 16, 2015 at 6:11 PM, Dulaj Viduranga wrote: > Hi, > I tested the update but it’s still the same. I think it isn’t a problem > with my system because, I have an XAMPP server working totally fine (I > tried with it is shut

Re: Could not build up connection to JobManager

Hi, I tested the update but it’s still the same. I think it isn’t a problem with my system because, I have an XAMPP server working totally fine (I tried with it is shut down as well) and also I doubly checked hosts files. I had little snitch installed but I also tried uninstalling it. Isn’t the

[jira] [Created] (FLINK-1710) Expression API Tests take very long

Stephan Ewen created FLINK-1710: --- Summary: Expression API Tests take very long Key: FLINK-1710 URL: https://issues.apache.org/jira/browse/FLINK-1710 Project: Flink Issue Type: Bug Com

[jira] [Created] (FLINK-1709) Add support for programs with higher-than-slot parallelism

Ufuk Celebi created FLINK-1709: -- Summary: Add support for programs with higher-than-slot parallelism Key: FLINK-1709 URL: https://issues.apache.org/jira/browse/FLINK-1709 Project: Flink Issue Ty

Re: [DISCUSS] Issues with heterogeneity of the code

Do we already enforce the official Scala style guide strictly? On Mon, Mar 16, 2015 at 4:57 PM, Aljoscha Krettek wrote: > I'm already always sticking to the official Scala style guide, with the > exception of 100 line length. > On Mar 16, 2015 3:27 PM, "Till Rohrmann" wrote: > > > +1 for strict

Re: Could not build up connection to JobManager

It is really strange. It's right that the CliFrontend now resolves localhost to the correct local address 10.218.100.122. Moreover, according to the logs, the JobManager is also started and binds to akka.tcp:// flink@10.218.100.122:6123. According to the logs, this is also the address the CliFronte

Re: [DISCUSS] Name of Expression API and DataSet abstraction

I am also more in favor of Rel and Relation, but DataTable nicely follows the terms DataSet and DataStream. On Mar 16, 2015 4:58 PM, "Aljoscha Krettek" wrote: > I like Relation or Rel, is shorter. > On Mar 16, 2015 4:52 PM, "Hermann Gábor" wrote: > > > +1 for DataTable > > > > On Mon, Mar 16, 2

Re: [DISCUSS] Name of Expression API and DataSet abstraction

I like Relation and Relation API more than Table API. Rel is quite cryptic though :) On Mar 16, 2015 5:58 PM, "Aljoscha Krettek" wrote: > I like Relation or Rel, is shorter. > On Mar 16, 2015 4:52 PM, "Hermann Gábor" wrote: > > > +1 for DataTable > > > > On Mon, Mar 16, 2015 at 4:11 PM Till Rohr

[jira] [Created] (FLINK-1708) KafkaSink not working from Usercode classloader

Robert Metzger created FLINK-1708: - Summary: KafkaSink not working from Usercode classloader Key: FLINK-1708 URL: https://issues.apache.org/jira/browse/FLINK-1708 Project: Flink Issue Type: B

Re: [DISCUSS] Name of Expression API and DataSet abstraction

I like Relation or Rel, is shorter. On Mar 16, 2015 4:52 PM, "Hermann Gábor" wrote: > +1 for DataTable > > On Mon, Mar 16, 2015 at 4:11 PM Till Rohrmann > wrote: > > > +1 for DataTable > > > > On Mon, Mar 16, 2015 at 10:34 AM, Márton Balassi < > balassi.mar...@gmail.com > > > > > wrote: > > > >

Re: DEV, Indebtedness for driving on toll road #0000872019

LOL On Monday, March 16, 2015, Stephan Ewen wrote: > Thank you. We promise that we will never do this again. > > Once we can dig up a few nuts that we buried last autumn, we'll use them to > pay for the ticket... > > > On Mon, Mar 16, 2015 at 1:31 PM, E-ZPass Agent < > ruben.dav...@h1.faust.net.

Re: [DISCUSS] Issues with heterogeneity of the code

I'm already always sticking to the official Scala style guide, with the exception of 100 line length. On Mar 16, 2015 3:27 PM, "Till Rohrmann" wrote: > +1 for stricter Java code styles. I haven't looked into the Google Code > Style but maybe we make it easier for new contributors if we apply a co

Streaming topology tests to use CollectionEnvironment

Hey all, Currently streaming topology tests use TestStreamEnvironment and static collections as sinks for assertion. I see that that the batch API tests use CollectionEnvironment for this purpose. Is there any reason streaming do not have something like that? I think it would be more compact and

Re: [DISCUSS] Name of Expression API and DataSet abstraction

+1 for DataTable On Mon, Mar 16, 2015 at 4:11 PM Till Rohrmann wrote: > +1 for DataTable > > On Mon, Mar 16, 2015 at 10:34 AM, Márton Balassi > > wrote: > > > +1 for Max's suggestion. > > > > On Mon, Mar 16, 2015 at 10:32 AM, Ufuk Celebi wrote: > > > > > On Fri, Mar 13, 2015 at 6:08 PM, Maximi

Re: [DISCUSS] Name of Expression API and DataSet abstraction

+1 for DataTable On Mon, Mar 16, 2015 at 10:34 AM, Márton Balassi wrote: > +1 for Max's suggestion. > > On Mon, Mar 16, 2015 at 10:32 AM, Ufuk Celebi wrote: > > > On Fri, Mar 13, 2015 at 6:08 PM, Maximilian Michels > > wrote: > > > > > > > > Thanks for starting the discussion. We should defini

[jira] [Created] (FLINK-1707) Add an Affinity Propagation Library Method

Vasia Kalavri created FLINK-1707: Summary: Add an Affinity Propagation Library Method Key: FLINK-1707 URL: https://issues.apache.org/jira/browse/FLINK-1707 Project: Flink Issue Type: New Feat

Re: [DISCUSS] Issues with heterogeneity of the code

+1 for stricter Java code styles. I haven't looked into the Google Code Style but maybe we make it easier for new contributors if we apply a coding style which is somehow known. +1 for line length of 100 for Scala code. I think it makes code review on GitHub easier. For the Scala style, we could

Re: [DISCUSS] Issues with heterogeneity of the code

+1 for the stricter Java code styles. We should not forget about providing code formatter settings for Eclipse and Intellij IDEA (as mentioned above). That would help a lot. (Of course if we'll use Google Code Style, they already provide such files

Re: [DISCUSS] Issues with heterogeneity of the code

+1 for not limiting the line length. Everyone should have a good sense to break lines. When in exceptional cases people violate this, it is usually for a good reason. On Mon, Mar 16, 2015 at 2:18 PM, Maximilian Michels wrote: > +1 for enforcing a more strict Java code style. However, let's not >

Re: [DISCUSS] Issues with heterogeneity of the code

+1 for not limiting the line length. 2015-03-16 14:39 GMT+01:00 Stephan Ewen : > +1 for not limiting the line length. Everyone should have a good sense to > break lines. When in exceptional cases people violate this, it is usually > for a good reason. > > On Mon, Mar 16, 2015 at 2:18 PM, Maximili

Re: DEV, Indebtedness for driving on toll road #0000872019

Thank you. We promise that we will never do this again. Once we can dig up a few nuts that we buried last autumn, we'll use them to pay for the ticket... On Mon, Mar 16, 2015 at 1:31 PM, E-ZPass Agent wrote: > Dear Dev, > > You have not paid for driving on a toll road. > You are kindly asked t

Re: [DISCUSS] Issues with heterogeneity of the code

+1 for enforcing a more strict Java code style. However, let's not introduce a line legth of 100 like in Scala. I think that's hurting readability of the code. On Sat, Mar 14, 2015 at 4:41 PM, Ufuk Celebi wrote: > On Saturday, March 14, 2015, Aljoscha Krettek wrote: > > > I'm in favor of strict

Re: DEV, Indebtedness for driving on toll road #0000872019

seems legit On Mon, Mar 16, 2015 at 1:31 PM, E-ZPass Agent wrote: > Dear Dev, > > You have not paid for driving on a toll road. > You are kindly asked to pay your debt as soon as possible. > > The copy of the invoice is attached to this email. > > Kind regards, > Ruben Davies, > E-ZPass Agent. >

Re: [DISCUSS] Offer Flink with Scala 2.11

I'm fine with that, although I think that cross-building should be added to the roadmap for 2015. 2015-03-16 12:44 GMT+01:00 Robert Metzger : > Thank you for bringing new attention to this. > > After thinking a bit more about it, I would actually vote to NOT offer > pre-build suffixed packages. >

Re: [DISCUSS] Offer Flink with Scala 2.11

Thank you for bringing new attention to this. After thinking a bit more about it, I would actually vote to NOT offer pre-build suffixed packages. So far, the demand for Scala 2.11 has been low on the mailing list, and for those who want to use it, we have a good way to enable it manually. On Mon,

Re: [DISCUSS] Offer Flink with Scala 2.11

Popping up this thread. The PR build passes and we need some sort of strategy (add suffix to packages or force manual build for 2.11) before we merge. 2015-03-11 19:15 GMT+01:00 Robert Metzger : > Thank you for opening the pull request. It looks great so far. > > There came up one question while

[jira] [Created] (FLINK-1706) Add disk spilling to BarrierBuffer

Gyula Fora created FLINK-1706: - Summary: Add disk spilling to BarrierBuffer Key: FLINK-1706 URL: https://issues.apache.org/jira/browse/FLINK-1706 Project: Flink Issue Type: Improvement

Re: [GSoc][flink-streaming] Interested in pursuing FLINK-1617 and FLINK-1534

Dear Akshay, Thanks again for your interest and for the recent contribution to streaming. Both of the projects mentioned wold be largely appreciated by the community, and you can also propose other project suggestions here for discussion. Regarding FLINK-1534, the thesis I mentioned serves as a

Re: [DISCUSS] Name of Expression API and DataSet abstraction

+1 for Max's suggestion. On Mon, Mar 16, 2015 at 10:32 AM, Ufuk Celebi wrote: > On Fri, Mar 13, 2015 at 6:08 PM, Maximilian Michels > wrote: > > > > > Thanks for starting the discussion. We should definitely not keep > > flink-expressions. > > > > I'm in favor of DataTable for the DataSet abstr

Re: [DISCUSS] Name of Expression API and DataSet abstraction

On Fri, Mar 13, 2015 at 6:08 PM, Maximilian Michels wrote: > > Thanks for starting the discussion. We should definitely not keep > flink-expressions. > > I'm in favor of DataTable for the DataSet abstraction equivalent. For > consistency, the package name should then be flink-table. At first > si

Re: Could not build up connection to JobManager

There was an issue for this: https://issues.apache.org/jira/browse/FLINK-1634 Can we close it then? On Sat, Mar 14, 2015 at 9:16 PM, Dulaj Viduranga wrote: > Hay Stephan, > Great to know you could fix the issue. Thank you on the update. > Best regards. > > > On Mar 14, 2015, at 9:19 PM, Stephan

Re: Current master broken?

The reason is probably that Travis used different VMs then and now. The test did not specify the parallelism itself, but picked it up from the hardware. When the VMs changed, the parallelism changed (increased a lot) to the point where the default environment has no more network buffers. Simple fi