[jira] [Created] (FLINK-2353) Hadoop mapred IOFormat wrappers do not respect JobConfigurable interface

2015-07-13 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-2353: Summary: Hadoop mapred IOFormat wrappers do not respect JobConfigurable interface Key: FLINK-2353 URL: https://issues.apache.org/jira/browse/FLINK-2353 Project: Flin

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Márton Balassi
Generally I agree with the new design. Two concerns: 1) Does KeyedDataStream replace GroupedDataStream or is it the latter a special case of the former? The KeyedDataStream as described in the design document is a bit unclear for me. It lists the following usages: a) It is the first step in bui

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Paris Carbone
+1 No further concerns from my side either > On 13 Jul 2015, at 18:30, Gyula Fóra wrote: > > +1 > On Mon, Jul 13, 2015 at 6:23 PM Stephan Ewen wrote: > >> If naming is the only concern, then we should go ahead, because we can >> change names easily (before the release). >> >> In fact, I don'

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Gyula Fóra
+1 On Mon, Jul 13, 2015 at 6:23 PM Stephan Ewen wrote: > If naming is the only concern, then we should go ahead, because we can > change names easily (before the release). > > In fact, I don't think it leaves a bad impression. Global windows are > non-parallel windows. There are also parallel win

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Stephan Ewen
If naming is the only concern, then we should go ahead, because we can change names easily (before the release). In fact, I don't think it leaves a bad impression. Global windows are non-parallel windows. There are also parallel windows. Pick what you need and what works. On Mon, Jul 13, 2015 at

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Gyula Fóra
I think we agree on everything its more of a naming issue :) I thought it might be misleading that global time windows are "non-parallel" windows. We dont want to give a bad impression. (Also we dont want them to think that every global window is parallel but thats not a problem here) Gyula On Mo

Re: Documentation Webpage Rendering Problem

2015-07-13 Thread Maximilian Michels
This has been fixed but our server which rebuilds the documentation is currently unavailable. I'm dealing with INFRA to bring it back up again and to configure builds on multiple servers such that we have a failover in case one goes down. Unfortunately, the server is externally hosted and has to br

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Stephan Ewen
Okay, what is missing about the windowing in your opinion? The core points of the document are: - The parallel windows are per group only. - The implementation of the parallel windows holds window data in the group buffers. - The global windows are non-parallel. May have parallel pre-aggr

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Gyula Fóra
In general I like it, although the main difference between the current and the new one is the windowing and that is still not very clear. Where do we have the full stream time windows for instance?(which is parallel but not keyed) On Mon, Jul 13, 2015 at 4:28 PM Aljoscha Krettek wrote: > +1 I li

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Aljoscha Krettek
+1 I like it as well. On Mon, 13 Jul 2015 at 16:17 Kostas Tzoumas wrote: > +1 from my side > > On Mon, Jul 13, 2015 at 4:15 PM, Stephan Ewen wrote: > > > Do we have consensus on these designs? > > > > If we have, we should get to implementing this soon, because basically > all > > streaming pat

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Kostas Tzoumas
+1 from my side On Mon, Jul 13, 2015 at 4:15 PM, Stephan Ewen wrote: > Do we have consensus on these designs? > > If we have, we should get to implementing this soon, because basically all > streaming patches will have to be revisited in light of this... > > On Tue, Jul 7, 2015 at 3:41 PM, Gyula

Re: Design documents for consolidated DataStream API

2015-07-13 Thread Stephan Ewen
Do we have consensus on these designs? If we have, we should get to implementing this soon, because basically all streaming patches will have to be revisited in light of this... On Tue, Jul 7, 2015 at 3:41 PM, Gyula Fóra wrote: > You are right thats an important issue. > > And I think we should

Re: How do network transmissions in Flink work?

2015-07-13 Thread Ufuk Celebi
Hey Niklas, there is also this Wiki entry: https://cwiki.apache.org/confluence/display/FLINK/Data+exchange+between+tasks On 09 Jul 2015, at 21:32, Niklas Semmler wrote: > 1. What does the number of ResultSubpartition instances in the > ResultPartition correspond to? Is one assigned to each co

[jira] [Created] (FLINK-2352) [Graph Visualization] Integrate Gelly with Gephi

2015-07-13 Thread Andra Lungu (JIRA)
Andra Lungu created FLINK-2352: -- Summary: [Graph Visualization] Integrate Gelly with Gephi Key: FLINK-2352 URL: https://issues.apache.org/jira/browse/FLINK-2352 Project: Flink Issue Type: New Fe

Re: Documentation Webpage Rendering Problem

2015-07-13 Thread Maximilian Michels
Turns out the problem is something else. It's due to Apache Infra changing URLs to https. We have hardcoded unsecure URLs in our docs which Firefox ignores due to security reasons. It then fails to load the style sheet. On Mon, Jul 13, 2015 at 10:26 AM, Andra Lungu wrote: > I just checked for Fi

Re: Documentation Webpage Rendering Problem

2015-07-13 Thread Andra Lungu
I just checked for Firefox 38.0.5, still reproducible. But I guess the fix for 39.0 will do the trick for the previous version as well :) On Mon, Jul 13, 2015 at 10:21 AM, Maximilian Michels wrote: > As far as I know this occurs only in the latest Firefox 39. > > https://issues.apache.org/jira/b

Re: The documentation site is cut on the top

2015-07-13 Thread Maximilian Michels
Ah interesting. Thanks for the info. Trying to fix that now. On Mon, Jul 13, 2015 at 10:18 AM, Andra Lungu wrote: > The bug is also reproducible in Chrome... The page renders similarly to the > way it does in Firefox :( > > On Mon, Jul 13, 2015 at 10:14 AM, Maximilian Michels > wrote: > > > Hey

Re: Documentation Webpage Rendering Problem

2015-07-13 Thread Maximilian Michels
As far as I know this occurs only in the latest Firefox 39. https://issues.apache.org/jira/browse/FLINK-2347 On Fri, Jul 10, 2015 at 2:40 PM, Chiwan Park wrote: > Oh, I misunderstood the problem. In firefox, the problem occurs. [1] > > Regards, > Chiwan Park > > [1] http://imgur.com/js5nZQ1 > >

Re: The documentation site is cut on the top

2015-07-13 Thread Andra Lungu
The bug is also reproducible in Chrome... The page renders similarly to the way it does in Firefox :( On Mon, Jul 13, 2015 at 10:14 AM, Maximilian Michels wrote: > Hey Henry! > > Are you on Firefox? This only shows up for me after a recent Firefox > update. Safari still shows it correctly. The p

Re: Question regarding HBase and machine-learning

2015-07-13 Thread Till Rohrmann
Hi Lydia, I assume that your data is already in the libSVM format or you convert it into this format before you write it to a file. Otherwise, libSVM cannot read in the data. If you do this, then you can directly use this transformed DataSet as the input for the SVM algorithm, instead of writing i

Re: The documentation site is cut on the top

2015-07-13 Thread Maximilian Michels
Hey Henry! Are you on Firefox? This only shows up for me after a recent Firefox update. Safari still shows it correctly. The problem is that the image's size is not set and apparently the rendering code just shows the image in its full size now. Kind of to be expected actually :) Will fix it and