Re: Flink contributor list

2015-07-27 Thread Szabó Péter
Tofi007 - Kristóf Kovács (he's a hungarian student worked with us in summer 2014) 2015-07-27 10:25 GMT+02:00 Maximilian Michels : > Hi Kostas, > > Thanks for creating the list! Looks impressive. > > As for keeping the list up to date: We could add a CONTRIBUTORS file in the > repository. This is

Re: Null pointer exception on pl.project13.maven:git-commit-id-plugin:2.1.5:revision

2015-06-03 Thread Szabó Péter
@Robert No, I couldn't. 2015-06-03 16:21 GMT+02:00 Szabó Péter : > I have the same problem on one of my computers but not on the other one. > I've read somewhere that it can be related to the git > version/configuration. I'm not completely sure, though. > > Peter &g

Re: Null pointer exception on pl.project13.maven:git-commit-id-plugin:2.1.5:revision

2015-06-03 Thread Szabó Péter
I have the same problem on one of my computers but not on the other one. I've read somewhere that it can be related to the git version/configuration. I'm not completely sure, though. Peter 2015-06-03 15:46 GMT+02:00 F. Beligianni : > Hello, > > I have a problem to build Flink master branch. Spec

Fwd: Discussion: Storm Comparability Layer

2015-06-03 Thread Szabó Péter
-- Forwarded message -- From: Szabó Péter Date: 2015-06-03 15:31 GMT+02:00 Subject: Re: Discussion: Storm Comparability Layer To: Márton Balassi Hey, Matthias, Of course, you can remove my last commit. I just wanted to remove the failing tests, and some unnecessary comments

Re: Storm compatibility layer currently does not support Storm's SimpleJoin example

2015-06-02 Thread Szabó Péter
progress, so the release will probably forked-off rather soon. > > On Fri, May 29, 2015 at 2:10 PM, Szabó Péter > wrote: > > > Thank you very much, this explains a lot of things :) > > I'm aware of that currently the support of TopologyContext is limited, > so I >

Re: [DISCUSS] Consolidate method naming between the batch and streaming API

2015-06-01 Thread Szabó Péter
Great proposal! We should use consistent naming for the two API. Peter 2015-06-01 21:11 GMT+02:00 Márton Balassi : > @Fabian: I hope that this is the complete list, correct me f I am wrong. :) > > I am opening a small PR with the changes on top of Aljoscha's one that > exposes the streaming part

Re: Storm compatibility layer currently does not support Storm's SimpleJoin example

2015-05-29 Thread Szabó Péter
dea, to add more examples from storm-starter to > flink-storm-examples. > > > -Matthias > > > On 05/28/2015 09:37 AM, Szabó Péter wrote: > > Hi Matthias, > > > > Of course, here is the package that contains the example's source > classes. > > > h

Re: Storm compatibility layer currently does not support Storm's SimpleJoin example

2015-05-28 Thread Szabó Péter
; > I am pretty sure, that the fix will be merged later on, too. There are > many other limitation in the layer. Right now, it is still in beta state. > ;) > > -Matthias > > > On 05/27/2015 03:48 PM, Szabó Péter wrote: > > Hey everyone, > > > > I experimented w

Storm compatibility layer currently does not support Storm's SimpleJoin example

2015-05-27 Thread Szabó Péter
Hey everyone, I experimented with the Storm compatibility layer Matthias wrote, and ran some Storm examples on Flink. I found that Storm's SimpleJoin example does not work. I suppose it is because of the multiple input streams. I'm willing to add another example instead. Right now, I'm getting it

Re: [DISCUSS] Merging Storm compatibility to Flink-contrib

2015-05-13 Thread Szabó Péter
@Robert: I have a little storm experience. I will try to run some examples on the cluster. Peter 2015-05-12 11:40 GMT+02:00 Matthias J. Sax : > Hi, > > some UnsupportedOperationExceptions are required, because Storm > interfaces are implement but Flink cannot support those functionality. > Some

Re: [jira] [Created] (FLINK-1986) Group by fails on iterative data streams

2015-05-12 Thread Szabó Péter
The problem is that the the StreamIterationHead is not created, because only IterativeDataStream.transform(...) can create it. groupBy() on an IterativeDataStream does not call transform(), therefore the exception. All methods of DataStream that is supported for iterations and do not call transform

Re: Question about SlidingPreReducers

2015-04-30 Thread Szabó Péter
t; > On Thursday, April 30, 2015, Aljoscha Krettek > > wrote: > > > > > >> Hi, > > >> no, I think the two are unrelated. But that's another problem we need > > >> to tackle then. > > >> > > >> Cheers, > > >&g

Re: Question about SlidingPreReducers

2015-04-30 Thread Szabó Péter
Hey, our intern, Pablo pointed out that there is some problem with mixed windowing policies. When you write ... .window(Count ...) .every(Time ...) .mapWindow(...) ... The result makes no sense, as the window is not of the specified length. Maybe, there is some conflict between Time and

Re: [jira] [Created] (FLINK-1757) java.lang.ClassCastException is thrown while summing Short values on window

2015-03-20 Thread Szabó Péter
This issue is basically solved. Will be committed soon. Peter 2015-03-20 13:45 GMT+01:00 Péter Szabó (JIRA) : > Péter Szabó created FLINK-1757: > -- > > Summary: java.lang.ClassCastException is thrown while summing > Short values on window >

NullFieldException is thrown when testing IterativeDataStream with tuples and maxBy

2015-03-09 Thread Szabó Péter
I'm running the following code and getting the RuntimeException "Emit failed due to: org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value." https://dl.dropboxusercontent.com/u/64242132/TestExample.java Does somebody know what causes it? Another issue is that if

Re: [DISCUSS] Issues with heterogeneity of the code

2015-03-09 Thread Szabó Péter
I agree. A unified rule-set for code style & formatting would make new contributions easier. There should be also a configuration guide for different IDEs. Peter 2015-03-08 23:17 GMT+01:00 Stephan Ewen : > Hi everyone! > > I would like to start an open discussion about some issue with the > hete

Re: [DISCUSS] URI NullPointerException in TestBaseUtils

2015-02-27 Thread Szabó Péter
that it only affects the TestBaseUtils, it should not be big > deal to change it. > > On Fri, Feb 27, 2015 at 10:30 AM, Szabó Péter > wrote: > > > The following code snippet in from TestBaseUtils: > > > > protected static File asFile(String path) { > >tr

Re: Flink Streaming parallelism bug report

2015-02-27 Thread Szabó Péter
No problem. I will not commit the modification until it is clarified. Peter 2015-02-27 10:48 GMT+01:00 Gyula Fóra : > I can't look at it at the moment, I am on vacation and don't have my > laptop. > On Feb 27, 2015 9:41 AM, "Szabó Péter" wrote: > > > Oka

Re: Flink Streaming parallelism bug report

2015-02-27 Thread Szabó Péter
when one or the other is used. > > Please watch out when you try to modify that because you might actually > break functionality there :p > On Feb 27, 2015 8:55 AM, "Szabó Péter" wrote: > > > As I know, the time of creation of the execution environment has been >

[DISCUSS] URI NullPointerException in TestBaseUtils

2015-02-27 Thread Szabó Péter
The following code snippet in from TestBaseUtils: protected static File asFile(String path) { try { URI uri = new URI(path); if (uri.getScheme().equals("file")) { return new File(uri.getPath()); } else { throw new IllegalArgumentException("This path does not

Flink Streaming parallelism bug report

2015-02-27 Thread Szabó Péter
As I know, the time of creation of the execution environment has been slightly modified in the streaming API, which caused that dataStream.getParallelism() and dataStream.env.getDegreeOfParallelism() may return different values. Usage of the former is recommended. In theory, the latter is eliminate

Re: [DISCUSS] Iterative streaming example

2015-02-27 Thread Szabó Péter
? Perhaps I can help more if > you have some specific use case in mind. > > Paris > > > On 23 Feb 2015, at 14:29, Szabó Péter nemderogator...@gmail.com>> wrote: > > Nice. Thank you guys! > > @Paris > Are there any Flink implementations of this model? The GitH

Re: [DISCUSS] Iterative streaming example

2015-02-23 Thread Szabó Péter
k that the Samoa people have quite a few nice examples along the > lines of model training with feedback. > > @Paris: What would be the simplest example? > > On Mon, Feb 23, 2015 at 11:27 AM, Szabó Péter <mailto:nemderogator...@gmail.com>> > wrote: > > Does eve

[DISCUSS] Iterative streaming example

2015-02-23 Thread Szabó Péter
Does everyone know of a good, simple and realistic streaming iteration example? The current example tests a random generator, but it should be replaced by something deterministic in order to be testable. Peter