Web interface to submit jobs

2015-11-04 Thread Sachin Goel
Hi all Are there any plans to upgrade the webclient interface? It could certainly use an upgrade compared to the much better dashboard . If so, is integrating them into one the best way to go? We can have a tab under Job Manager on the dashboard. I can share screenshots of the UI I designed last n

[jira] [Created] (FLINK-2973) Remove OpenJDK JMH dependency from flink-benchmark

2015-11-04 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-2973: Summary: Remove OpenJDK JMH dependency from flink-benchmark Key: FLINK-2973 URL: https://issues.apache.org/jira/browse/FLINK-2973 Project: Flink Issue Type:

[jira] [Created] (FLINK-2972) Remove Twitter Chill dependency from flink-java module

2015-11-04 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-2972: Summary: Remove Twitter Chill dependency from flink-java module Key: FLINK-2972 URL: https://issues.apache.org/jira/browse/FLINK-2972 Project: Flink Issue Ty

[jira] [Created] (FLINK-2971) Add outer joins to the Table API

2015-11-04 Thread Timo Walther (JIRA)
Timo Walther created FLINK-2971: --- Summary: Add outer joins to the Table API Key: FLINK-2971 URL: https://issues.apache.org/jira/browse/FLINK-2971 Project: Flink Issue Type: New Feature

How to use static data with streams?

2015-11-04 Thread Kashmar, Ali
Hi there, I’m trying to design and implement a use case in Flink where I’m receiving protocol packets over a socket. Each packet has the subscriber IMSI in it and a bunch of more data. At the same time, I have a csv file with a mapping from IMSI -> subscriber group. I need to inject the group i

[jira] [Created] (FLINK-2970) Yarn client cannot connect to new job manager

2015-11-04 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-2970: -- Summary: Yarn client cannot connect to new job manager Key: FLINK-2970 URL: https://issues.apache.org/jira/browse/FLINK-2970 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2969) FlinkYarnSessionCli with recovery enabled fails when killing TaskManager

2015-11-04 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-2969: -- Summary: FlinkYarnSessionCli with recovery enabled fails when killing TaskManager Key: FLINK-2969 URL: https://issues.apache.org/jira/browse/FLINK-2969 Project: Flink

[jira] [Created] (FLINK-2968) Windowed fold operation fails because the initial value was not serialized

2015-11-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2968: Summary: Windowed fold operation fails because the initial value was not serialized Key: FLINK-2968 URL: https://issues.apache.org/jira/browse/FLINK-2968 Project: Fli

Re: Question about limitations of iterative algorithms

2015-11-04 Thread Vasiliki Kalavri
Hi Andre, On 4 November 2015 at 16:04, André Petermann < peterm...@informatik.uni-leipzig.de> wrote: > Hi Fabian, > > thanks for your fast reply! > > I created a gist to explain the while-not-empty loop in more detail: > https://gist.github.com/p3et/9f6e56cf0b68213e3e2b > > It is an approach to c

Re: Error with window fold

2015-11-04 Thread Till Rohrmann
I have a fix for it. Will open a PR. On Wed, Nov 4, 2015 at 3:31 PM, Aljoscha Krettek wrote: > Ahh, there are no fold tests for the aligned time window operators. > > If you use Ingestion time or event time as stream characteristic it works > correctly. > > On Wed, Nov 4, 2015, 15:23 Maximilian

Re: Question about limitations of iterative algorithms

2015-11-04 Thread André Petermann
Hi Fabian, thanks for your fast reply! I created a gist to explain the while-not-empty loop in more detail: https://gist.github.com/p3et/9f6e56cf0b68213e3e2b It is an approach to create a minimal example of the kind of algorithm corresponding to page 1 of the PDF, in particular frequent substr

Re: Error with window fold

2015-11-04 Thread Aljoscha Krettek
Ahh, there are no fold tests for the aligned time window operators. If you use Ingestion time or event time as stream characteristic it works correctly. On Wed, Nov 4, 2015, 15:23 Maximilian Michels wrote: > That's basically what I also found out too so far. If you want to fix > it please go ah

Re: Error with window fold

2015-11-04 Thread Maximilian Michels
That's basically what I also found out too so far. If you want to fix it please go ahead. On Wed, Nov 4, 2015 at 3:11 PM, Till Rohrmann wrote: > The error should also be in 0.10. The problem is that due to the latest > stream refactorings we not only have fold operations which are > StreamOperato

Re: Error with window fold

2015-11-04 Thread Till Rohrmann
The error should also be in 0.10. The problem is that due to the latest stream refactorings we not only have fold operations which are StreamOperators but also WindowFunctions (if you apply them on windows). For the StreamOperators the output type is correctly set in the StreamGraph and thus the in

Re: Error with window fold

2015-11-04 Thread Gyula Fóra
This was java 8, snapshot 1.0 :) Maximilian Michels ezt írta (időpont: 2015. nov. 4., Sze, 14:47): > It's a bug. It also occurs in the Java API. Perhaps we can find a fix > for the release.. > > On Wed, Nov 4, 2015 at 2:40 PM, Maximilian Michels wrote: > > Hi Gyula, > > > > Trying to reproduce

Re: Error with window fold

2015-11-04 Thread Maximilian Michels
It's a bug. It also occurs in the Java API. Perhaps we can find a fix for the release.. On Wed, Nov 4, 2015 at 2:40 PM, Maximilian Michels wrote: > Hi Gyula, > > Trying to reproduce this error now. I'm assuming this is 0.10-SNAPSHOT? > > Cheers, > Max > > On Wed, Nov 4, 2015 at 1:49 PM, Gyula Fór

Re: Error with window fold

2015-11-04 Thread Maximilian Michels
Hi Gyula, Trying to reproduce this error now. I'm assuming this is 0.10-SNAPSHOT? Cheers, Max On Wed, Nov 4, 2015 at 1:49 PM, Gyula Fóra wrote: > Hey, > > Running the following simple application gives me an error: > > //just counting by key, the > streamOfIntegers.keyBy(x -> x).timeWindow(Time

[jira] [Created] (FLINK-2967) TM address detection might not always detect the right interface on slow networks / overloaded JMs

2015-11-04 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2967: - Summary: TM address detection might not always detect the right interface on slow networks / overloaded JMs Key: FLINK-2967 URL: https://issues.apache.org/jira/browse/FLINK-2967

Error with window fold

2015-11-04 Thread Gyula Fóra
Hey, Running the following simple application gives me an error: //just counting by key, the streamOfIntegers.keyBy(x -> x).timeWindow(Time.milliseconds(3000)).fold(0, ( c, next) -> c + 1).print(); Executing this gives the following error: "No initial value was serialized for the fold window fu

[jira] [Created] (FLINK-2966) Improve the way job duration is reported on web frontend.

2015-11-04 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2966: -- Summary: Improve the way job duration is reported on web frontend. Key: FLINK-2966 URL: https://issues.apache.org/jira/browse/FLINK-2966 Project: Flink Issue Typ

Re: Failure in KafkaIT case

2015-11-04 Thread Gyula Fóra
Ah sorry I forgot to post it, thanks Max :) Till Rohrmann ezt írta (időpont: 2015. nov. 4., Sze, 12:20): > Great, thanks :-) > > On Wed, Nov 4, 2015 at 12:07 PM, Maximilian Michels > wrote: > > > Thanks Gyula. Here is the issue: > > https://issues.apache.org/jira/browse/FLINK-2965 > > > > On We

Re: Failure in KafkaIT case

2015-11-04 Thread Till Rohrmann
Great, thanks :-) On Wed, Nov 4, 2015 at 12:07 PM, Maximilian Michels wrote: > Thanks Gyula. Here is the issue: > https://issues.apache.org/jira/browse/FLINK-2965 > > On Wed, Nov 4, 2015 at 12:00 PM, Gyula Fóra wrote: > > done > > > > Till Rohrmann ezt írta (időpont: 2015. nov. 4., > Sze, > >

Re: Failure in KafkaIT case

2015-11-04 Thread Maximilian Michels
Thanks Gyula. Here is the issue: https://issues.apache.org/jira/browse/FLINK-2965 On Wed, Nov 4, 2015 at 12:00 PM, Gyula Fóra wrote: > done > > Till Rohrmann ezt írta (időpont: 2015. nov. 4., Sze, > 11:19): > >> Could you please open or update the corresponding JIRA issue if existing. >> >> On W

Re: Failure in KafkaIT case

2015-11-04 Thread Gyula Fóra
done Till Rohrmann ezt írta (időpont: 2015. nov. 4., Sze, 11:19): > Could you please open or update the corresponding JIRA issue if existing. > > On Wed, Nov 4, 2015 at 11:14 AM, Gyula Fóra wrote: > > > Hey, > > > > I found an interesting failure in the KafkaITCase, I am not sure if this > > ha

[jira] [Created] (FLINK-2965) KafkaITCase failure

2015-11-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-2965: - Summary: KafkaITCase failure Key: FLINK-2965 URL: https://issues.apache.org/jira/browse/FLINK-2965 Project: Flink Issue Type: Bug Components: Streaming,

Re: [VOTE] [RESULT] Release Apache Flink 0.10.0 (release-0.10.0-rc5)

2015-11-04 Thread Maximilian Michels
I won't immediately create the next RC but collect fixes from the community first. Delaying the next release candidate gives us time to find more issues. However, it also contradicts with getting out a release in a timely manner. Since 0.10 is already kind of overdue my take as a release manager is

Re: Failure in KafkaIT case

2015-11-04 Thread Till Rohrmann
Could you please open or update the corresponding JIRA issue if existing. On Wed, Nov 4, 2015 at 11:14 AM, Gyula Fóra wrote: > Hey, > > I found an interesting failure in the KafkaITCase, I am not sure if this > happened before. > > It received a duplicate record and failed on that (not the usual

Failure in KafkaIT case

2015-11-04 Thread Gyula Fóra
Hey, I found an interesting failure in the KafkaITCase, I am not sure if this happened before. It received a duplicate record and failed on that (not the usual zookeeper timeout thing) Logs are here: https://s3.amazonaws.com/archive.travis-ci.org/jobs/89171477/log.txt Cheers, Gyula

Re: [VOTE] [RESULT] Release Apache Flink 0.10.0 (release-0.10.0-rc5)

2015-11-04 Thread Robert Metzger
How about waiting a bit with the next RC until we have found some more issues? On Wed, Nov 4, 2015 at 11:00 AM, Maximilian Michels wrote: > This vote is cancelled in favor of a new RC. > > On Wed, Nov 4, 2015 at 10:59 AM, Maximilian Michels > wrote: > > > That's a big release blocker. Thanks

[VOTE] [RESULT] Release Apache Flink 0.10.0 (release-0.10.0-rc5)

2015-11-04 Thread Maximilian Michels
This vote is cancelled in favor of a new RC. On Wed, Nov 4, 2015 at 10:59 AM, Maximilian Michels wrote: > That's a big release blocker. Thanks for the fix, Till! I'm really glad we > managed to fix this subtle bug. > > On Wed, Nov 4, 2015 at 2:19 AM, Till Rohrmann > wrote: > >> I fear that I ha

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc5)

2015-11-04 Thread Maximilian Michels
That's a big release blocker. Thanks for the fix, Till! I'm really glad we managed to fix this subtle bug. On Wed, Nov 4, 2015 at 2:19 AM, Till Rohrmann wrote: > I fear that I have to give another -1. > > The reason is that in the current RC Flink fails when spilling partitions > of the MutableH