Re: Multiple operations on a WindowedStream

2016-04-08 Thread Aljoscha Krettek
issue with the 0.9 consumer on YARN? From: > aljos...@apache.org Date: Thu, 7 Apr 2016 09:56:42 +0000 Subject: Re: > Multiple operations on a WindowedStream To: user@flink.apache.org Hi, the > code seems alright? Did you try looking at the Flink Dashboard to check out > whether any of

RE: Multiple operations on a WindowedStream

2016-04-08 Thread Kanak Biscuitwala
operations on a WindowedStream To: user@flink.apache.org Hi, the code seems alright? Did you try looking at the Flink Dashboard to check out whether any of the operations are sending elements? Cheers, Aljoscha On Tue, 5 Apr 2016 at 21:00 Kanak Biscuitwala wrote: This worked when I ran my test code

Re: Multiple operations on a WindowedStream

2016-04-07 Thread Aljoscha Krettek
. > > Anything obvious that I'm doing wrong? > ____ > > From: aljos...@apache.org > > Date: Fri, 1 Apr 2016 09:41:12 + > > Subject: Re: Multiple operations on a WindowedStream > > To: user@flink.apache.org > &g

RE: Multiple operations on a WindowedStream

2016-04-05 Thread Kanak Biscuitwala
rom: aljos...@apache.org > Date: Fri, 1 Apr 2016 09:41:12 + > Subject: Re: Multiple operations on a WindowedStream > To: user@flink.apache.org > > Hi, > if you are using ingestion-time (or event-time) as your stream time > characteristic, i.e.: > >

Re: Multiple operations on a WindowedStream

2016-04-01 Thread Aljoscha Krettek
Hi, if you are using ingestion-time (or event-time) as your stream time characteristic, i.e.: env.setStreamTimeCharacteristic(TimeCharacteristic.IngestionTime) // or TimeCharacteristic.EventTime you can apply several window transforms after another and they will apply the same "time window" becau

Re: Multiple operations on a WindowedStream

2016-04-01 Thread Balaji Rajagopalan
I had a similar use case and ended writing the aggregation logic in the apply function, could not find any better solution. On Fri, Apr 1, 2016 at 6:03 AM, Kanak Biscuitwala wrote: > Hi, > > I would like to write something that does something like a word count, and > then emits only the 10 highe

Multiple operations on a WindowedStream

2016-03-31 Thread Kanak Biscuitwala
Hi, I would like to write something that does something like a word count, and then emits only the 10 highest counts for that window. Logically, I would want to do something like: stream.timeWindow(Time.of(1, TimeUnit.MINUTES), Time.of(5, TimeUnit.SECONDS)).sum(2).apply(getTopK(10)) However,