Re: Window based on tuple timestamps

://cwiki.apache.org/confluence/display/FLINK/Time+and+Order+in+Streams Cheers, Aljoscha On Fri, 18 Sep 2015 at 13:19 Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote: Hello again, another question from me =). Could you provide an example on how to correctly use w

Window based on tuple timestamps

Hello again, another question from me =). Could you provide an example on how to correctly use windows based on timestamps on the tuples (i.e. non-realtime)? As a simple example I tried something like this: val w4 = rdfSource.window(Time.of(20L, customTimestamp, 121962510L)).map

Re: Joining Windowed Data Streams

ments would the benchmark query have? Greetings, Stephan On Thu, Sep 17, 2015 at 11:02 AM, Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote: Hey community, is there a possibility to join two windowed data streams, instead of joining two data streams on a window?

Joining Windowed Data Streams

Hey community, is there a possibility to join two windowed data streams, instead of joining two data streams on a window? For example if one wants to implement Q1 of SRBench you load the data, create one window definition and then one would combine filters an

Re: Custom Aggregate - Example

uce function you should be able to implement any custom aggregations. You can also use foldWindow() if you want to do a functional fold over the window. I hope this helps. Cheers, Aljoscha On Fri, 21 Aug 2015 at 14:51 Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote:

Custom Aggregate - Example

Hello community, how do I define a custom aggregate function in Flink Streaming (Scala)? Could you please provide an example on how to do that? Thank you and best regards, Philipp

Re: NullPointerException when working with Windows

Jul 2015, at 14:02, Philipp Goetze wrote:

NullPointerException when working with Windows

Hey community, I am not sure whether it is a bug or I am doing something wrong. I have a little snippet produced by our project (see below). When I execute it in Eclipse everything works fine. However, when deploying the Jar to the local flink installation I get NullPointer Exceptions after th

Re: Submitting jobs from within Scala code

well. Therefore, I guess that there is something wrong with your job. What happens in |PigStorage().load|? Cheers, Till ​ On Thu, Jul 16, 2015 at 4:35 PM, Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote: Hey Tim, I think my previous mail was intercepted or somethi

Fwd: Re: Submitting jobs from within Scala code

Forwarded Message Subject:Re: Submitting jobs from within Scala code Date: Thu, 16 Jul 2015 14:31:01 +0200 From: Philipp Goetze To: user@flink.apache.org Hey, from the JobManager I do not get any more hints: 13:36:06,674 DEBUG

Re: Submitting jobs from within Scala code

| Cheers, Till ​ On Thu, Jul 16, 2015 at 11:23 AM, Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote: Hi Till, the problem is that this is the only output :( Or is it possible to get a more verbose log output? Maybe it is important to note, that both Fl

Re: Submitting jobs from within Scala code

the complete log output. This might help to get to the bottom of the problem. Cheers, Till On Thu, Jul 16, 2015 at 11:01 AM, Philipp Goetze mailto:philipp.goe...@tu-ilmenau.de>> wrote: Hi community, in our project we try to submit built Flink programs to the jobmanage

Submitting jobs from within Scala code

Hi community, in our project we try to submit built Flink programs to the jobmanager from within Scala code. The test program is executed correctly when submitted via the wrapper script "bin/flink run ..." and also with the webclient. But when executed from within the Scala code nothing seems

Re: Flink 0.9 built with Scala 2.11

10:23 PM, Chiwan Park wrote: No. Currently, there are no Flink binaries with scala 2.11 which are downloadable. Regards, Chiwan Park On Jun 10, 2015, at 10:18 PM, Philipp Goetze wrote: Thank you Chiwan! I did not know the master has a 2.11 profile. But there is no pre-built Flink with

Re: Flink 0.9 built with Scala 2.11

branch. `mvn clean install -DskipTests -P \!scala-2.10,scala-2.11` command builds Flink with Scala 2.11. Regards, Chiwan Park On Jun 10, 2015, at 9:56 PM, Flavio Pompermaier wrote: Nice! On 10 Jun 2015 14:49, "Philipp Goetze" wrote: Hi community! We started a new project cal

Flink 0.9 built with Scala 2.11

Hi community! We started a new project called Piglet (https://github.com/ksattler/piglet). For that we use i.a. Flink as a backend. The project is based on Scala 2.11. Thus we need a 2.11 build of Flink. Until now we used the 2.11 branch of the stratosphere project and built Flink ourselves.