[jira] [Created] (FLINK-2663) Update Gelly library methods to use any key type

2015-09-13 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-2663: Summary: Update Gelly library methods to use any key type Key: FLINK-2663 URL: https://issues.apache.org/jira/browse/FLINK-2663 Project: Flink Issue Type: Im

Re: Using event timestamps

2015-09-13 Thread Márton Balassi
Hey Gyula, I have been recently looking at the streaming UdfOperators and can not recall a utility for the sources that you are looking for, but maybe I am also missing it. :) It would be a convenient addition though. Best, Marton On Sun, Sep 13, 2015 at 8:59 PM, Gyula Fóra wrote: > Hey All!

Using event timestamps

2015-09-13 Thread Gyula Fóra
Hey All! Is there a proper way of using a Flink Streaming source with event timestamps and watermarks? What I mean here is instead of implementing a custom SourceFunction, use an existing one and provide some Timestamp extractor (like the one currently used for Time windows), which will also autom

Re: Does flink support groupByKey([numTasks])

2015-09-13 Thread Fabian Hueske
Hi Liang, Martin gave a very good answer. I'd like to add a few words regarding the different stream processing models of Spark and Flink. Spark Streaming is based on mini-batches and each mini-batch is processed like a batch program. Hence a Spark Streaming program is implemented like a batch pr