Re: Rowtime for Table from DataStream without explixit fieldnames

2018-10-04 Thread Johannes Schulte
t want to correct me if I am wrong. > > Best, > > Dawid > > > On 04/10/18 15:08, Johannes Schulte wrote: > > Hi, > > when converting a DataStream (with Watermarks) to a table like > described here > https://ci.apache.org/projects/flink/flink-docs-release-1.6/

Rowtime for Table from DataStream without explixit fieldnames

2018-10-04 Thread Johannes Schulte
Hi, when converting a DataStream (with Watermarks) to a table like described here https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/table/streaming.html#event-time I wonder on how to use the rowtime in a following window operation _without_ explicitly specifying all field names and

Re: Stream Join With Early firings

2018-06-23 Thread Johannes Schulte
alize both inputs. As you mentioned, you can use idle state > retention to remove records from state that have not been accessed for a > certain time. > > Best, Fabian > > 2018-06-18 11:09 GMT+02:00 Johannes Schulte : > >> Hi Fabian, >> >> thanks for the hints,

Re: Stream Join With Early firings

2018-06-18 Thread Johannes Schulte
ndowFunction. > > Best, Fabian > > > > > > 2018-06-13 13:43 GMT+02:00 Johannes Schulte : > >> Hi, >> >> I am joining two streams with a session window and want to emit a joined >> (early) result for every element arriving on on

Stream Join With Early firings

2018-06-13 Thread Johannes Schulte
Hi, I am joining two streams with a session window and want to emit a joined (early) result for every element arriving on one of the streams. Currently the code looks like this: s1.join(s2) .where(s1.id).equalTo(s2.id) .window(EventTimeSessionWindows.withGap(Time.minutes(15))) // trigger(?) .app

Re: Process Function

2017-09-06 Thread Johannes Schulte
> Regards, > Timo > > > Am 06.09.17 um 10:50 schrieb Aljoscha Krettek: > > Hi, > > I'm actually not very familiar with the current Table API implementations > but Fabian or Timo (cc'ed) should know more. I suspect very much that this > is implemented like

Re: TTL for State Entries / FLINK-3089

2017-03-09 Thread Johannes Schulte
cardinality and I think people have used Flink with > timers/windows with key cardinalities of several 100 millions. > > Best, > Aljoscha > > On Wed, Mar 8, 2017, at 14:37, Ufuk Celebi wrote: > > Looping in Aljoscha and Kostas who are the expert on this. :-) > > >

TTL for State Entries / FLINK-3089

2017-03-06 Thread Johannes Schulte
Hi, I am trying to achieve a stream-to-stream join with big windows and are searching for a way to clean up state of old keys. I am already using a RichCoProcessFunction I found there is already an existing ticket https://issues.apache.org/jira/browse/FLINK-3089 but I have doubts that a registr