Re: Towards a spec for robust streaming SQL, Part 1

2017-04-21 Thread Tyler Akidau
Good point, when you start talking about anything less than a full join, triggers get involved to describe how one actually achieves the desired semantics, and they may end up being tied to just one of the inputs (e.g., you may only care about the watermark for one side of the join). Am expecting u

Re: Towards a spec for robust streaming SQL, Part 1

2017-04-21 Thread Kenneth Knowles
There's something to be said about having different triggering depending on which side of a join data comes from, perhaps? (delightful doc, as usual) Kenn On Fri, Apr 21, 2017 at 1:33 PM, Tyler Akidau wrote: > Thanks for reading, Luke. The simple answer is that CoGBK is basically > flatten + G

Re: Towards a spec for robust streaming SQL, Part 1

2017-04-21 Thread Tyler Akidau
Thanks for reading, Luke. The simple answer is that CoGBK is basically flatten + GBK. Flatten is a non-grouping operation that merges the input streams into a single output stream. GBK then groups the data within that single union stream as you might otherwise expect, yielding a single table. So I

Re: Towards a spec for robust streaming SQL, Part 1

2017-04-21 Thread Lukasz Cwik
The doc is a good read. I think you do a great job of explaining table -> stream, stream -> stream, and stream -> table when there is only one stream. But when there are multiple streams reading/writing to a table, how does that impact what occurs? For example, with CoGBK you have multiple streams

[jira] [Created] (FLINK-6356) Make times() eager and enable allowing combinations.

2017-04-21 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6356: - Summary: Make times() eager and enable allowing combinations. Key: FLINK-6356 URL: https://issues.apache.org/jira/browse/FLINK-6356 Project: Flink Issue Ty

Re: Question on checkpointing

2017-04-21 Thread Blake Essing
Sorry all for my earlier messages.  I just realized that I'm on the wrong mailing list for what I'm asking.  I will move my question to the user list. On Friday, April 21, 2017 11:54 AM, Blake Essing wrote: Sorry for the earlier incomplete email, E-mail editor issue. I have modified the

Mesos component status for 1.3

2017-04-21 Thread Eron Wright
Hello! Here's a list of related PRs that I'm tracking for 1.3 release: - FLINK-5974 - Mesos-DNS hostname support - FLINK-6336 - Mesos placement constraints - FLINK-5975 - Mesos volume support We need a committer to push these over the finish line. Also, I'd like to nominate myself as a shepherd

Re: Question on checkpointing

2017-04-21 Thread Blake Essing
Sorry for the earlier incomplete email, E-mail editor issue. I have modified the WordCounter example program to use a NiFi DataStream as input.  I would like to add checkpointing to the program to learn how it works.  I have googled and added many of the checkpointing configuration values to the

Question on checkpointing

2017-04-21 Thread Blake Essing
I have modified the WordCounter example program to use a NiFi DataStream as input.  I would like to add checkpointing to the program to learn how it works.  I have googled and added many of the checkpointing configuration values to the StreamExecutionEnvironment but I'm missing something critica

[jira] [Created] (FLINK-6355) TableEnvironment support register TableFunction

2017-04-21 Thread Kaibo Zhou (JIRA)
Kaibo Zhou created FLINK-6355: - Summary: TableEnvironment support register TableFunction Key: FLINK-6355 URL: https://issues.apache.org/jira/browse/FLINK-6355 Project: Flink Issue Type: Improveme

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

2017-04-21 Thread Aljoscha Krettek
There is this (somewhat pesky) issue: - https://issues.apache.org/jira/browse/FLINK-6353: Restoring using CheckpointedRestoring does not work from 1.2 to 1.2 I have the fix ready but we can do that in Flink 1.2.2. Very quickly, though. > On 20. Apr 2017, at 17:20, Henry Saputra wrote: > > LIC

[jira] [Created] (FLINK-6354) Add documentation for migration away from Checkpointed interface

2017-04-21 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-6354: --- Summary: Add documentation for migration away from Checkpointed interface Key: FLINK-6354 URL: https://issues.apache.org/jira/browse/FLINK-6354 Project: Flink

[jira] [Created] (FLINK-6353) Restoring using CheckpointedRestoring does not work from 1.2 to 1.2

2017-04-21 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-6353: --- Summary: Restoring using CheckpointedRestoring does not work from 1.2 to 1.2 Key: FLINK-6353 URL: https://issues.apache.org/jira/browse/FLINK-6353 Project: Flin

Re: [DISCUSS] Planning Release 1.3

2017-04-21 Thread Kostas Kloudas
+1 On Feb 6, 2017 20:19, "Robert Metzger" wrote: > Hi, > according to our recent time-based releases discussion, I came up with the > following deadlines for the upcoming 1.3 release: > > *Feature freeze (branch forking)*: 1 May 2017 > *Code freeze (first voting RC)*: 15 May 2017 > *Release da

Re: [DISCUSS] Planning Release 1.3

2017-04-21 Thread Robert Metzger
Quick reminder: *The feature freeze is 1 week from now (May 1)* On Mon, Mar 6, 2017 at 1:03 PM, Stephan Ewen wrote: > Looks good to me! > > > On Mon, Mar 6, 2017 at 10:55 AM, Robert Metzger > wrote: > > > That's the right attitude :) > > > > Since one month has passed since my initial email on