Re: [PROPOSAL] Merge gearpump-runner to master

2017-07-21 Thread Kenneth Knowles
+1 to this! I really want to call out the longevity of contribution behind this, following many changes in both Beam and Gearpump for over a year. Here's the first commit on the branch: commit 9478f4117de3a2d0ea40614ed4cb801918610724 (github/pr/323) Author: manuzhang Date: Tue Mar

Re: [PROPOSAL] Connectors for memcache and Couchbase

2017-07-21 Thread Madhusudan Borkar
As suggested by @Ismaƫl, we are planning to start development next week using the original proposal as the first version. We would appreciate if there more ideas about changing the proposal, please let us know otherwise we will go ahead. Thanks Madhu Borkar On Thu, Jul 20, 2017 at 8:54 PM, Sesha

Re: BeamSQL status and merge to master

2017-07-21 Thread Tyler Akidau
There are still open items in the merge to master doc. We're close to being ready, but let's please address those first. -Tyler On Thu, Jul 20, 2017 at 9:34 PM Mingmin Xu wrote: > Quick update: > > The final PR[1] is open to review now. Please leave your comment or create > a sub-task in [2] f

Next Step in I/O Integration Tests

2017-07-21 Thread Stephen Sisk
Hi! we now have changes in ([3] and [4]) that enable developers to easily run I/O integration tests from their local machines without having a pre-existing instance of the data store that they're running the tests against - all they need is a kubernetes cluster. It's currently hooked up for jdbc a

Re: Should Pipeline wait till all processing time timers fire before exit?

2017-07-21 Thread Kenneth Knowles
I think the best answer is "yes" we should fire all timers before exit. This is the subject of https://issues.apache.org/jira/browse/BEAM-2535 which is a fairly significant enhancement to the model. In this proposal, every timer is treated like an input with a timestamp and that is independent of

Jenkins build is unstable: beam_Release_NightlySnapshot #484

2017-07-21 Thread Apache Jenkins Server
See

Should Pipeline wait till all processing time timers fire before exit?

2017-07-21 Thread Shen Li
If max watermarks arrive at all transforms before some processing time timers fire, should the Pipeline wait till all timers fire before turning to DONE state? Thanks, Shen

[PROPOSAL] Merge gearpump-runner to master

2017-07-21 Thread Manu Zhang
Guys, On behalf of the gearpump team, I'd like to propose to merge the gearpump-runner branch into master, which will give it more visibility to other contributors and users. The runner satisfies the following criteria outlined in contribution guide [1]. 1. Have at least 2 contributors intere