Re: Better developer instructions for using Maven?

2017-01-10 Thread Aviem Zur
I agree with Dan and Lukasz. Developers should not be expected to know beforehand which specific profiles to run. The phase specified in the PR instructions (`verify`) should run all the relevant verifications and be the "slower" build, while a preceding lifecycle, such as `test`, should run the "f

Re: [jira] [Created] (BEAM-1261) State API should allow state to be managed in different windows

2017-01-10 Thread Robert Bradshaw
Possibly this could be handled by rewindowing and the current semantics. If not, maybe treat state like a side input with its own windowing and window mapping fn. On Jan 10, 2017 3:14 PM, "Ben Chambers (JIRA)" wrote: > Ben Chambers created BEAM-1261: > -- > >

Re: splitIntoBundles vs. generateInitialSplits

2017-01-10 Thread Eugene Kirpichov
I agree that the methods are named somewhat confusingly, and ideally would be named the same. Both of the names miss some aspect of the underlying concept. The underlying concept is split the source into smaller sub-sources which, if you read all of them, would have read the same data as the origi

Re: Some Thoughts on IO Integration Tests

2017-01-10 Thread Lukasz Cwik
PipelineOptions allows you to aggregate common options within a parent interface with child interfaces extending and inheriting those options. For example you can have MyIOOptionsTest1 which extends MyIOOptions and also MyIOOptionsTest2 which extends MyIOOptions. MyIOOptions can have all the share

Re: Some Thoughts on IO Integration Tests

2017-01-10 Thread Stephen Sisk
thanks Jason for doing this research! There are a lot of options. You mentioned "Steven" - I assume you're talking about me :) As you mention in your goals, we want this to work for both individual devs working on a particular store, as well as the beam CI system. I'm inclined to favor making thi

Some Thoughts on IO Integration Tests

2017-01-10 Thread Jason Kuster
Hi all, Following up on some of the discussions already on-list, I wanted to solicit some more feedback about some implementation details regarding the IO Integration Tests. As it currently stands, we mostly have IO ITs for GCP-based IO, which our GCP-based Jenkins executors handle natively, but

Re: Graduation!

2017-01-10 Thread Tyler Akidau
Congrats and thanks to everyone who helped make this happen! :-D -Tyler On Tue, Jan 10, 2017 at 2:20 PM Kenneth Knowles wrote: This is really exciting. It is such a privilege to be involved with this project & community. Kenn On Tue, Jan 10, 2017 at 1:42 PM, JongYoon Lim wrote: > Congrats t

Re: Graduation!

2017-01-10 Thread Kenneth Knowles
This is really exciting. It is such a privilege to be involved with this project & community. Kenn On Tue, Jan 10, 2017 at 1:42 PM, JongYoon Lim wrote: > Congrats to everyone involved ! > > Best Regards, > JongYoon > > 2017-01-11 7:18 GMT+13:00 Jean-Baptiste Onofré : > > > Congrats to the team

Re: Jenkins build became unstable: beam_SeedJob_Main #74

2017-01-10 Thread Jason Kuster
Manual build -- ignore. On Tue, Jan 10, 2017 at 11:28 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > -- --- Jason Kuster Apache Beam (Incubating) / Google Cloud Dataflow

Re: Graduation!

2017-01-10 Thread JongYoon Lim
Congrats to everyone involved ! Best Regards, JongYoon 2017-01-11 7:18 GMT+13:00 Jean-Baptiste Onofré : > Congrats to the team !! > > I'm proud and glad to humbly be part of it. > > Regards > JB⁣​ > > On Jan 10, 2017, 19:09, at 19:09, Raghu Angadi > wrote: > >Congrats to everyone involved. > >

Jenkins build became unstable: beam_SeedJob_Main #74

2017-01-10 Thread Apache Jenkins Server
See

Re: Beam ML

2017-01-10 Thread Kam Kasravi
Thanks Andrew I think more information about the DRM operations and how persistence would be done at the runner level. It looks like HDFS or spark caching is currently being used? On Monday, January 9, 2017 6:04 PM, Andrew Musselman wrote: Hello Beam Team, Thought you might be intere

Re: Graduation!

2017-01-10 Thread Jean-Baptiste Onofré
Congrats to the team !! I'm proud and glad to humbly be part of it. Regards JB⁣​ On Jan 10, 2017, 19:09, at 19:09, Raghu Angadi wrote: >Congrats to everyone involved. > >It has been a great experience following the rapid progress of Beam and >hard work of many. Well deserved promotion. > > >O

Re: Graduation!

2017-01-10 Thread Raghu Angadi
Congrats to everyone involved. It has been a great experience following the rapid progress of Beam and hard work of many. Well deserved promotion. On Tue, Jan 10, 2017 at 3:07 AM, Davor Bonaci wrote: > The ASF has publicly announced our graduation! > > > https://blogs.apache.org/foundation/ent

Re: Graduation!

2017-01-10 Thread Frances Perry
I've been part of the evolution of this programming model for a long time -- from the original FlumeJava prototype, to a key component of Google's internal infrastructure, to a public cloud product, and now a full-fledged Apache project. This has been the most exciting, humbling, and challenging ye

Re: Graduation!

2017-01-10 Thread Jason Kuster
Woo h[1]! Congrats to everyone - this is fantastic. [1] http://68.media.tumblr.com/3b22c7b2799f4adadbe377af7e8e7443/tumblr_npf7bzwSvA1s2wio8o1_500.gif On Tue, Jan 10, 2017 at 8:54 AM, Sandeep Deshmukh wrote: > Congratulations to all!!! > > On 10-Jan-2017 9:49 PM, "Amit Sela" wrote: > > >

Re: Graduation!

2017-01-10 Thread Sandeep Deshmukh
Congratulations to all!!! On 10-Jan-2017 9:49 PM, "Amit Sela" wrote: > Congratulations and thanks to everyone involved! > > On Tue, Jan 10, 2017, 18:16 Aljoscha Krettek wrote: > > > Sweet! Congratulations to everyone. :-) > > > > On Tue, 10 Jan 2017 at 17:01 Mukul Jain wrote: > > > > > Congrat

Re: Graduation!

2017-01-10 Thread Jamie Grier
Congrats all :) On Tue, Jan 10, 2017 at 8:16 AM, Aljoscha Krettek wrote: > Sweet! Congratulations to everyone. :-) > > On Tue, 10 Jan 2017 at 17:01 Mukul Jain wrote: > > > Congrats to everyone on this good news !! > > > > Sent from my iPhone > > > > > On Jan 10, 2017, at 7:59 AM, Ismaël Mejía

Re: Graduation!

2017-01-10 Thread Amit Sela
Congratulations and thanks to everyone involved! On Tue, Jan 10, 2017, 18:16 Aljoscha Krettek wrote: > Sweet! Congratulations to everyone. :-) > > On Tue, 10 Jan 2017 at 17:01 Mukul Jain wrote: > > > Congrats to everyone on this good news !! > > > > Sent from my iPhone > > > > > On Jan 10, 201

Re: Graduation!

2017-01-10 Thread Aljoscha Krettek
Sweet! Congratulations to everyone. :-) On Tue, 10 Jan 2017 at 17:01 Mukul Jain wrote: > Congrats to everyone on this good news !! > > Sent from my iPhone > > > On Jan 10, 2017, at 7:59 AM, Ismaël Mejía wrote: > > > > Congratulations everyone, this is great news, graduation will give new > > u

Re: Graduation!

2017-01-10 Thread Pawel Szczur
Congratz everyone! This is awesome. <3 Beam Paweł 2017-01-10 17:01 GMT+01:00 Mukul Jain : > Congrats to everyone on this good news !! > > Sent from my iPhone > >> On Jan 10, 2017, at 7:59 AM, Ismaël Mejía wrote: >> >> Congratulations everyone, this is great news, graduation will give new >> use

Re: Graduation!

2017-01-10 Thread Mukul Jain
Congrats to everyone on this good news !! Sent from my iPhone > On Jan 10, 2017, at 7:59 AM, Ismaël Mejía wrote: > > Congratulations everyone, this is great news, graduation will give new > users confidence about the project and its community. > Awesome ! > > Ismaël > > ps. @Michal It is onl

Re: Graduation!

2017-01-10 Thread Ismaël Mejía
Congratulations everyone, this is great news, graduation will give new users confidence about the project and its community. Awesome ! Ismaël ps. @Michal It is only one unified API for both bounded and unbounded data, the behavior changes depending on the data sources. On Tue, Jan 10, 2017 at 4:

Re: Graduation!

2017-01-10 Thread Thomas Weise
Congratulations everyone! Thomas On Tue, Jan 10, 2017 at 6:14 AM, Bobby Evans wrote: > Yes great news, Congradulations > > - Bobby > > On Tuesday, January 10, 2017, 8:11:43 AM CST, Jungtaek Lim < > kabh...@gmail.com> wrote:Congrats all! > > - Jungtaek Lim (HeartSaVioR) > > 2017년 1월 10일 (화) 오후

Re: Graduation!

2017-01-10 Thread Michal Hariš
Congratulations Beamers! I have been following your project for a while but not touched it yet. Now that it has graduated maybe it's a good time to ask one fundamental question I had on my mind: Is the unfied model for bound and unbound data sets designed as a unified API or is it similar to Flin

Re: Graduation!

2017-01-10 Thread Bobby Evans
Yes great news, Congradulations - Bobby On Tuesday, January 10, 2017, 8:11:43 AM CST, Jungtaek Lim wrote:Congrats all! - Jungtaek Lim (HeartSaVioR) 2017년 1월 10일 (화) 오후 10:53, Andrew Hoblitzell 님이 작성: > Good work all! > > On Tue, Jan 10, 2017 at 8:50 AM, Jesse Anderson > wrote: > > > Excelle

Re: Graduation!

2017-01-10 Thread Jungtaek Lim
Congrats all! - Jungtaek Lim (HeartSaVioR) 2017년 1월 10일 (화) 오후 10:53, Andrew Hoblitzell 님이 작성: > Good work all! > > On Tue, Jan 10, 2017 at 8:50 AM, Jesse Anderson > wrote: > > > Excellent! > > > > On Tue, Jan 10, 2017, 7:12 AM Jacky Li wrote: > > > > > Great work! Congratulations! > > > > > >

Re: Graduation!

2017-01-10 Thread Andrew Hoblitzell
Good work all! On Tue, Jan 10, 2017 at 8:50 AM, Jesse Anderson wrote: > Excellent! > > On Tue, Jan 10, 2017, 7:12 AM Jacky Li wrote: > > > Great work! Congratulations! > > > > Regards, > > Jacky > > > > > 在 2017年1月10日,下午7:11,Sergio Fernández 写道: > > > > > > Congrats, guys! > > > > > > On Tue,

Re: Graduation!

2017-01-10 Thread Jesse Anderson
Excellent! On Tue, Jan 10, 2017, 7:12 AM Jacky Li wrote: > Great work! Congratulations! > > Regards, > Jacky > > > 在 2017年1月10日,下午7:11,Sergio Fernández 写道: > > > > Congrats, guys! > > > > On Tue, Jan 10, 2017 at 12:07 PM, Davor Bonaci wrote: > > > >> The ASF has publicly announced our graduati

Re: Graduation!

2017-01-10 Thread Jacky Li
Great work! Congratulations! Regards, Jacky > 在 2017年1月10日,下午7:11,Sergio Fernández 写道: > > Congrats, guys! > > On Tue, Jan 10, 2017 at 12:07 PM, Davor Bonaci wrote: > >> The ASF has publicly announced our graduation! >> >> >> https://blogs.apache.org/foundation/entry/the-apache- >> softwar

Re: Graduation!

2017-01-10 Thread Sergio Fernández
Congrats, guys! On Tue, Jan 10, 2017 at 12:07 PM, Davor Bonaci wrote: > The ASF has publicly announced our graduation! > > > https://blogs.apache.org/foundation/entry/the-apache- > software-foundation-announces > > https://beam.apache.org/blog/2017/01/10/beam-graduates.html > > Graduation is

Graduation!

2017-01-10 Thread Davor Bonaci
The ASF has publicly announced our graduation! https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces https://beam.apache.org/blog/2017/01/10/beam-graduates.html Graduation is a recognition of the community that we have built together. I am humbled to be part of