[ANN] Apache Beam 2.5.0 has been released!

The Apache Beam team is pleased to announce the release of 2.5.0 version! You can download the release here: https://beam.apache.org/get-started/downloads/ This release includes the following major new features & improvements: - Go SDK support - new ParquetIO - Build migrated to Gradle (

Re: Parallelizing test runs

- How many resources to ValidatesRunner tests use? - Where are those settings? On Sat, Jun 30, 2018 at 9:50 AM Reuven Lax wrote: > The specific issue only affects Dataflow ValidatesRunner tests. We > currently allow only one of these to run at a time, to control usage of > Dataflow and of GCE qu

Re: Parallelizing test runs

The specific issue only affects Dataflow ValidatesRunner tests. We currently allow only one of these to run at a time, to control usage of Dataflow and of GCE quota. Other types of tests do not suffer from this issue. I would like to see if it's possible to increase Dataflow quota so we can run mo

Parallelizing test runs

+Reuven Lax told me yesterday that he was waiting for some test to be scheduled and run, and it took 6 hours or so. I would like to help reduce these wait times by increasing parallelism. I need help understanding the continuous minimum of what we use. It seems the following is true: - There

Re: Beam's recent community development work

Ken, This is really good. I would like to emphasize one nuance, however. That is that when you get to the committer consideration step, there is a strong Apache tradition that the actual decision about committer-ship is not communicated to the candidate to avoid disappointment or campaigning duri

Re: Samza runner committer support

Thanks you guys for volunteering! Looks we got plenty coverage on portability, Python and Go. I will reach out to you guys for reviews and questions. Thanks, Xinyu On Fri, Jun 29, 2018 at 2:51 PM, Lukasz Cwik wrote: > I would also have context on any portability related changes and would be > g

Re: [Design Proposal] Improving Beam code review

Thanks for driving this Huygaa! I'm excited to see this happen, this is going to make a big difference in contributor and reviewer experience. On Fri, Jun 29, 2018 at 5:29 PM Huygaa Batsaikhan wrote: > Thanks everyone who reviewed the doc and suggested good ideas. Here is a > recap of the docume

Jenkins build is back to stable : beam_SeedJob #2122

See

Jenkins build became unstable: beam_SeedJob #2121

See

Build failed in Jenkins: beam_Release_Gradle_NightlySnapshot #85

See Changes: [xiliu] [BEAM-4641] Samza runner postcommit status in PR template [Scott Wegner] Update pre-commit filter to include migrated build rules [lukasz.gajowy] Remove mvn leftovers from

Re: Beam's recent community development work

Very interesting! I especially like the different levels of engagement and beam committers actively engaging potential committers to mentor them towards reaching the next level. This fact together with the feedback loop sounds like a very promising and encouraging system. Thanks a lot Yasser and K

Re: Beam's recent community development work

Thank you very much Kenneth, they're nice points! Regards. On 6/30/2018 10:45 AM, Kenneth Knowles wrote: > Hi all, > > The ASF board suggested that we (Beam) share some of what we've been doing > for community development with d...@community.apache.org and > memb...@apache.org. So here is a long