deploy jars into our maven repo

2023-08-23 Thread gabrywu
Hi, folks, I'm new to gradle, and trying to deploy beam jars to our maven repo, can you help to do it?Is there a wiki about it?

Beam High Priority Issue Report (40)

2023-08-23 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/28104 [Failing Test]: gra

Re: deploy jars into our maven repo

2023-08-23 Thread Kenneth Knowles
Hello! I doubt this is a Beam question. We use gradle publish plugin in pretty much the normal way. How you publish the jars (or just copy/paste them) into your personal or company maven repo is up to you! Kenn On Wed, Aug 23, 2023 at 4:06 AM gabrywu wrote: > Hi, folks, > I'm new to gradle, an

Request for submissions | Can Beam slow down a PCollection?

2023-08-23 Thread Damon Douglas
Hello Everyone, As part of a long term research and development into throttling API requests within Beam pipelines, we are asking for your opinion in the form of code snippets. The following document briefly reviews the problem statement and some instructions on how you could submit your code snip

Re: [Request for Feedback] Swift SDK Prototype

2023-08-23 Thread Byron Ellis via dev
Indeed :-) Yeah, I went back and forth on the pardo syntax quite a bit before settling on where I ended up. Ultimately I decided to go with something that felt more Swift-y than anything else which means that rather than dealing with a single element like you do in the other SDKs you're dealing wit

Re: [Request for Feedback] Swift SDK Prototype

2023-08-23 Thread Byron Ellis via dev
Oh, I also forgot to mention that I included element-wise collection operations like "map" that eliminate the need for pardo in many cases. the groupBy command is actually a map + groupByKey under the hood. That was to be more consistent with Swift's collection protocol (and is also why PCollection

Beam Website Feedback

2023-08-23 Thread Jonas Eyob
Hi on this page: https://beam.apache.org/documentation/io/built-in/google-bigquery/#storage-api Under "Using Storage Read API" there is a paragraph and example showing how Beam SDK for Python can use the Bigquery Storage API. But in code snippet box just below it says "The SDK for Python does no