Beam High Priority Issue Report (39)

2024-02-08 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/29971 [Bug]: FixedWindows

Re: Playground: File Explorer?

2024-02-08 Thread XQ Hu via dev
Can you provide which example you are referring to? I checked a few examples and usually we use beam.Map(print) to display some output values. On Wed, Feb 7, 2024 at 8:55 PM Joey Tran wrote: > Hey all, > > I've been really trying to use Playground for educating new Beam users but > it feels like

Re: Playground: File Explorer?

2024-02-08 Thread Joey Tran
Here's two: https://play.beam.apache.org/?path=SDK_PYTHON_MultipleOutputPardo&sdk=python https://play.beam.apache.org/?path=SDK_PYTHON_WordCount&sdk=python Also, how often does playground get redeployed? I put up a PR[1] that's been merged for try to reduce the amount of logging these examples pro

Re: Playground: File Explorer?

2024-02-08 Thread Robert Burke
We redeploy the playground along with the release, so once 2.54.0 RC2 has been validated and voted on, I'll be redeploying it with 2.54.0. On Thu, Feb 8, 2024, 7:18 AM Joey Tran wrote: > Here's two: > > https://play.beam.apache.org/?path=SDK_PYTHON_MultipleOutputPardo&sdk=python > https://play.b

Re: Playground: File Explorer?

2024-02-08 Thread Joey Tran
Ah that makes sense. Does the new version of Playground get staged for release validation? On Thu, Feb 8, 2024 at 12:08 PM Robert Burke wrote: > We redeploy the playground along with the release, so once 2.54.0 RC2 has > been validated and voted on, I'll be redeploying it with 2.54.0. > > On Thu

Re: [VOTE] Release 2.54.0, release candidate #2

2024-02-08 Thread Chamikara Jayalath via dev
+1 (binding) Tried out Java/Python multi-lang jobs and upgrading BQ/Kafka transforms from 2.53.0 to 2.54.0 using the Transform Service. Thanks, Cham On Wed, Feb 7, 2024 at 5:52 PM XQ Hu via dev wrote: > +1 (non-binding) > > Validated with a simple RunInference Python pipeline: > https://github

Re: [DESIGN PROPOSAL] Reshuffle Allowing Duplicates

2024-02-08 Thread Kenneth Knowles
On Wed, Feb 7, 2024 at 5:15 PM Robert Burke wrote: > OK, so my stance is a configurable Reshuffle might be interesting, so my > vote is +1, along the following lines. > > 1. Use a new URN (beam:transform:reshuffle:v2) and attach a new > ReshufflePayload to it. > Ah, I see there's more than one v

Re: [DESIGN PROPOSAL] Reshuffle Allowing Duplicates

2024-02-08 Thread Robert Burke
Was that only October? Wow. Option 2 SGTM, with the adjustment to making the core of the URN "redistribute_allowing_duplicates" instead of building from the unspecified Reshuffle semantics. Transforms getting updated to use the new transform can have their @RequiresStableInputs annotation added

Re: [VOTE] Release 2.54.0, release candidate #2

2024-02-08 Thread Svetak Sundhar via dev
+1 (Non-Binding) Tested with Python SDK on DirectRunner and Dataflow Runner Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, Feb 8, 2024 at 12:45 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > +1 (binding) > > Tried out Java/Python multi-lang jobs and upgradin

Re: Playground: File Explorer?

2024-02-08 Thread Robert Burke
I think in principle we could update the release process to do that, but it would require adjusting how we build the staging version of the playground to accommodate how each SDK handles RCs. At present it's very geared towards building from released versions. On Thu, Feb 8, 2024, 9:18 AM Joey Tr