Beam High Priority Issue Report (47)

2024-01-30 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/29971 [Bug]: FixedWindows

[prism] Programmatic Cancel, and Drain

2024-01-30 Thread Damon Douglas
Good day, Everyone, We are implementing a Cancel and Drain feature for the Prism runner. Please see https://github.com/apache/beam/issues/29669 that contains everything that goes into a design document. For more information about Prism, please see https://github.com/apache/beam/tree/master/sdks/go

[DESIGN PROPOSAL] Reshuffle Allowing Duplicates

2024-01-30 Thread Kenneth Knowles
Hi all, Just when you thought I had squeezed all the possible interest out of this most boring-seeming of transforms :-) I wrote up a very quick proposal as a doc [1]. It is short enough that I will also put the main idea and main question in this email so you can quickly read. Best to put commen

Re: [DESIGN PROPOSAL] Reshuffle Allowing Duplicates

2024-01-30 Thread Robert Burke
Is the benefit of this proposal just the bounded deviation from the existing reshuffle? Reshuffle is already rather dictated by arbitrary runner choice, from simply ignoring the node, to forcing a materialization break, to a full shuffle implementation which has additional side effects. But model