Re: Flink vs beam-flink-runner benchmark

2025-03-04 Thread XQ Hu via dev
>From the Beam side, I am not aware we have any benchmark about the native Flink vs FlinkRunner. Beam does regularly run some benchmarks with FlinkRunner using the GitHub workflows: https://github.com/apache/beam/tree/master/.github/workflows On Tue, Mar 4, 2025 at 9:42 AM Taher Koitawala wrote:

Re: Beam Infrastructure: Health Status Report for Feb 2025

2025-03-04 Thread XQ Hu via dev
Great job! On Tue, Mar 4, 2025 at 11:06 AM Danny McCormick via dev wrote: > Thanks Vitaly and team! Its great to see the progress; anecdotally, it has > also been nice to not have a bunch of flakes on most PRs :) > > On Tue, Mar 4, 2025 at 11:03 AM Vitaly Terentyev via dev < > dev@beam.apache.or

Re: Inquiry About GSoC Project - Beam ML Vector DB/Feature Store Integrations

2025-03-04 Thread Danny McCormick via dev
I generally agree that this would be good to add (along with something for Anthropic and maybe others). I think it is not necessarily within the scope of this project, though, so I would not recommend including it as an early item in a project proposal (it could be a nice to have if there's time at

Re: Lost permission to merge MRs

2025-03-04 Thread Jozef Vilcek
Will do! Thank you On Tue, Mar 4, 2025, 18:03 Robert Bradshaw via dev wrote: > Welcome back! > > Generally permission to merge is derived directly from your apache > credentials and status as a comitter (which you still are; merit > doesn't expire). I do seem to recall that there was an effort t

Re: Lost permission to merge MRs

2025-03-04 Thread Robert Bradshaw via dev
Welcome back! Generally permission to merge is derived directly from your apache credentials and status as a comitter (which you still are; merit doesn't expire). I do seem to recall that there was an effort to remove permissions from inactive accounts simply to reduce the attack surface (e.g. in

Lost permission to merge MRs

2025-03-04 Thread Jozef Vilcek
Hey, As project comitter, I do remember to have permission to merge MRs before. I did not contribute lately for a bit long time and now I see on my MR that after review is done I can not merge it: https://github.com/apache/beam/pull/33772 Can someone help me figure out how to fix it? Thanks, Joz

Re: Beam Infrastructure: Health Status Report for Feb 2025

2025-03-04 Thread Danny McCormick via dev
Thanks Vitaly and team! Its great to see the progress; anecdotally, it has also been nice to not have a bunch of flakes on most PRs :) On Tue, Mar 4, 2025 at 11:03 AM Vitaly Terentyev via dev < dev@beam.apache.org> wrote: > Dear Community, > > Our team has been actively monitoring and improving B

Re: Flink vs beam-flink-runner benchmark

2025-03-04 Thread Taher Koitawala
Any help here? On Sun, 2 Mar 2025 at 1:40 PM, Taher Koitawala wrote: > Hi All, > Curious question! Has someone done a benchmark on native flink > vs beam-flink-runner? > > Im wanting to know or ask, if there are differences in the following > areas( Consider Streaming only) > 1. Netwo

[Improvement Proposal] Enhancing Custom Metrics Visibility in Flink Runner

2025-03-04 Thread LDesire
Hello Apache Beam Community, While working with the Flink Runner, I've noticed that custom metrics are not easily visible in the Flink UI. (They can be checked in the Metrics tab of the Flink UI.) Typical users would expect to see these metrics in the Accumulators tab as well. However, in the

Beam High Priority Issue Report (23)

2025-03-04 Thread beamactions
This is your summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/33407 [Bug]: tfrecordio does no