Re: [Feature Proposal] Expose Kafka Client Metrics in Beam

2025-02-27 Thread Danny McCormick via dev
Thanks for putting this together! I am generally in favor of a DIY PTransform option for now to get the value of these metrics in the shorter term. I am interested in the alternative of restructuring metrics, but I agree that we shouldn't block all progress on this. Thanks, Danny On Wed, Feb 26,

[Feature Proposal] Expose Kafka Client Metrics in Beam

2025-02-26 Thread Osvaldo Fernandez
All, I've shared with you a link below to a document detailing a limitation of Beam's metric system, and its impact on KafkaIO and Kafka clients as a whole. I have outlined a handful of proposed solutions, and I'd greatly appreciate your time looking at this. Thank you all in advance! Best, Ozzie