Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-09 Thread via GitHub
NGA-TRAN commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2135732154 ## datafusion/physical-plan/src/metrics/custom.rs: ## @@ -0,0 +1,113 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor lic

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-06 Thread via GitHub
alamb commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2950705663 🚀 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-06 Thread via GitHub
alamb merged PR #16195: URL: https://github.com/apache/datafusion/pull/16195 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusi

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-06 Thread via GitHub
alamb commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2950705278 We have now made the release-48 branch so what is merged into main will be released as part of DataFusion 49.0.0 -- This is an automated message from the Apache Git Service. To respo

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-05 Thread via GitHub
alamb commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2945581697 Let's wait to merge this PR until we ship DataFusion 48 to limit the breaking changes - #15771 I think we'll be able to merge this in the next few days -- This is an autom

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-05 Thread via GitHub
alamb commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2944619110 > > Should it target main or the 47 branch ? > > The `main` branch is the good one (I don't think the branch-47 is the most recent release branch anyway) yeah, let's targe

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-05 Thread via GitHub
sfluor commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2943143826 There was one remaining test failing, I fixed it and updated the PR to the latest branch. Should it target `main` or the `47` branch ? -- This is an automated message from the Apach

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-05 Thread via GitHub
gabotechs commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2943183513 > Should it target main or the 47 branch ? The `main` branch is the good one (I don't the branch-47 is the most recent release branch anyway) -- This is an automated messa

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-04 Thread via GitHub
sfluor commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2940051045 Thanks for the review @alamb ! I removed the panic and went with a default value of 0 -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-04 Thread via GitHub
alamb commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2126288404 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +528,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-04 Thread via GitHub
alamb commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2126279454 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -344,7 +344,7 @@ impl Drop for ScopedTimerGuard<'_> { /// Among other differences, the metric types have dif

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-04 Thread via GitHub
LiaCastaneda commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2126024222 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +528,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-04 Thread via GitHub
LiaCastaneda commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2126024222 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +528,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-03 Thread via GitHub
sfluor commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2123513896 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -516,6 +596,21 @@ impl MetricValue { (Self::EndTimestamp(timestamp), Self::EndTimestamp(other_

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-03 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2123429852 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -516,6 +596,21 @@ impl MetricValue { (Self::EndTimestamp(timestamp), Self::EndTimestamp(oth

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-03 Thread via GitHub
sfluor commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2934299401 I have addressed the remaining comments cc @LiaCastaneda / @gabotechs / @alamb -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-02 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2120615931 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -401,6 +401,90 @@ pub enum MetricValue { StartTimestamp(Timestamp), /// The time at which execu

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-02 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2120632856 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +528,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-02 Thread via GitHub
alamb commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2121402980 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -344,7 +344,7 @@ impl Drop for ScopedTimerGuard<'_> { /// Among other differences, the metric types have dif

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-02 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2120615931 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -401,6 +401,90 @@ pub enum MetricValue { StartTimestamp(Timestamp), /// The time at which execu

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-06-01 Thread via GitHub
alamb commented on PR #16195: URL: https://github.com/apache/datafusion/pull/16195#issuecomment-2927412259 @gabotechs / @LiaCastaneda please ping me when you think this PR is ready for a review / merge Thank you for the help getting it ready -- This is an automated message from th

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2109744098 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -401,6 +401,22 @@ pub enum MetricValue { StartTimestamp(Timestamp), /// The time at which execu

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
sfluor commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2110945415 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +460,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2109744098 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -401,6 +401,22 @@ pub enum MetricValue { StartTimestamp(Timestamp), /// The time at which execu

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
gabotechs commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2109611063 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -443,6 +460,9 @@ impl MetricValue { .and_then(|ts| ts.timestamp_nanos_opt())

Re: [PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
LiaCastaneda commented on code in PR #16195: URL: https://github.com/apache/datafusion/pull/16195#discussion_r2109164412 ## datafusion/physical-plan/src/metrics/value.rs: ## @@ -589,6 +632,79 @@ mod tests { use super::*; +#[derive(Debug, Default)] +pub struct Cu

[PR] feat: Support defining custom MetricValues in PhysicalPlans [datafusion]

2025-05-27 Thread via GitHub
sfluor opened a new pull request, #16195: URL: https://github.com/apache/datafusion/pull/16195 See this issue: https://github.com/apache/datafusion/issues/16044 The MetricValue enum currently exposes only single-value statistics: counts, gauges, timers, timestamps, and a few hard-code