Got it! Thanks so much, and will try it out!
-siyu
>
> On May 6, 2022, at 4:53 PM, Pablo Estrada wrote:
>
>
> Hi Siyu!
> Yeah, that's a good question!
>
> Depending on the properties of the client that you're using, you can create
> it as a class/static variable rather than an instance va
sorry for typo “recommissioned way” should be “recommended way”
> On May 6, 2022, at 4:31 PM, Siyu Lin wrote:
>
>
> Hi Pablo,
>
> Thanks so much for your explanation!
>
> Also, for prom client in the do fn, do we need to initialize them in the
> setup code? My concern is that if we have t
Hi Pablo,
Thanks so much for your explanation!
Also, for prom client in the do fn, do we need to initialize them in the setup
code? My concern is that if we have this initialization in each do fn, we might
overwhelm the memory. I think we can pass them as the parameter? Do you have a
recommis
Hi Pablo,
No worries at all!
Was wondering if “add any dependencies” means to add a side container to the
dataflow runner? Like prometheus scraper?
If so, is it only working for dataflow runner v2? We have not upgraded to v2
yet so it might be hard to do that in v1.
Thanks so much!
Siyu
>
Hi Jeff,
Thanks so much for your quick responses. It is unfortunate that histogram is
unavailable in dataflow. Do you know if there are any workaround? Or do you
think it is plausible if we can use runner v2 and customize the image with
Prometheus exporter?
Thanks again!
Siyu
>
> On Apr 4,
Siyu - The Beam metrics interface includes the Distribution metric type
which can be used for histograms:
https://beam.apache.org/documentation/programming-guide/#types-of-metrics
Particulars of support depend on the runner. For Cloud Dataflow, the
reported values are MAX, MIN, MEAN, and COUNT, s
Hi Beam community,
I am wondering if there is histogram metrics available (or alternative
recommendations) for showing up quantiles. We have counter metrics already but
we would also like to see some quantiles for different values.
Thanks a lot!
Siyu
