Re: Dataflow v2 runner scaling behaviour

Hi Pablo, Did you find out anything? Any suggestion we can try? Many thanks, David On Wed, Mar 24, 2021 at 5:19 PM David Sánchez wrote: > Hi Pablo, > > This is the input data we are testing > > Elements added38,792,932 > Estimated size3.14 GB > > On Wed, Mar 24, 2021 at 5:09 PM Pablo Estrada

Re: Query regarding support for ROLLUP

+Andrew Pilloud do you know if this is a bug? On Tue, May 4, 2021 at 7:38 AM D, Anup (Nokia - IN/Bangalore) < anu...@nokia.com> wrote: > Hi All, > > > > I was trying to use “GROUP BY WITH ROLLUP” (2.29.0 version) which I saw > here - > https://beam.apache.org/documentation/dsls/sql/calcite/query

Re: Query regarding support for ROLLUP

I can confirm we don't have anything in Beam to support ROLLUP, it is silently dropped. I opened https://issues.apache.org/jira/browse/BEAM-12288, support needs to be implemented in sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/rel/BeamAggregationRel.java For now

Re: New Beam Glossary

+user@beam for visibility Thanks David! -- Forwarded message - From: David Huntsperger Date: Wed, May 5, 2021 at 10:25 AM Subject: New Beam Glossary To: Hey all, We published a new Apache Beam glossary , to help new users learn

Re: Exporting beam custom metrics to Prometheus

Hi Feba, Yes, AFAIK, detach mode doesn’t support metrics currently [1], so you cannot query metrics result like [2]. If anyone knows how to achieve this with Flink runner, please reply here. But you can still get some runtime metrics as Flink will push some run time metrics available to Prome