Re: custom metric reporter

Hi Sigalit Did you add the classpath to the META-INF.services folder of the reporter? [cid:image001.png@01DAE256.1C0ADDF0] The content of my file is: org.apache.flink.metrics.custom.NestedGaugePrometheusReporterFactory Kind regards Dominik From: Sigalit Eliazov Date: Monday, 29 July 2024 a

checkpoint upload thread

Hi,Community:   Does Flink upload states and inflight buffers within the same opratorchain using the same connection (instead of per connection per operator)?

Re: [Request Help] flinkcdc start with errorjava.lang.NoClassDefFoundError:org/apache/flink/cdc/common/sink/MetadataApplier

Hi Xiqian, Thanks,Xiqian.I checked the Flink Home /lib directory  and found  i put  flink-cdc-pipeline-connector-mysql-3.1.jar,flink-cdc-pipeline-connector-doris-3.1.jar in /lib directory. I remove these two and go right.I think maybe jar conflicts. I had use flink-cdc 3.0 and  it go right Reg

custom metric reporter

hi we have upgraded from flink 1.16 to 1.18 and our custom metric stopped working. i saw in the release note of 1.17 that there was a change so i have defined the following metrics.reporters: otlp metrics.reporter.otlp.factory.class: xxx.flink.metrics.otlp.OpenTelemetryProtocolReporterFactory metr

Using state processor for a custom windowed aggregate function

Hello, I am trying to create state for an aggregate function that is used with a GlobalWindow. This basically looks like: savepointWriter.withOperator( OperatorIdentifier.forUid(UID), OperatorTransformation.bootstrapWith(stateToMigrate) .keyBy(...) .window(GlobalWindows.cr

[ANNOUNCE] Apache Celeborn 0.5.1 available

Hello all, Apache Celeborn community is glad to announce the new release of Apache Celeborn 0.5.1. Celeborn is dedicated to improving the efficiency and elasticity of different map-reduce engines and provides an elastic, highly efficient service for intermediate data including shuffle data, spill

[ANNOUNCE] Apache Celeborn 0.4.2 available

Hello all, Apache Celeborn community is glad to announce the new release of Apache Celeborn 0.4.2. Celeborn is dedicated to improving the efficiency and elasticity of different map-reduce engines and provides an elastic, highly efficient service for intermediate data including shuffle data, spill

Re: Expose rocksdb options for flush thread.

This has been not moved for a while so assigned to you. G On Mon, Jul 15, 2024 at 9:06 AM Zhongyou Lee wrote: > Hellow everyone : > > Up to now, To adjuest rocksdb flush thread the only way is implement > ConfigurableRocksDBOptionsFactory #setMaxBackgroundFlushes by user. I found > FLINK-22059

Re: SavepointReader: Record size is too large for CollectSinkFunction

I've double checked and I think that CollectSinkOperatorFactory is initialized in DataStream.collectAsync without MAX_BATCH_SIZE and SOCKET_TIMEOUT values coming from the Flink config. Could you plz share the whole stacktrace to double check my assumption? G On Tue, Jul 23, 2024 at 12:46 PM Salv