Order of Execution in KeyedBroadcastProcessFunction

2023-09-07 Thread Anil K
Hi, I am new to flink. I am trying to write a job that updates the Keyed State when a Broadcast Message is received in KeyedBroadcastProcessFunction. I was wondering will the *ctx.applyToKeyedState* in the processBroadCastElement will get completed before further messages are processed in the *pro

Re: Question About Histograms

2022-04-05 Thread Anil K
; > Thanks, > Prasanna. > > On Tue, 5 Apr 2022, 01:26 Anil K, wrote: > >> Hi, >> I was doing some experimentation using Histograms, had a few questions >> mostly related to fault tolerance and restarts. I am looking for a way to >> calculate p95 over 30days.

Question About Histograms

2022-04-04 Thread Anil K
Hi, I was doing some experimentation using Histograms, had a few questions mostly related to fault tolerance and restarts. I am looking for a way to calculate p95 over 30days. Since histograms are pushed as a summary into prometheus, will not be able to do the aggregation for 30 days at Prometheus'

Tracking ID in log4j MDC

2020-12-01 Thread Anil K
Hi All, Is it possible to have a tracking id in MDC that will be shared across chained users defined operations like Filter, KeySelector, Flat map, Process function, and Producer? Tracking id will be read from headers of Kafka Message, which if possible plan to set to MDC in log4j. Right now I a

Re: FlinkKafakaProducer with Confluent SchemaRegistry and KafkaSerializationSchema

2020-04-21 Thread Anil K
> Best, > Fabian > > [1] > https://github.com/apache/flink/blob/master/flink-end-to-end-tests/flink-confluent-schema-registry/src/main/java/org/apache/flink/schema/registry/test/TestAvroConsumerConfluent.java > > Am Sa., 18. Apr. 2020 um 19:17 Uhr schrieb Anil K >: >

FlinkKafakaProducer with Confluent SchemaRegistry and KafkaSerializationSchema

2020-04-18 Thread Anil K
Hi, What is the best way to use Confluent SchemaRegistry with FlinkKafkaProducer? What I have right now is as follows. SerializationSchema serializationSchema = ConfluentRegistryAvroSerializationSchema.forGeneric(topic, schema, schemaRegistryUrl); FlinkKafkaProducer kafkaProducer = new