RE: Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-28 Thread alfredo.vasquez.spglobal.com via user
sary Context isn't made available. Perhaps you could use the State Processor API to bootstrap some state into the broadcast state. David On Mon, Sep 26, 2022 at 6:07 PM alfredo.vasquez.spglobal.com<http://alfredo.vasquez.spglobal.com> via user mailto:user@flink.apache.org>> wrot

RE: Kafka source stops consuming messages from topic after some minutes

2022-09-26 Thread alfredo.vasquez.spglobal.com via user
there's an issue which causes that operator to not progress as quickly, causing the source to pause/stop reading. Op do 1 sep. 2022 om 22:40 schreef alfredo.vasquez.spglobal.com<http://alfredo.vasquez.spglobal.com> via user mailto:user@flink.apache.org>>: Hello, Im using

Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-26 Thread alfredo.vasquez.spglobal.com via user
Hello community. Currently we have a BroadcastProcessFunction implementation that is storing the broadcast state using a MapStateDescriptor. I have a use case that needs to load the BroadcastState to perform some operation before receiving any processElement or processBroadcastElement message.

Kafka source stops consuming messages from topic after some minutes

2022-09-01 Thread alfredo.vasquez.spglobal.com via user
Hello, Im using flink-connector-kafka version 1.15.2 to consume messages from a kafka topic which has 3 partitions that later its connected to to another kafka source and then processed in a BroadcastProcessFunction. The Kafka source is created as follows: Properties properties = new Propertie