Re: Job hanging taking savepoint on legacy Flink

Hi Le The problem looks like there's not enough memory segment in the task manager where the source wants to emit result data. You can check the usage of network buffer pool in your webui and try to increase the size of network buffer pool if it is not enough. You can see more information about n

Re: org.apache.flink.runtime.rpc.exceptions.RecipientUnreachableException

Hi Ajinkya It seems that the JobMaster is not started successfully. If possible, you can provide more information to help analyze the problem. Best, Shammon FY On Wed, Mar 22, 2023 at 10:57 AM Ajinkya Pathrudkar < ajinkya.pathrudka...@gmail.com> wrote: > > I am writing to inform you of a recen

Re: Handling JSON Serialization without Kryo

Hi Ken,I’m going to profile the job today to try and get a better handle on where the bottleneck is. The job currently just passes around JsonObjects between the operators, which are relying on Kryo. The job also writes to Postgres, Kafka, and Elasticsearch so it’s possible that one of those is cau

Re: Bootstrapping multiple state within same operator

Not familiar with the implementation but thinking some options: - composable transformations - underlying MultiMap - ... On Wed, Mar 22, 2023 at 10:24 AM Hang Ruan wrote: > Hi, David, > I also read the code about the `SavepointWriter#withOperator`. The > transformations are stored in a `Map` wh

Re: Bootstrapping multiple state within same operator

Hi, David, I also read the code about the `SavepointWriter#withOperator`. The transformations are stored in a `Map` whose key is `OperatorID`. I don't come up with a way that we could register multi transformations for one operator with the provided API. Maybe we need a new type of `XXXStateBoots

Bootstrapping multiple state within same operator

We are using state processor API to bootstrap the state of some operators. It has been working fine until now, when