No, I'm using a collection source + 20 same JDBC lookups + Kafka sink. On Mon, 26 Jun 2023 at 19:17, Yaroslav Tkachenko <yaros...@goldsky.com> wrote:
> Hey Brendan, > > Do you use a file source by any chance? > > On Mon, Jun 26, 2023 at 4:31 AM Brendan Cortez < > brendan.cortez...@gmail.com> wrote: > >> Hi all! >> >> I'm trying to submit a Flink Job in Application Mode in the Kubernetes >> cluster. >> >> I see some problems when an application has a big number of operators >> (more than 20 same operators) - it freezes for ~6 minutes after >> *2023-06-21 15:46:45,082 WARN >> org.apache.flink.connector.kafka.sink.KafkaSinkBuilder [] - Property >> [transaction.timeout.ms <http://transaction.timeout.ms/>] not specified. >> Setting it to PT1H* >> and until >> >> *2023-06-21 15:53:20,002 INFO >> org.apache.flink.streaming.api.graph.StreamGraphGenerator [] - Disabled >> Checkpointing. Checkpointing is not supported and not needed when executing >> jobs in BATCH mode.*(logs in attachment) >> >> When I set log.level=DEBUG, I see only this message each 10 seconds: >> *2023-06-21 14:51:30,921 DEBUG >> org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - >> Trigger heartbeat request.* >> >> Please, could you help me understand the cause of this problem and how to >> fix it. I use the Flink 1.15.3 version. >> >> Thank you in advance! >> >> Best regards, >> Brendan Cortez. >> >
