Re: Flink Kubernetes Operator: Table Not Inserted When Using Parallel Job

2023-05-10 Thread Sharil Shafie
Update: I haven't tried your first suggestion but I managed to get it working by setting up the source idle timeout. Thanks for your help. Regards. On Thu, May 11, 2023 at 12:34 PM Sharil Shafie wrote: > Hi, > > I believe only one partition based on the log output below. I didn't make > any

Re: Flink Kubernetes Operator: Table Not Inserted When Using Parallel Job

2023-05-10 Thread Sharil Shafie
Hi, I believe only one partition based on the log output below. I didn't make any changes to the DataGenerator from the flink playground. 2023-05-10 11:55:33,082 WARN org.apache.kafka.clients.admin.AdminClientConfig [] - These configurations '[key.deserializer, commit.offsets.on.chec

Re: Flink Kubernetes Operator: Table Not Inserted When Using Parallel Job

2023-05-10 Thread Weihua Hu
Hi, How many partitions does your kafka topic have? One possibility is that the kafka topic has only one partition, and when the source parallelism is set to 2, one of the source tasks cannot consume data and generate the watermark, so the downstream operator cannot align the watermark and cannot