Re:Re: sink upsert materializer in SQL job

2024-02-18 Thread Xuyang
Hi, Marek. Sorry for this late reply because of the Spring Festival in China. When the upsert keys is empty that can't be deduced or are different with the pk in. sink, flink will genereta upsert materializer when `table.exec.sink.upsert-materialize = FORCE`. You can see the code here[1]. You

Re: sink upsert materializer in SQL job

2024-02-08 Thread Marek Maj
Hi Xuyang, Thank you for the explanation, table.exec.sink.upsert-materialize = FORCE config was set unnecessarily, I just redeployed the job and confirmed that when using default AUTO, materializer is still on Thank you for the example you provided. My understanding of upsert key was exactly as yo

sink upsert materializer in SQL job

2024-01-31 Thread Marek Maj
Hello Flink Community, In our Flink SQL job we are experiencing undesirable behavior that is related to events reordering (more below in background section) I have a few questions related to sink upsert materializer, the answer to them should help me understand its capabilities: 1. Does the materi