Re: Is it possible to change 'connector.startup-mode' option in the flink job

2020-05-18 Thread Thomas Huang
Hi Jingsong, Cool, Thanks for your reply. Best wishes. From: Jingsong Li Sent: Tuesday, May 19, 2020 10:46 To: Thomas Huang Cc: Flink Subject: Re: Is it possible to change 'connector.startup-mode' option in the flink job Hi Thomas, Good to hea

Re: Is it possible to change 'connector.startup-mode' option in the flink job

2020-05-18 Thread Jingsong Li
Hi Thomas, Good to hear from you. This is a very common problem. In 1.11, we have two FLIP to solve your problem. [1][2] You can take a look. I think dynamic table options (table hints) is enough for your requirement. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-113%3A+Supports+Dyna

Is it possible to change 'connector.startup-mode' option in the flink job

2020-05-18 Thread Thomas Huang
Hi guys, I'm using hive to store kafka topic metadata as follows:: CREATE TABLE orders ( user_idBIGINT, productSTRING, order_time TIMESTAMP(3), WATERMARK FOR order_time AS order_time - '5' SECONDS ) WITH ( 'connector.type' = 'kafka',