Are the Table API Connectors production ready?

2023-02-26 Thread ravi_suryavanshi.yahoo.com via user
Hi Team, In Flink 1.16.0, we would like to use some of the Table API Connectors for production. Kindly let me know if the below connectors are production ready or only for testing purposes. | Name | Version | Source | Sink | | Filesystem | | Bounded and Unbounded Scan, Lookup | Streaming Sink,

Re: Is there any API method for dynamic loading of the UDF jar

2023-02-26 Thread yuxia
Flink 1.17 which is to be released recently will support it[1] in table environment[2]. No any difference in performance between TableEnvironment method calls and TableEnvironment.executeSql, the api is different but the runtime is same under the hood. You can choose any one of them according

Is there any API method for dynamic loading of the UDF jar

2023-02-26 Thread neha goyal
Hello, In Flink 16, CREATE FUNCTION USING JAR functionality has been introduced where we can specify the jar resources and the jar can be located in a remote file system such as hdfs/s3. I don't see an alternative method for the same functionality using the TableEnvironment methods call, for examp

Re: RE: Re: Re: Should we always mark ValueState as "transient" forRichFunctions

2023-02-26 Thread Gen Luo
Hi, I suppose there are two things to clarify: 1. the function object will only be serialized once when deploying and deserialized once per task while initializing. 2. the ValueState itself is only a handle. It is set/setup with the key of each incoming record. When serializing, it is only a null