Re: Backpressure handling in FileSource APIs - Flink 1.16

2023-05-21 Thread Kamal Mittal
Hello Community, Can you please share views about the query asked above w.r.t back pressure for FileSource APIs for Bulk and Record stream formats. Planning to use these APIs w.r.t AVRO to Parquet and vice-versa conversion. Rgds, Kamal On Thu, May 18, 2023 at 2:33 PM Kamal Mittal wrote: > Hel

Re: [Flink K8s Operator] Automatic cleanup of terminated deployments

2023-05-21 Thread Paul Lam
Hi Gyula, Thank you and sorry for the late response. My use case is that users may run finite jobs (either batch jobs or finite stream jobs), leaving a lot of deprecated flink deployments around. I’ve filed a ticket[1]. [1] https://issues.apache.org/jira/browse/FLINK-32143 Best, Paul Lam >

Re: python udf with flinksql

2023-05-21 Thread Dian Fu
Hi Tom, The following statement is incorrect. ``` CREATE FUNCTION add AS 'custom_udf_2.MyUDF' LANGUAGE PYTHON; ``` You should define it as following: custom_udf_2.py ``` from pyflink.table.udf import ScalarFunction, udf from pyflink.table import DataTypes class MyUDF(ScalarFunction): def __in