Re: pyFlink UDTF function registration

2020-07-16 Thread Manas Kale
Hi Xingbo, Thank you for the elaboration. Note that all of this is for a streaming job. I used this code to create a SQL VIEW : f""" CREATE VIEW TMP_TABLE AS SELECT monitorId, featureName, featureData, time_st FROM ( SELECT monitorId, featureName, featureData, time_st FROM {INPUT_T

Re: pyFlink UDTF function registration

2020-07-15 Thread Xingbo Huang
Hi Manas, You need to join with the python udtf function. You can try the following sql: ddl_populate_temporary_table = f""" INSERT INTO {TEMPORARY_TABLE} SELECT * FROM ( SELECT monitorId, featureName, featureData, time_st FROM {INPUT_TABLE}, LATERAL TABLE(split(data)) as T(feature

pyFlink UDTF function registration

2020-07-15 Thread Manas Kale
Hi, I am trying to use a UserDefined Table Function to split up some data as follows: from pyflink.table.udf import udtf @udtf(input_types=DataTypes.STRING(), result_types= [DataTypes.STRING(), DataTypes.DOUBLE()]) def split_feature_values(data_string): json_data = loads(data_string) for