Re: Re: Re: Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-02 Thread Benchao Li
I just run it in my IDE. sunfulin 于2020年3月2日周一 下午9:04写道: > > > Hi, > Yep, I am using 1.10 > Did you submit the job in the cluster or just run it in your IDE? Because > I can also run it successfully in my IDE, but cannot run it through cluster > by a shading jar. So I think maybe the problem is

Re:Re: Re: Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-02 Thread sunfulin
Hi, Yep, I am using 1.10 Did you submit the job in the cluster or just run it in your IDE? Because I can also run it successfully in my IDE, but cannot run it through cluster by a shading jar. So I think maybe the problem is related with maven jar classpath. But not sure about that. If y

Re: Re: Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-02 Thread Benchao Li
Hi fulin, I cannot reproduce your exception on current master using your SQLs. I searched the error message, it seems that this issue[1] is similar with yours, but it seems that current compile util does not have this issue. BTW, do you using 1.10? [1] https://issues.apache.org/jira/browse/FLINK

Re:Re: Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread sunfulin
create table lscsp_sc_order_all ( amount varchar , argType varchar, balance varchar, branchNo varchar , businessType varchar , channelType varchar , counterOrderNo varchar , counterRegisteredDate varchar, custAsset varchar , customerNumber varchar, customerType varc

Re: Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread Benchao Li
Could you also provide us the DDL for lscsp_sc_order_all and dim_app_cust_info ? sunfulin 于2020年3月1日周日 下午9:22写道: > > *CREATE TABLE **realtime_product_sell *( > sor_pty_id *varchar*, > entrust_date *varchar*, > entrust_time *varchar*, > product_code *varchar *, > business_type *varchar

Re:Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread sunfulin
CREATE TABLE realtime_product_sell ( sor_pty_id varchar, entrust_date varchar, entrust_time varchar, product_code varchar , business_type varchar , balance double , cust_name varchar , open_comp_name varchar , open_comp_id varchar , org_name varchar , org_id varchar , com

Re: Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread Benchao Li
The UDF looks good. Could you also paste your DDL? Then we can produce your bug easily. sunfulin 于2020年3月1日周日 下午6:39写道: > Below is the code. The function trans origin field timeStr "2020-03-01 > 12:01:00.234" to target timeStr accroding to dayTag. > > *public class *ts2Date *extends *ScalarFunct

Re:Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread sunfulin
Below is the code. The function trans origin field timeStr "2020-03-01 12:01:00.234" to target timeStr accroding to dayTag. public class ts2Date extends ScalarFunction { public ts2Date() { } public String eval (String timeStr, boolean dayTag) { if(timeStr == null) {

Re: Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread Benchao Li
Could you show how your UDF `ts2Date` is implemented? sunfulin 于2020年3月1日周日 下午6:05写道: > Hi, Benchao, > Thanks for the reply. > > Could you provide us more information? > 1. what planner are you using? blink or legacy planner? > I am using Blink Planner. Not test with legacy planner because my pr

Re: Flink SQL job failed to submit with enableCheckpointing while SQL contains UDF

2020-03-01 Thread Benchao Li
Hi fulin, It seems like a bug in the code generation. Could you provide us more information? 1. what planner are you using? blink or legacy planner? 2. how do you register your UDF? 3. does this has a relation with checkpointing? what if you enable checkpointing and not use your udf? and disable