Re: Using Hive UDFs

2021-04-28 Thread Rui Li
Hi Youngwoo, That's no problem at all and glad to know the UDF works now. Yeah, before you can use a hive udf, you should register it into metastore. And that can be done via either Flink or Hive. Feel free to let me know if you encounter any other issues. On Wed, Apr 28, 2021 at 4:28 PM Youngwo

Re: Using Hive UDFs

2021-04-28 Thread 김영우
Hey Rui, My bad! You have already pointed out to me what I completely misunderstood. I've been confusing some of the steps to register udfs. And also, somehow, my metastore was a mess. So, I cleaned up the metastore and database and then, I created a database for hive catalog and registered the fu

Re: Using Hive UDFs

2021-04-27 Thread 김영우
Hey Rui, For geospatial udfs, I've configured these jars to my flink deployment: # Flink-Hive RUN wget -q -O /opt/flink/lib/flink-sql-connector-hive-3.1.2_2.12-1.12.2.jar https://repo1.maven.org/maven2/org/apache/flink/flink-sql-connector-hive-3.1.2_2.12/1.12.2/flink-sql-connector-hive-3.1.2_2.1

Re: Using Hive UDFs

2021-04-27 Thread Rui Li
Hi Youngwoo, Could you please share the function jar and DDL you used to create the function? I can try reproducing this issue locally. On Wed, Apr 28, 2021 at 1:33 PM Youngwoo Kim (김영우) wrote: > Thanks Shengkai and Rui for looking into this. > > A snippet from my app. looks like following: > >

Re: Using Hive UDFs

2021-04-27 Thread 김영우
Thanks Shengkai and Rui for looking into this. A snippet from my app. looks like following: HiveCatalog hive = *new* HiveCatalog("flink-hive", "default", "/tmp/hive"); tableEnv.registerCatalog("flink-hive", hive); tableEnv.useCatalog("flink-hive"); tableEnv.loadModule("flink-h

Re: Using Hive UDFs

2021-04-27 Thread Rui Li
Hi Youngwoo, The catalog function is associated with a catalog and DB. Assuming you have created the function ST_Point in your metastore, could you verify whether the current catalog is your HiveCatalog and the current database is the database in which ST_Point is registered? On Wed, Apr 28, 2021

Re: Using Hive UDFs

2021-04-27 Thread Shengkai Fang
Hi. The order of the module may influence the load of the function. [1] https://issues.apache.org/jira/browse/FLINK-22383 Youngwoo Kim (김영우) 于2021年4月28日周三 上午10:50写道: > Hi, > > I've configured Hive metastore to use HiveCatalog in streaming > application. So far, most of the features are working