SQL UDF problem (with re to types)

While registering and using SQL UDFs, I am running into the following problem: UDF registered: ctx.udf().register("Test", new UDF1() { /** * */ private static final long serialVersionUID = -8231917

Spark SQL create table

Is creating a table using the SparkSQLContext currently supported? Regards, Raghu -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-create-table-tp25996.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -

Scala MatchError in Spark SQL

Hi, I created a custom UserDefinedType in Java as follows: SQLPoint = new UserDefinedType() { //overriding serialize, deserialize, sqlType, userClass functions here } When creating a dataframe, I am following the manual mapping, I have a constructor for JavaPoint - JavaPoint(double x, double y)

Spark SQL joins taking too long

Hi, I create two tables, one counties with just one row (it actually has 2k rows, but I used only one) and another hospitals, which has 6k rows. The join command I use is as follows, which takes way too long to run and has never finished successfully (even after nearly 10mins). The following is wh

UDTRegistration (in Java)

Hi, After moving to Spark 2.0, the UDTRegistration is giving me some issues. I am trying the following (in Java): UDTRegistration.register(userclassName, udtclassName); After this, when I try creating a DataFrame, it throws an exception that the userclassName is not registered. Can anyone point

Re: UDTRegistration (in Java)

Well, it is perplexing - as I am able to simply call UDTRegistration from Java. And maybe it is not working properly? I was able to put in a class/String through the register function. And when I call exists(..) it returns true. So, it appears to work, but has issues :-) Regards, Raghu -- View