Re: UDF Method overloading

2015-07-30 Thread Joe Halliwell
Hi Sachith, Yes, that's possible, you just need to implement https://hive.apache.org/javadocs/r0.10.0/api/org/apache/hadoop/hive/ql/udf/generic/GenericUDF.html Note the class documentation: "A Generic User-defined function (GenericUDF) for the use with Hive. New GenericUDF classes need to inherit

Re: Multi-Line JSON in SparkSQL

2015-05-05 Thread Joe Halliwell
ered enough of an issue that some basic > ETL becomes a non viable solution. > > -Ewan > > On 05/05/15 09:37, Joe Halliwell wrote: >> >> @reynold, I’ll raise a JIRA today.@oliver, let’s discuss on the ticket? >> >> >> >> >> >> I su

Re: Multi-Line JSON in SparkSQL

2015-05-05 Thread Joe Halliwell
Reynold Xin wrote: >> > >> > Joe - I think that's a legit and useful thing to do. Do you want to give >> it >> > a shot? >> > >> > On Mon, May 4, 2015 at 12:36 AM, Joe Halliwell >> > wrote: >> > >> >> I think Rey

Re: Multi-Line JSON in SparkSQL

2015-05-04 Thread Joe Halliwell
I think Reynold’s argument shows the impossibility of the general case. But a “maximum object depth” hint could enable a new input format to do its job both efficiently and correctly in the common case where the input is an array of similarly structured objects! I’d certainly be interested in

Typo in 1.3.0 release notes: s/extended renamed/renamed/

2015-03-16 Thread Joe Halliwell
Cheers, Joe Best regards, Joe