Re: Custom SerDe: Initialize() passes a null configuration to my Custom SerDe

2013-10-14 Thread Rui Martins
Edward Capriolo wrote: > Have you seen? > > https://github.com/edwardcapriolo/hive-protobuf/ > > > On Mon, Oct 14, 2013 at 8:16 AM, Rui Martins wrote: > >> Hi hive users, >> >> I am writing a custom SerDe that loads any protocol buffer generated >> class.

Re: Custom SerDe: Initialize() passes a null configuration to my Custom SerDe

2013-10-14 Thread Rui Martins
+dev hive mailing list that I should've mailed in the first place. (apologies for the spam) On Mon, Oct 14, 2013 at 1:16 PM, Rui Martins wrote: > Hi hive users, > > I am writing a custom SerDe that loads any protocol buffer generated > class. > For flexibility this cla

Custom SerDe: Initialize() passes a null configuration to my Custom SerDe

2013-10-14 Thread Rui Martins
Hi hive users, I am writing a custom SerDe that loads any protocol buffer generated class. For flexibility this class can live in a jar external to the SerDe's jar and then I just use the Hive Configuration class passed in the initiliaze to dynamically load it and set the schema for the Hive table

Re: Trying to write a custom HiveOutputFormat

2013-05-13 Thread Rui Martins
o something like present struct objects to the input format rather > then Text objects. > > You may want to take a look at the protobuf input format we use: > https://github.com/edwardcapriolo/hive-protobuf/ > > You could reverse the logic here and design an output format. > &g

Trying to write a custom HiveOutputFormat

2013-05-13 Thread Rui Martins
Hi guys, I'm currently writing my on HiveOutputFormat as I would like to write the output of hive queries into a specific protobuf format my team is using. I have managed to do this however, the Writable object I get from Hive as a result of a SELECT query is of type Text. This means that I have t