Re: SerDe loading external scheme

2012-04-05 Thread Roberto Congiu
I think the additions you make to the Configuration object in the client are done after the job.xml is written to disk and sent to the rest of the cluster, but you could add the external resource URL in hive-site.xml, add a SET external.resource.url=... in the hive query or on your hiverc, or pass

SerDe loading external scheme

2012-04-05 Thread Koert Kuipers
I am working on a hive SerDe where both SerDe and RecordReader need to have access to an external resource with information. This external resource could be on hdfs, in hbase, or on a http server. This situation is very similar to what haivvreo does. The way i go about it right now is that i store