Great, that seems to be what I was looking for. Do you know any good resource explaining all LazySerDer available paramters?
Thx, Ramón Pin From: shrikanth shankar [mailto:sshan...@qubole.com] Sent: miércoles, 30 de mayo de 2012 22:47 To: user@hive.apache.org Subject: Re: Hive 'rest' column I believe the default LazySerDe takes a parameter called 'serialization.last.column.takes.rest'. Setting this to true might solve your issue (restoMsg would become a string then and you might have to parse it in the query into an array) thanks, Shrikanth On May 30, 2012, at 9:27 AM, <ramon....@accenture.com<mailto:ramon....@accenture.com>> <ramon....@accenture.com<mailto:ramon....@accenture.com>> wrote: Hi, I'm trying to define a table over an external file. My file has 12 fixed columns followed by a varying amount of columns that depends on some of the fixed ones. I tried to define the table as: CREATE EXTERNAL TABLE IF NOT EXISTS log_array ( dt string, txOperOpciResto string, idRegPerf string, oper string, opcion string, accion string, servc string, canal string, platf string, codIdioma string, pais string, lacre string, dirIP string, restoMsg array<string> ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' COLLECTION ITEMS TERMINATED BY '|' STORED AS SEQUENCEFILE LOCATION '/user/hadoop-user/uc3/seq/'; So what I tried was to get all varing part on an array field (restoMsg). The trick is not working because both delimiters, fields and collections, are the same. My restoMsg field only gets one column and the rest are omitted. Is there any way to get that last part without custom code? If not, what classes should I create to this and how can I define the table then? Thx, Ramón Pin ________________________________ Subject to local law, communications with Accenture and its affiliates including telephone calls and emails (including content), may be monitored by our systems for the purposes of security and the assessment of internal compliance with Accenture policy. ______________________________________________________________________________________ www.accenture.com<http://www.accenture.com>
