@OP - first thing i'd ask is does your python script obey the ^A,^B,^C,^D etc. nesting delimiter pattern. give that your create table does not specify delimiters those are the defaults. nb. ^A == control-A == \001
Cheers, Stephen. On Tue, Jan 14, 2014 at 3:11 PM, Andre Araujo <ara...@pythian.com> wrote: > I had a similar issue in the past when trying to cast an empty array to > array(<bigint>). By default Hive assumes it's an array(<string>). > I don't think there's currently a Hive syntax to cast values to complex > data types. If there's one, I'd love to know what it is :) > > > On 14 January 2014 10:22, rohan monga <monga.ro...@gmail.com> wrote: > >> Hi, >> >> I have a table that is of the following format >> >> create table t1 ( f1 int, f2 array<struct<a1:int, a2:int>> ); >> >> Now I have a custom script that does some computation and generates >> the value for f2 >> like so >> >> from ( >> from randomtable r >> map r.g1, r.g2, r.g3 >> using '/bin/cat' as g1, g2, g3 >> cluster by g1 ) m >> insert overwrite table t1 >> reduce m.g1, m.g2, m.g3 >> using 'python customScript.py' as ( f1 , f2 ); >> >> however f2 is not being loaded properly into t1, it comes up broken or >> null. What should I do so that f2 is loaded as an array of structs. >> >> >> Thanks, >> >> -- >> Rohan Monga >> > > > > -- > André Araújo > Big Data Consultant/Solutions Architect > The Pythian Group - Australia - www.pythian.com > > Office (calls from within Australia): 1300 366 021 x1270 > Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 x1270 > Mobile: +61 410 323 559 > Fax: +61 2 9805 0544 > IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk > > “Success is not about standing at the top, it's the steps you leave behind.” > — Iker Pou (rock climber) > > -- > > > >
