Yes, you can define the nested structure; but I had the incorrect syntax in the DDL. The correct syntax to create such table is:
CREATE TABLE table_1(f1 int, f2 string, f3 array <struct <a:string, b:int, c:map<string, string>>>) ROW FORMAT DELIMITED FIELDS TERMINATED BY '|' COLLECTION ITEMS TERMINATED BY ',' MAP KEYS TERMINATED BY '=' LINES TERMINATED BY '\n' STORED AS TEXTFILE; Thanks, Sadu On Fri, Sep 28, 2012 at 4:51 AM, MiaoMiao <liy...@gmail.com> wrote: > Never seen nested collections on Hive, so I'm not sure about "array > <struct <a string, b int, c map<string, string>>>". > > In my case, my arrays and maps always contains values of primitive > types, such as string, int, bigint, etc. > > On Fri, Sep 28, 2012 at 1:01 PM, Sadananda Hegde <saduhe...@gmail.com> > wrote: > > How does "collection items terminated by" work on a nested structure? > Say > > the table is created with the DDL: > > > > CREATE TABLE table_1(f1 int, f2 string, f3 array <struct <a string, b > int, > > c map<string, string>>>) > > ROW FORMAT DELIMITED > > FIELDS TERMINATED BY '|' > > COLLECTION ITEMS TERMINATED BY ',' > > MAP KEYS TERMINATED BY '=' > > LINES TERMINATED BY '\'n' > > STORED AS TEXTFILE; > > > > I guess comma seperator wll be used for the items in the outer most > > structure (i.e. array). Is that true? > > 1. What would be the seperator character between a,b and c (struct > > elements)? > > 2. What would be the seperator for mapelements? > > 3. Is there a way to explicitly specify those ITEMS seperators rather > than > > using the default ones like ^B, ^C, etc, (like multiple collection > items)? > > > > The original data is in xml format (complex one with many nested levels) > > and we are planning to parse that xml using a java parser into delimited > > text file which can be used to load the hive table. My question is: > > " How should we be representng the f3 like structures in the data > > file?" > > > > The actual file has lot many fields with quite a few complex types like > f3 > > above; but I guess logic would be the same. > > > > Thanks for your help..... > > > > Regards, > > Sadu > > > > > > > > > > > > > > >
