Re: Load Hive query result with array field into pig

2014-03-21 Thread Jeff Storey
Sorry for another post on this thread. I had an error in my pigscript that had the wrong unicode character to split on. Using STRSPLIT worked well. On Fri, Mar 21, 2014 at 8:46 AM, Jeff Storey wrote: > Correction - it looks like the query uses \u002 to separate array elements > and \u001 to sep

Re: Load Hive query result with array field into pig

2014-03-21 Thread Jeff Storey
Correction - it looks like the query uses \u002 to separate array elements and \u001 to separate the other fields. The question is still similar though in wondering how I can load that array into pig. Note - If my data is formatted as a tsv with parentheses surrounding the array: (element1,elemen

Load Hive query result with array field into pig

2014-03-21 Thread Jeff Storey
I'm executing a hive query in which one of the fields an array and writing it to a file using: INSERT OVERWRITE '/path/to/output' SELECT ... This query works well. I would like to load this data into pig, but I'm quite sure how to get the array properly into pig. My output file from the query do