Re: Convert string to map

2016-01-20 Thread Edward Capriolo
create table ().. [COLLECTION ITEMS TERMINATED BY char] [MAP KEYS TERMINATED BY char] collection items terminated by ',' map keys terminated by ':' works in many cases On Wed, Jan 20, 2016 at 9:07 PM, Buntu Dev wrote: > I found the brickhouse Hive udf `json_map' that seems to conver

Re: Convert string to map

2016-01-20 Thread Buntu Dev
I found the brickhouse Hive udf `json_map' that seems to convert to map of given type. Thanks! On Wed, Jan 20, 2016 at 2:03 PM, Buntu Dev wrote: > I got json string of the form: > > {"k1":"v1","k2":"v2,"k3":"v3"} > > How would I go about converting this to a map? > > Thanks! >

Re: HIVE CLI does not escape \t ?

2016-01-20 Thread Gopal Vijayaraghavan
> I¹m exporting a table with Hive CLI using hive ­f query.hql > file.tsv > Use ^A as a separator ... > Maybe using an alternative SerDe could solve that? Have you tried using the actual SerDe instead of the stdout formatter? INSERT OVERWRITE LOCAL DIRECTORY '...' ; The only issue I've notice

HIVE CLI does not escape \t ?

2016-01-20 Thread Thomas Achache
Hi all, I’m exporting a table with Hive CLI using hive –f query.hql > file.tsv. The resulting tab separated file won’t read in R because it seems that some of my fields contain the \t separator and that Hive CLI is neither escaping those characters nor putting the chr fields within quotes. The

Convert string to map

2016-01-20 Thread Buntu Dev
I got json string of the form: {"k1":"v1","k2":"v2,"k3":"v3"} How would I go about converting this to a map? Thanks!

RE: ORC table stats from orcfiledump

2016-01-20 Thread Mich Talebzadeh
Thanks Prasanth for these helpful answers Just to clarify 1.ORC will use be default ZLIB. That means that oRC file will use some fo Looks like your question is incomplete. It was meant to say ORC will use be default ZLIB. That means that ORC file will use default compress

Re: January Hive User Group Meeting

2016-01-20 Thread Dmitry Tolpeko
If possible please share the slides after the meeting. Thank you! Dmitry On Wed, Jan 20, 2016 at 8:45 PM, Xuefu Zhang wrote: > Hi all, > > As a reminder, the meeting will be held tomorrow as scheduled. Please > refer to the meetup page[1] for details. Looking forward to meeting you all! > > Th

Re: ORC table stats from orcfiledump

2016-01-20 Thread Prasanth Jayachandran
Please find answers inline. Thanks Prasanth On Jan 20, 2016, at 12:32 PM, Mich Talebzadeh mailto:m...@peridale.co.uk>> wrote: Hi, I did some tests on ORC table by creating a simple ORC table as below CREATE TABLE orctest ( PROD_IDbigint , CUST_IDbigin

ORC table stats from orcfiledump

2016-01-20 Thread Mich Talebzadeh
Hi, I did some tests on ORC table by creating a simple ORC table as below CREATE TABLE orctest ( PROD_IDbigint , CUST_IDbigint , TIME_IDtimestamp, CHANNEL_ID bigint

Re: January Hive User Group Meeting

2016-01-20 Thread Xuefu Zhang
Hi all, As a reminder, the meeting will be held tomorrow as scheduled. Please refer to the meetup page[1] for details. Looking forward to meeting you all! Thanks, Xuefu [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/ On Wed, Dec 16, 2015 at 3:38 PM, Xuefu Zhang wrote: > De

chmod: changing permissions of '/datadir/000056_0': Permission denied. user=danielh is not the owner of inode=000056_0

2016-01-20 Thread Daniel Haviv
Hi, We have a table in which the files are created by different users (under the same group). When a user inserts into the table it will finish successfully but after moving the files the user will receive the following error(s): chmod: changing permissions of '/datadir/56_0': Permission denied

Re: the `use database` command will change the scheme of target table?

2016-01-20 Thread 董亚军
hi all, I read the wiki of section Temporary Folders: https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration#AdminManualConfiguration-HiveMetastoreConfigurationVariables My target table's filesystem is HDFS, but hive write the temporary data on S3 after I use an S3 database.