Re: Dynamic Partitioning- Partition_Naming

2014-09-11 Thread Satish Mittal
Hi, HIVE-6109 added support for providing custom path pattern when dynamic partitions are added through HCatalog APIs. However that feature is not yet available when issuing Hive queries. I have created a JIRA HIVE-8053 to track it. Thanks, Satish On Thu, Sep 11, 2014 at 9:01 AM, Nitin Pawar w

Support for Thrift Set type in Hive

2014-08-27 Thread Satish Mittal
Hi, I am wondering if anyone has been able to get Thrift Set type working in Hive. Thrift supports List, Map and Struct complex types, which get mapped to Array, Map and Struct complex types in Hive respectively. (Though there is a difference in the support for Map: Thrift map allows a key of com

Re: External partition table question

2014-07-17 Thread Satish Mittal
'ALTER TABLE .. ADD PARTITION..' would just a partition entry for the table in hive metastore. It doesn't perform any data loading, instead it expects the data to be loaded already in the file pointed to by LOCATION. On Tue, Jul 15, 2014 at 5:39 AM, Raymond Lau wrote: > I've created an external

Re: how to control hive log location on 0.13?

2014-07-17 Thread Satish Mittal
You can configure the following property in $HIVE_HOME/conf/hive-log4j.properties: hive.log.dir= The default value of this property is ${java.io.tmpdir}/${user.name}. Thanks, Satish On Thu, Jul 17, 2014 at 11:58 PM, Yang wrote: > we just moved to hadoop2.0 (HDP2.1 distro). it turns out that

Re: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread Satish Mittal
Can you check the following element configured in hive-site.xml of your Hive client: javax.jdo.option.ConnectionURLjdbc:mysql://*hostname*/database_name?createDatabaseIfNotExist=true where *hostname* is the name of the machine you installed MySQL on and database_name is the name of database. On

Re: use custom MapReduce script to load data into table with partitions

2013-12-26 Thread Satish Mittal
Hi, You could use HCatalog for reading/writing data into Hive metastore tables. HCatalog provides HCatLoader/HCatStorer interface for Pig and HCatInputFormat/HCatFormat interface for MR jobs to perform table read/write, including support for static/dynamic partitions. Thanks, Satish On Thu, Dec