RE: Reduce number of Hadoop mappers for large number of GZ files

2016-04-04 Thread Loudongfeng
You can set hive.hadoop.supports.splittable.combineinputformat=true to combine your files. In fact ,this parameter should be set to true by default since MAPREDUCE-1597 was fixed is hadoop 0.22.0 long ago. From: Harshit Sharan [mailto:hsincredi...@gmail.com] Sent: Saturday, April 02, 2016 4:06 P

Can't able to access temp table via jdbc client

2016-04-04 Thread ram kumar
HI, I started a hive thrift server from hive home, ./bin/hiveserver2 opened jdbc client, ./bin/beeline connected to thrift server, 0: > show tables; ++--+ |tab_name| ++--+ | check | | people | +-

Hive Metadata tables of a schema

2016-04-04 Thread brajmohan saxena
Hi, How can I access Hive metadata tables of a particular Server and Schema in a C program or through JDBC client. I have one application running on Client and my Hiveserver2 running on Remote machine. So if i provide Server name and Schema name in my client C program ,I should be able to get al

Re: Hive Macros roadmap

2016-04-04 Thread Lefty Leverenz
Shannon Ladymon has documented Hive macros in the wiki , using examples from HIVE-2655 and HIVE-13372

Standard Deviation in Hive 2 is still incorrect

2016-04-04 Thread Mich Talebzadeh
Hi, I reported back in April 2015 that what Hive calls Standard Deviation Function STDDEV is a pointer to STDDEV_POP. This is incorrect and has not been rectified in Hive 2 Both Oracle and Sybase point STDDEV to STDDEV_SAMP not STDDEV_POP. Also I did tests with Spark 1.6 as well and Spark correc

Re: Unable to start Hive CLI after install

2016-04-04 Thread Mich Talebzadeh
What are you getting when trying $HIVE_HOME/bin/hive The error! Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpres

Re: HBase table map to hive

2016-04-04 Thread Wojciech Indyk
Hi! You can use map on your column family or a prefix of column qualifier. https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration#HBaseIntegration-HiveMAPtoHBaseColumnFamily -- Kind regards/ Pozdrawiam, Wojciech Indyk http://datacentric.pl 2016-04-04 14:13 GMT+02:00 ram kumar : > Hi,

Re: Unable to start Hive CLI after install

2016-04-04 Thread Raj Hadoop
Hi Mich -I did all those steps. Some how i am not able to find out whats the issue. Can you suggest any debugging tips ?Regards,Rajendra On Monday, April 4, 2016 12:16 PM, Mich Talebzadeh wrote: HI Raj, Hive 2 is as good to go :) Check this I see that you are using Oracle DB as your

Re: Unable to start Hive CLI after install

2016-04-04 Thread Mich Talebzadeh
HI Raj, Hive 2 is as good to go :) Check this I see that you are using Oracle DB as your metastore. Mine is Oracle as well javax.jdo.option.ConnectionURL jdbc:oracle:thin:@rhes564:1521:mydb

Re: Unable to start Hive CLI after install

2016-04-04 Thread Raj Hadoop
Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let me troubleshoot 1.1.1 issues i am facing now. here is my hive-site.xml. Can you please let me know if i am missing anything. hive.exec.scratchdir /tmp/hive hive.metastore.local false hive.metastore.warehouse.dir h

Re: Unable to start Hive CLI after install

2016-04-04 Thread Raj Hadoop
Sorry in a typo with your name - Mich. On Monday, April 4, 2016 12:01 PM, Raj Hadoop wrote: Thanks Mike. If Hive 2.0 is stable - i would definitely go for it. But let me troubleshoot 1.1.1 issues i am facing now. here is my hive-site.xml. Can you please let me know if i am missing anyt

Re: Unable to start Hive CLI after install

2016-04-04 Thread Mich Talebzadeh
Interesting why you did not download Hive 2.0 which is out now The error says: HiveConf of name hive.metastore.local does not exist In you hive-site.xml how have you configured parameters for hive.metastore? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAA

Unable to start Hive CLI after install

2016-04-04 Thread Raj Hadoop
Hi, I have downloaded apache hive 1.1.1 and trying to setup hive environment in my hadoop cluster. On one of the nodes i installed hive and when i set all the variables and environment i am getting the following error.Please advise. [hadoop@z1 bin]$ hive 2016-04-04 10:12:45,686 WARN  [main] conf

Re: Hue 3.7.1 issue at EMR 4.3.0: fails to install Hive Editor

2016-04-04 Thread Jose Rozanec
Hello, Just for the record: we found out that a property at /etc/hue/conf.empty/hue.ini was not matching Hive configurations: at Hive we had authentication set to a value different from NONE; while at Hue configuration we found security_enabled=false After changing the value to security_enabled=tr

Hue 3.7.1 issue at EMR 4.3.0: fails to install Hive Editor

2016-04-04 Thread Jose Rozanec
Hello, Today morning we started getting an issue at Hue instance, when creating an EMR cluster with Hive/Hue. At this link we provide the trace we get, when attempting to setup Hue's Hive Editor: http://pastebin.com/LTN15k7r Did anyone face this? A few days ago we had no issues creating a cluster

Dynamic Partitioning Table Properties

2016-04-04 Thread bhanu prasad
Hi, Can anyone explain me the below dynamic partitioning table properties in detail. 1.set hive.exec.dynamic.partition.mode=nonstrict; 2.set hive.exec.max.dynamic.partitions=1; 3.set hive.exec.max.dynamic.partitions.pernode=500; Thanks in advance

HBase table map to hive

2016-04-04 Thread ram kumar
Hi, I have a hbase table with column name changes (increases) over time. Is there a way to map such hbase to hive table, inferring schema from the hbase table? Thanks

Re: How to setup Hive JDBC client to connect remote Hiveserver

2016-04-04 Thread Mich Talebzadeh
This telnet does not specify the port that Hiveserver2 is running on (default 1) Mine is running on 10010 *telnet 50.140.197.217 10010*Trying 50.140.197.217... Connected to rhes564 (50.140.197.217). Escape character is '^]'. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/