Re: Edit access to hive wiki to update hive-hbase integration docs

2015-04-30 Thread Lefty Leverenz
Done. Welcome to the Hive wiki team, Andrew. -- Lefty On Thu, Apr 30, 2015 at 7:20 PM, Andrew Mains wrote: > Doh, can't believe I forgot that, sorry! > > Username: amains12 > > Thanks again. > > > On 4/30/15 4:11 PM, Lefty Leverenz wrote: > > Great! Just give us a Confluence username (see Ab

Re: Edit access to hive wiki to update hive-hbase integration docs

2015-04-30 Thread Andrew Mains
Doh, can't believe I forgot that, sorry! Username: amains12 Thanks again. On 4/30/15 4:11 PM, Lefty Leverenz wrote: Great! Just give us a Confluence username (see About This Wiki -- How to get permission to edit

Re: Edit access to hive wiki to update hive-hbase integration docs

2015-04-30 Thread Lefty Leverenz
Great! Just give us a Confluence username (see About This Wiki -- How to get permission to edit ). -- Lefty On Thu, Apr 30, 2015 at 7:07 PM, Andrew Mains wrote: > Hi all, > > Could I get ed

Edit access to hive wiki to update hive-hbase integration docs

2015-04-30 Thread Andrew Mains
Hi all, Could I get edit access to the hive wiki in order to update the hive/hbase integration docs (https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration). Specifically I'd like to: 1. Add documentation about compound key support (the only statement on the wiki right now is

Re: PL/HQL - Procedural SQL-on-Hadoop

2015-04-30 Thread Dmitry Tolpeko
Hi everyone, PL/HQL 0.3.1 released today. There are some features I hope you find interesting: 1) Stored procedures and SQL user-defined functions CREATE PROCEDURE and CREATE FUNCTION statements are supported so you can define procedures and functions in your scripts, and when added to .plhqlrc

Re: map side join

2015-04-30 Thread Abe Weinograd
Great info, thanks. Makes sense on the partition since those files can be shipped by themselves. These are "reference" tables, but one happens to be pretty long. Thanks, Abe On Thu, Apr 30, 2015 at 12:54 PM, Gopal Vijayaraghavan wrote: > Hi, > > > Using CDH 5.3 - Hive 0.13. Does a view help

Re: map side join

2015-04-30 Thread Gopal Vijayaraghavan
Hi, > Using CDH 5.3 - Hive 0.13. Does a view help here? Does how i format >the table help in reducing size? No, a view does not help - they are not materialized and you need hive-1.0 to have temporary table support. The only way out is if you only have 1 filter column in the system. I assume

Re: ACID ORC file reader issue with uncompacted data

2015-04-30 Thread Alan Gates
Are you using OrcInputFormat.getReader to get a reader? If so, it should take care of these anomalies for you and mask your need to worry about delta versus base files. Alan. Elliot West April 29, 2015 at 9:40 Hi, I'm implementing a tap to read Hive ORC ACID date i

Re: map side join

2015-04-30 Thread Abe Weinograd
Using CDH 5.3 - Hive 0.13. Does a view help here? Does how i format the table help in reducing size? Abe On Thu, Apr 30, 2015 at 11:07 AM, Gopal Vijayaraghavan wrote: > Hi, > > > its submitting the whole table to the job. if I use a view with the > >filter > > baked in, will that help? I do

Re: map side join

2015-04-30 Thread Gopal Vijayaraghavan
Hi, > its submitting the whole table to the job. if I use a view with the >filter > baked in, will that help? I don't want to have to jack up the JVM for >the > client/HiveServer2 to accommodate the full table. Which hive version are you using? If you¹re on a recent version like hive-1.0, this

Re: Hive Alter Partition Location Issue

2015-04-30 Thread Harsha N
Nope Daniel, That extra '/' isn't causing any trouble. -Harsha On Thu, Apr 30, 2015 at 7:03 AM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > I think you have an extra '/' in the HDFS URI > > Daniel > > On 30 באפר׳ 2015, at 16:46, Harsha N wrote: > > Thanks for your reply, > > analyze

Re: Hive Alter Partition Location Issue

2015-04-30 Thread Daniel Haviv
I think you have an extra '/' in the HDFS URI Daniel > On 30 באפר׳ 2015, at 16:46, Harsha N wrote: > > Thanks for your reply, > > analyze table table1 partition (dt=201501) compute statistics;--returns the > same error > Total jobs = 1 > Launching Job 1 out of 1 > Number of reduce tasks is se

Re: Too many connections from hive to zookeeper

2015-04-30 Thread Eduardo Ferreira
It looks to me using Hive's Table Lock Manager with ZK with Cloudera's CDH5.3.3 distribution (Hive 0.13.1) is a bad thing. The ticket indicates the problem is fixed in version 1.1.0 only. I asked earlier in a different email (Subject: Table Lock Manager: ZooKeeper cluster) about using the same ZK q

map side join

2015-04-30 Thread Abe Weinograd
Hi, I am doing a few map side joins in one query to load an user facing ORC table in order to denormalize. Two of the tables I am joining too are pretty large. I am setting hive.auto.convert.join.noconditionaltask.size pretty high. However, the join it self filters on those two tables, but it se

Re: Hive Alter Partition Location Issue

2015-04-30 Thread Harsha N
Thanks for your reply, analyze table table1 partition (dt=201501) compute statistics;--returns the same error *Total jobs = 1* *Launching Job 1 out of 1* *Number of reduce tasks is set to 0 since there's no reduce operator* *java.io.IOException: cannot find dir = hdfs:///data/dt =201501/1430201400

Re: Too many connections from hive to zookeeper

2015-04-30 Thread Abe Weinograd
I have had the same problem and bouncing the Hive server temporarily alleviates this. Abe On Thu, Apr 30, 2015 at 2:20 AM, Shady Xu wrote: > I found the patch here https://issues.apache.org/jira/browse/HIVE-9119. > But upgrading is the last thing we want to do. > > Also, I found another solutio

RE: Hive Alter Partition Location Issue

2015-04-30 Thread Mich Talebzadeh
Hi Harsha, Have you updated stats on table1 after partition adding? In other words it is possible that the optimiser is not aware of that partition yet? analyze table table1 partition (dt=201501) compute statistics; HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Au

Re: HIVE udf explain error

2015-04-30 Thread Gerald-G
HI My hive version is 0.14.0 installed from HDP2.2.4 On Thu, Apr 30, 2015 at 3:34 PM, Gerald-G wrote: > Hi ALL: > > I have develop three UDF and compile them in one jar. Hive Explainn one > udf to antother class > > Dump INFO as Follow: Hive explain userlost-->shiftAct(), but the return > t

HIVE udf explain error

2015-04-30 Thread Gerald-G
Hi ALL: I have develop three UDF and compile them in one jar. Hive Explainn one udf to antother class Dump INFO as Follow: Hive explain userlost-->shiftAct(), but the return type is boolean, the right return type I want 0: jdbc:hive2://10-4-32-53:1> explain select userlost(idayacti,1) f