Re: creating a table based on where column=x

2015-06-09 Thread Abe Weinograd
Does a view not work for you? You create your external table as you described and a view which looks like the 2nd table. Abe On Tue, Jun 9, 2015 at 9:44 AM, Gary Clark wrote: > Hello, > > > > I would like to create a table based on a selection in hive. Currently I > am creating a table based

Re: ORC Table creation failure

2015-05-21 Thread Abe Weinograd
I think your WHERE clause is having casting issues. Is that column of the right data type? Can you run the SELECT by itself without the CREATE TABLE? Abe On Wed, May 20, 2015 at 11:23 PM, vivek veeramani < vivek.veeraman...@gmail.com> wrote: > > Hi , > > I'm trying to create a subset table fro

Re: Output of Hive

2015-05-19 Thread Abe Weinograd
Your WHERE clause is returning 0 rows to the query. Either the filter needs to be tweaked OR there is something wrong with your table. Try doing a count on the table without filters to see if that works and then maybe add filters in one by one to see where you lose results. Abe On Sat, May 16,

Re: map side join

2015-04-30 Thread Abe Weinograd
Great info, thanks. Makes sense on the partition since those files can be shipped by themselves. These are "reference" tables, but one happens to be pretty long. Thanks, Abe On Thu, Apr 30, 2015 at 12:54 PM, Gopal Vijayaraghavan wrote: > Hi, > > > Using CDH 5.3 - Hive 0.13. Does a view help

Re: map side join

2015-04-30 Thread Abe Weinograd
Using CDH 5.3 - Hive 0.13. Does a view help here? Does how i format the table help in reducing size? Abe On Thu, Apr 30, 2015 at 11:07 AM, Gopal Vijayaraghavan wrote: > Hi, > > > its submitting the whole table to the job. if I use a view with the > >filter > > baked in, will that help? I do

map side join

2015-04-30 Thread Abe Weinograd
Hi, I am doing a few map side joins in one query to load an user facing ORC table in order to denormalize. Two of the tables I am joining too are pretty large. I am setting hive.auto.convert.join.noconditionaltask.size pretty high. However, the join it self filters on those two tables, but it se

Re: Too many connections from hive to zookeeper

2015-04-30 Thread Abe Weinograd
I have had the same problem and bouncing the Hive server temporarily alleviates this. Abe On Thu, Apr 30, 2015 at 2:20 AM, Shady Xu wrote: > I found the patch here https://issues.apache.org/jira/browse/HIVE-9119. > But upgrading is the last thing we want to do. > > Also, I found another solutio