HADOOP-4097 absent in trunk?

2010-12-28 Thread Shrijeet Paliwal
Hi Hive users and developers, Any reason why change proposed in https://issues.apache.org/jira/browse/HADOOP-4097 is absent in current version? When speculative execution is on I see AlreadyBeingCreatedException. I was wondering it its because of HADOOP-4097. -Shrijeet

Re: Question about View in Hive 0.6

2010-12-28 Thread John Sichi
It runs the same as a nested select. Currently, since Hive doesn't do any relational common subexpression elimination, it will be executed twice. In the example below, this can be a good thing, since cond1 and cond2 can be pushed down separately. JVS On Dec 28, 2010, at 12:18 AM, Neil Xu wro

Re: Partitioning External table

2010-12-28 Thread Edward Capriolo
On Tue, Dec 28, 2010 at 9:41 AM, David Ginzburg wrote: > Hi, > I am trying to test  creation of  an external table using partitions, > my files on hdfs are: > > /user/training/partitions/dt=2/engine > /user/training/partitions/dt=2/engine > > engine are sequence files which I have managed to creat

Help: Could not obtain block: blk_ Exception

2010-12-28 Thread Tali K
Hi All, I am getting Could not obtain block: blk_2706642997966533027_4482 file=/user/outputwc425729652_0/part-r-0 I checked the file is actually there. What I should do? Please help. Could not obtain block: blk_2706642997966533027_4482 file=/user/outputwc425729652_0/part-r-0

Partitioning External table

2010-12-28 Thread David Ginzburg
Hi, I am trying to test creation of an external table using partitions, my files on hdfs are: /user/training/partitions/dt=2/engine /user/training/partitions/dt=2/engine engine are sequence files which I have managed to create externally and query from, when I have not used partitions. When

Re: Question of Hive Partitioning

2010-12-28 Thread Narendra
I guess it's the left outer that's making it do a full table scan...but why??? On Tue, Dec 28, 2010 at 2:34 PM, Narendra wrote: > Thanks for the response. > > The query is something like this - > > select > a.a_val1, > count(a.a_val2), > sum(b.b_val), > c.c_val, > d.d_val > from > table1 a > lef

Re: Question of Hive Partitioning

2010-12-28 Thread Narendra
Thanks for the response. The query is something like this - select a.a_val1, count(a.a_val2), sum(b.b_val), c.c_val, d.d_val from table1 a left outer join table2 b on (a.someval = b.someval), left outer join table3 c on (a.someval2 = c.someval2), left outer join table4 d on (a.someval3 = d.someva

Question about View in Hive 0.6

2010-12-28 Thread Neil Xu
in hive 0.6, we can create view for tables, views are actually run as a subquery when querying data, is it optimized in hive that a view is executed only once in a single query? Thanks in advance! such as: select * from ( select x,y from view1 where cond1 union all