Re: Review Request 11334: HIVE-4568 Beeline needs to support resolving variables

2013-08-23 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11334/#review25500 --- beeline/src/java/org/apache/hive/beeline/BeeLine.java

[jira] [Commented] (HIVE-4963) Support in memory PTF partitions

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749314#comment-13749314 ] Phabricator commented on HIVE-4963: --- ashutoshc has accepted the revision "HIVE-4963 [jira

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749311#comment-13749311 ] Phabricator commented on HIVE-5137: --- thejas has commented on the revision "HIVE-5137 [jir

[jira] [Commented] (HIVE-4707) Support configurable domain name for HiveServer2 LDAP authentication using Active Directory

2013-08-23 Thread Mikhail Antonov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749308#comment-13749308 ] Mikhail Antonov commented on HIVE-4707: --- There's email thread regarding LDAP auth for

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749306#comment-13749306 ] Phabricator commented on HIVE-3562: --- ashutoshc has commented on the revision "HIVE-3562 [

[jira] [Commented] (HIVE-4588) Support session level hooks for HiveServer2

2013-08-23 Thread Mikhail Antonov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749304#comment-13749304 ] Mikhail Antonov commented on HIVE-4588: --- Let me ask, if there're guys from Cloudera o

[jira] [Commented] (HIVE-4588) Support session level hooks for HiveServer2

2013-08-23 Thread Mikhail Antonov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749304#comment-13749304 ] Mikhail Antonov commented on HIVE-4588: --- Let me ask, if there're guys from Cloudera o

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749303#comment-13749303 ] Ashutosh Chauhan commented on HIVE-3562: Correct. Thanks a lot for considering. I a

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749302#comment-13749302 ] Navis commented on HIVE-3562: - Then, FS will be needed for context of limiting rows(limit, key

[jira] [Updated] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-5137: -- Attachment: HIVE-5137.D12453.7.patch vaibhavgumashta updated the revision "HIVE-5137 [jira] A Hive SQL q

[jira] [Updated] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-08-23 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-5137: --- Fix Version/s: 0.11.0 Status: Patch Available (was: Open) > A Hive SQL query s

[jira] [Updated] (HIVE-4588) Support session level hooks for HiveServer2

2013-08-23 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-4588: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Prasad!

Re: DISTRIBUTE BY works incorrectly in Hive 0.11 in some cases

2013-08-23 Thread Shahansad KP
I think the problem lies with in the group by operation. For this optimization to work the group bys partitioning should be on the column 1 only. It wont effect the correctness of group by, can make it slow but int this case will fasten the overall query performance. On Fri, Aug 23, 2013 at 5:55

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749296#comment-13749296 ] Ashutosh Chauhan commented on HIVE-3562: I agree that will be quite a bit of work a

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749292#comment-13749292 ] Navis commented on HIVE-3562: - I think RSHash should be a entity that can be used in various op

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749290#comment-13749290 ] Phabricator commented on HIVE-3562: --- navis has commented on the revision "HIVE-3562 [jira

[jira] [Commented] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749276#comment-13749276 ] Phabricator commented on HIVE-5137: --- thejas has commented on the revision "HIVE-5137 [jir

[jira] [Updated] (HIVE-5137) A Hive SQL query should not return a ResultSet when the underlying plan does not include a FetchTask

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-5137: -- Attachment: HIVE-5137.D12453.6.patch vaibhavgumashta updated the revision "HIVE-5137 [jira] A Hive SQL q

[jira] [Updated] (HIVE-5146) FilterExprOrExpr changes the order of the rows

2013-08-23 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HIVE-5146: --- Attachment: HIVE-5146.1.patch Patch uploaded. > FilterExprOrExpr chan

[jira] [Created] (HIVE-5146) FilterExprOrExpr changes the order of the rows

2013-08-23 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HIVE-5146: -- Summary: FilterExprOrExpr changes the order of the rows Key: HIVE-5146 URL: https://issues.apache.org/jira/browse/HIVE-5146 Project: Hive Issue T

[jira] [Commented] (HIVE-4568) Beeline needs to support resolving variables

2013-08-23 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749227#comment-13749227 ] Xuefu Zhang commented on HIVE-4568: --- [~thejas] Thanks for your review. I will respond to

Re: DISTRIBUTE BY works incorrectly in Hive 0.11 in some cases

2013-08-23 Thread Pala M Muthaia
I have attached the hive 10 and 11 query plans, for the sample query below, for illustration. On Fri, Aug 23, 2013 at 5:35 PM, Pala M Muthaia wrote: > Hi, > > We are using DISTRIBUTE BY with custom reducer scripts in our query > workload. > > After upgrade to Hive 0.11, queries with GROUP BY/DI

[jira] [Updated] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-5145: - Status: Patch Available (was: Open) > Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.2

[jira] [Commented] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749204#comment-13749204 ] Prasanth J commented on HIVE-5145: -- Added order by to the queries to get a deterministic o

[jira] [Updated] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-5145: - Attachment: HIVE-5145.patch > Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 > -

[jira] [Created] (HIVE-5145) Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23

2013-08-23 Thread Prasanth J (JIRA)
Prasanth J created HIVE-5145: Summary: Fix TestCliDriver.list_bucket_query_multiskew_2.q on hadoop 0.23 Key: HIVE-5145 URL: https://issues.apache.org/jira/browse/HIVE-5145 Project: Hive Issue Ty

DISTRIBUTE BY works incorrectly in Hive 0.11 in some cases

2013-08-23 Thread Pala M Muthaia
Hi, We are using DISTRIBUTE BY with custom reducer scripts in our query workload. After upgrade to Hive 0.11, queries with GROUP BY/DISTRIBUTE BY/SORT BY and custom reducer scripts produced incorrect results. Particularly, rows with same value on DISTRIBUTE BY column ends up in multiple reducers

[jira] [Commented] (HIVE-4961) Create bridge for custom UDFs to operate in vectorized mode

2013-08-23 Thread Eric Hanson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749189#comment-13749189 ] Eric Hanson commented on HIVE-4961: --- Completed working version of bridge to allow custom

[jira] [Updated] (HIVE-4961) Create bridge for custom UDFs to operate in vectorized mode

2013-08-23 Thread Eric Hanson (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Hanson updated HIVE-4961: -- Attachment: vectorUDF.5.patch > Create bridge for custom UDFs to operate in vectorized mode > --

[jira] [Commented] (HIVE-5095) Hive needs new operator walker for parallelization/optimization for tez

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749168#comment-13749168 ] Vikram Dixit K commented on HIVE-5095: -- RB request. https://reviews.apache.org/r/1378

Review Request 13787: HIVE-5095: Hive needs new operator walker for parallelization/optimization for tez

2013-08-23 Thread Vikram Dixit Kumaraswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13787/ --- Review request for hive and Gunther Hagleitner. Bugs: HIVE-5095 https://iss

[jira] [Updated] (HIVE-5095) Hive needs new operator walker for parallelization/optimization for tez

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5095: - Attachment: HIVE-5095.WIP.patch.txt Patch for the new walker. > Hive needs new op

[jira] [Updated] (HIVE-5080) Add hook to do additional optimization on the operator plan in tez

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5080: - Attachment: (was: HIVE-5080.WIP.patch.txt) > Add hook to do additional optimization on the

[jira] [Commented] (HIVE-5080) Add hook to do additional optimization on the operator plan in tez

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749163#comment-13749163 ] Vikram Dixit K commented on HIVE-5080: -- Wrong location. My bad! > Add

[jira] [Updated] (HIVE-5080) Add hook to do additional optimization on the operator plan in tez

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5080: - Attachment: HIVE-5080.WIP.patch.txt Updated work-in-progress. Needs some clean up.

[jira] [Commented] (HIVE-4331) Integrated StorageHandler for Hive and HCat using the HiveStorageHandler

2013-08-23 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749118#comment-13749118 ] Viraj Bhat commented on HIVE-4331: -- Sushanth, thanks for your help. I will finish modifyin

[jira] [Commented] (HIVE-4331) Integrated StorageHandler for Hive and HCat using the HiveStorageHandler

2013-08-23 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749108#comment-13749108 ] Sushanth Sowmyan commented on HIVE-4331: Francis, you're welcome to go ahead and re

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Attachment: (was: HIVE-5129.4.patch.txt) > Multiple table insert fails on count(distinct)

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Attachment: HIVE-5129.4.patch.txt > Multiple table insert fails on count(distinct) > -

Re: Review Request 13697: HIVE-5129: Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit Kumaraswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13697/ --- (Updated Aug. 23, 2013, 10:44 p.m.) Review request for hive and Navis Ryu. Ch

[jira] [Commented] (HIVE-4331) Integrated StorageHandler for Hive and HCat using the HiveStorageHandler

2013-08-23 Thread Viraj Bhat (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749101#comment-13749101 ] Viraj Bhat commented on HIVE-4331: -- Hi Francis, Thanks for your help. Regards Viraj

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Status: Patch Available (was: Open) > Multiple table insert fails on count(distinct) > --

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Attachment: HIVE-5129.4.patch.txt Addressed Harish's comments. Ran related unit tests.

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Status: Open (was: Patch Available) > Multiple table insert fails on count(distinct) > --

[jira] [Commented] (HIVE-4331) Integrated StorageHandler for Hive and HCat using the HiveStorageHandler

2013-08-23 Thread Francis Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749094#comment-13749094 ] Francis Liu commented on HIVE-4331: --- It seems no one has reviewed the HCat patch yet. I c

[jira] [Updated] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-4750: - Fix Version/s: 0.12.0 Affects Version/s: 0.12.0 Status: Patch Available (was: Open)

[jira] [Updated] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-4750: - Attachment: HIVE-4750.patch > Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 > --

[jira] [Commented] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749020#comment-13749020 ] Prasanth J commented on HIVE-4750: -- The issue is not related to inconsistent File.length()

[jira] [Updated] (HIVE-4750) Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23

2013-08-23 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-4750: - Assignee: Prasanth J (was: Brock Noland) > Fix TestCliDriver.list_bucket_dml_{6,7,8}.q on 0.23 >

Re: jenkins job stuck?

2013-08-23 Thread Edward Capriolo
I will check it out. On Fri, Aug 23, 2013 at 2:45 PM, Owen O'Malley wrote: > Is the pre-commit hive build stuck? It doesn't seem to have run anything in > the last 24 hours. > > -- Owen >

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4617: Status: Patch Available (was: Open) Canceling and making it patch available again to try and get th

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-4617: Status: Open (was: Patch Available) > ExecuteStatementAsync call to run a query in non-blocking

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748954#comment-13748954 ] Thejas M Nair commented on HIVE-4617: - HIVE-4617.D12507.1.patch looks good. Can you mak

[jira] [Commented] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748951#comment-13748951 ] Harish Butani commented on HIVE-5129: - Looks good. Can you add a test that has differen

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4617: -- Attachment: HIVE-4617.D12507.1.patch vaibhavgumashta requested code review of "HIVE-4617 [jira] Execute

[jira] [Updated] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5144: -- Status: Open (was: Patch Available) Test case run finished, auto_join30.q fails. Cancelling patch.

[jira] [Commented] (HIVE-5133) webhcat jobs that need to access metastore fails in secure mode

2013-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748882#comment-13748882 ] Eugene Koifman commented on HIVE-5133: -- 1. Server#pig() & Server#mapReduceJar() - the

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4617: -- Attachment: HIVE-4617.D12417.6.patch vaibhavgumashta updated the revision "HIVE-4617 [jira] ExecuteState

jenkins job stuck?

2013-08-23 Thread Owen O'Malley
Is the pre-commit hive build stuck? It doesn't seem to have run anything in the last 24 hours. -- Owen

[jira] [Commented] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748846#comment-13748846 ] Gopal V commented on HIVE-5144: --- I followed the pattern from MapJoinKey and MapJoinRowContain

[jira] [Commented] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748839#comment-13748839 ] Ashutosh Chauhan commented on HIVE-5144: Nice findings, Gopal! Couple of comments:

[jira] [Commented] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748807#comment-13748807 ] Phabricator commented on HIVE-4617: --- thejas has commented on the revision "HIVE-4617 [jir

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4617: -- Attachment: HIVE-4617.D12417.5.patch vaibhavgumashta updated the revision "HIVE-4617 [jira] ExecuteState

[jira] [Updated] (HIVE-4617) ExecuteStatementAsync call to run a query in non-blocking mode

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4617: -- Attachment: HIVE-4617.D12417.4.patch vaibhavgumashta updated the revision "HIVE-4617 [jira] ExecuteState

[jira] [Updated] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5144: -- Labels: perfomance (was: ) Release Note: Save memory in HashTableSink for key-only map-joins, by reus

[jira] [Created] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
Gopal V created HIVE-5144: - Summary: HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead Key: HIVE-5144 URL: https://issues.apache.org/jira/browse/HIVE-5144 Project: Hive

[jira] [Updated] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5144: -- Environment: Ubuntu LXC + -Xmx512m client opts (was: Ubuntu LXC + -Xmx4096m client opts) > HashTableSink a

[jira] [Updated] (HIVE-4460) Publish HCatalog artifacts for Hadoop 2.x

2013-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-4460: - Status: Patch Available (was: Open) > Publish HCatalog artifacts for Hadoop 2.x > ---

[jira] [Updated] (HIVE-5144) HashTableSink allocates empty new Object[] arrays & OOMs - use a static emptyRow instead

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5144: -- Attachment: HIVE-5144.01.patch With the attached patch, the memory usage drops from 199 Mb per million rows to

[jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)

2013-08-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-4914: --- Status: Patch Available (was: Open) > filtering via partition name should be done inside

[jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)

2013-08-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-4914: --- Status: Open (was: Patch Available) > filtering via partition name should be done inside

[jira] [Updated] (HIVE-4460) Publish HCatalog artifacts for Hadoop 2.x

2013-08-23 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-4460: - Attachment: HIVE-4460.2.patch Merged hcat shim layer into hive shim layer. Now the same hive-shim

[jira] [Updated] (HIVE-4914) filtering via partition name should be done inside metastore server (implementation)

2013-08-23 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-4914: --- Attachment: HIVE-4914.01.patch Hive QA won't run, try again... > filtering vi

[jira] [Updated] (HIVE-5100) RCFile::sync(long) missing 1 byte in System.arraycopy()

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5100: -- Status: Patch Available (was: Open) > RCFile::sync(long) missing 1 byte in System.arraycopy() > -

[jira] [Updated] (HIVE-5100) RCFile::sync(long) missing 1 byte in System.arraycopy()

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5100: -- Status: Open (was: Patch Available) > RCFile::sync(long) missing 1 byte in System.arraycopy() > -

[jira] [Updated] (HIVE-5100) RCFile::sync(long) missing 1 byte in System.arraycopy()

2013-08-23 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-5100: -- Attachment: HIVE-5100.01.patch Reuploading patch to match the PreCommit patch format. > RCFile

[jira] [Updated] (HIVE-5129) Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-5129: - Attachment: HIVE-5129.3.patch.txt [~navis] I looked into this some more and I feel that the issue

Re: Review Request 13697: HIVE-5129: Multiple table insert fails on count(distinct)

2013-08-23 Thread Vikram Dixit Kumaraswamy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13697/ --- (Updated Aug. 23, 2013, 4:37 p.m.) Review request for hive and Navis Ryu. Cha

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748683#comment-13748683 ] Yin Huai commented on HIVE-3562: Implementing RSHash as an operator sounds good. We can als

[jira] [Commented] (HIVE-3562) Some limit can be pushed down to map stage

2013-08-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748676#comment-13748676 ] Ashutosh Chauhan commented on HIVE-3562: [~navis] It occurred to me that this optim

[jira] [Commented] (HIVE-5100) RCFile::sync(long) missing 1 byte in System.arraycopy()

2013-08-23 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748643#comment-13748643 ] Ashutosh Chauhan commented on HIVE-5100: +1 [~gopalv] Can you reupload the patch as

[jira] [Updated] (HIVE-5091) ORC files should have an option to pad stripes to the HDFS block boundaries

2013-08-23 Thread Phabricator (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-5091: -- Attachment: HIVE-5091.D12249.2.patch omalley updated the revision "HIVE-5091 [jira] ORC files should hav

[jira] [Commented] (HIVE-951) Selectively include EXTERNAL TABLE source files via REGEX

2013-08-23 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748613#comment-13748613 ] Edward Capriolo commented on HIVE-951: -- This is being handle via another jira I think.

[jira] [Commented] (HIVE-4002) Fetch task aggregation for simple group by query

2013-08-23 Thread Edward Capriolo (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748576#comment-13748576 ] Edward Capriolo commented on HIVE-4002: --- +1 this is a very exciting feature. Will com

[jira] [Commented] (HIVE-951) Selectively include EXTERNAL TABLE source files via REGEX

2013-08-23 Thread pandeeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13748492#comment-13748492 ] pandeeswaran commented on HIVE-951: --- Yes This feature will be really useful for loading da