[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9104: --- Attachment: HIVE-9104.2.patch > windowing.q failed when mapred.reduce.tasks is set to larger than one > ---

[jira] [Commented] (HIVE-9315) CBO (Calcite Return Path): Inline FileSinkOperator, Properties

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272366#comment-14272366 ] Hive QA commented on HIVE-9315: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2015-01-09 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/#review67581 --- Thank you for your patch! I have a general question about the curren

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272350#comment-14272350 ] Szehon Ho commented on HIVE-9257: - For reference, patch is uploaded here: [http://ec2-50-

[jira] [Commented] (HIVE-8327) mvn site -Pfindbugs

2015-01-09 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272349#comment-14272349 ] Lefty Leverenz commented on HIVE-8327: -- Should this be documented somewhere in the wik

[jira] [Commented] (HIVE-4790) MapredLocalTask task does not make virtual columns

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272343#comment-14272343 ] Hive QA commented on HIVE-4790: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272334#comment-14272334 ] Chao commented on HIVE-9104: [~xuefuz] OK, will do. > windowing.q failed when mapred.reduce.ta

[jira] [Updated] (HIVE-9194) Support select distinct *

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9194: -- Attachment: HIVE-9194.01.patch Address [~jpullokkaran]'s comments. (1) add more test cases includ

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/ --- (Updated Jan. 10, 2015, 4:02 a.m.) Review request for hive and John Pullokkaran

[jira] [Updated] (HIVE-9194) Support select distinct *

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9194: -- Status: Patch Available (was: Open) > Support select distinct * > - > >

[jira] [Updated] (HIVE-9194) Support select distinct *

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9194: -- Status: Open (was: Patch Available) > Support select distinct * > - > >

[jira] [Commented] (HIVE-7550) Extend cached evaluation to multiple expressions

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272318#comment-14272318 ] Hive QA commented on HIVE-7550: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272299#comment-14272299 ] Xuefu Zhang commented on HIVE-9104: --- [~csun] Could you add a test case in which perhaps t

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Harish Butani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272290#comment-14272290 ] Harish Butani commented on HIVE-9104: - +1, thanks for tracking this down. > windowing.

[jira] [Commented] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272279#comment-14272279 ] Alexander Pivovarov commented on HIVE-3405: --- it's only one test failed on build 2

Move ancient Hive issues from Hadoop project to Hive

2015-01-09 Thread Ashutosh Chauhan
Hi all, Hive started out as Hadoop subproject. That time Hadoop's jira is used to track Hive's bugs and features. As I try to find lineage of some very old code in Hive, I sometimes end up on those jiras. It will be nice to move those issues from Hadoop to Hive so that its easy to search as all ji

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272187#comment-14272187 ] Xuefu Zhang commented on HIVE-9104: --- +1. Code looks reasonable to me. However, it's great

[jira] [Commented] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272180#comment-14272180 ] Hive QA commented on HIVE-3405: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/#review67566 --- ql/src/test/queries/clientpositive/selectDistinctStar.q

[jira] [Updated] (HIVE-9321) Notification message size can be arbitrarily long, DbNotificationListener limits to 1024

2015-01-09 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9321: - Fix Version/s: 0.15.0 Affects Version/s: 0.15.0 Status: Patch Available (was: Open)

[jira] [Updated] (HIVE-9321) Notification message size can be arbitrarily long, DbNotificationListener limits to 1024

2015-01-09 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-9321: - Attachment: HIVE-9321.patch This patch moves MESSAGE field from VARCHAR to TEXT/CLOB. > Notification messa

[jira] [Commented] (HIVE-4639) Add has null flag to ORC internal index

2015-01-09 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272141#comment-14272141 ] Lefty Leverenz commented on HIVE-4639: -- Thanks [~gopalv]. I assume that means no docu

[jira] [Commented] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272134#comment-14272134 ] Szehon Ho commented on HIVE-3405: - Current build should be testing 3405: [http://ec2-174-1

[jira] [Commented] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272129#comment-14272129 ] Alexander Pivovarov commented on HIVE-3405: --- how to trigger HIVE build? for some

[jira] [Updated] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated HIVE-3405: -- Status: Patch Available (was: In Progress) > UDF initcap to obtain a string with the fir

[jira] [Updated] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated HIVE-3405: -- Attachment: HIVE-3405.5.patch > UDF initcap to obtain a string with the first letter of e

[jira] [Updated] (HIVE-3405) UDF initcap to obtain a string with the first letter of each word in uppercase other letters in lowercase

2015-01-09 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated HIVE-3405: -- Status: In Progress (was: Patch Available) > UDF initcap to obtain a string with the fir

[jira] [Commented] (HIVE-4639) Add has null flag to ORC internal index

2015-01-09 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272122#comment-14272122 ] Gopal V commented on HIVE-4639: --- for the sake of documentation this does not change the ORC f

[jira] [Updated] (HIVE-4639) Add has null flag to ORC internal index

2015-01-09 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-4639: Resolution: Fixed Fix Version/s: 0.15.0 Release Note: Support for hasNull

[jira] [Updated] (HIVE-9334) PredicateTransitivePropagate optimizer should run after PredicatePushDown

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9334: --- Status: Patch Available (was: Open) > PredicateTransitivePropagate optimizer should run after

[jira] [Updated] (HIVE-9334) PredicateTransitivePropagate optimizer should run after PredicatePushDown

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9334: --- Attachment: HIVE-9334.patch [~navis] Since you implemented {{PredicateTransitivePropagate}} opt

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2015-01-09 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8966: - Status: Patch Available (was: Open) > Delta files created by hive hcatalog streaming cannot be compacted >

[jira] [Updated] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2015-01-09 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8966: - Attachment: HIVE-8966.4.patch This patch takes a new approach. Rather than changing AcidUtils.getAcidState

[jira] [Created] (HIVE-9334) PredicateTransitivePropagate optimizer should run after PredicatePushDown

2015-01-09 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-9334: -- Summary: PredicateTransitivePropagate optimizer should run after PredicatePushDown Key: HIVE-9334 URL: https://issues.apache.org/jira/browse/HIVE-9334 Project: Hi

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272107#comment-14272107 ] Szehon Ho commented on HIVE-9257: - Adding review request: [https://reviews.apache.org/r/29

Review Request 29787: HIVE-9257 : Merge spark to trunk January 2015 (Modified files)

2015-01-09 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29787/ --- Review request for hive. Bugs: HIVE-9257 https://issues.apache.org/jira/bro

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/#review67562 --- ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/#review67560 --- ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/#review67559 --- ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java

Re: Review Request 29671: Support select distinct *

2015-01-09 Thread John Pullokkaran
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29671/#review67558 --- ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java

[jira] [Commented] (HIVE-4639) Add has null flag to ORC internal index

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272090#comment-14272090 ] Hive QA commented on HIVE-4639: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Attachment: HIVE-9039.11.patch now, union distinct is implemented, union order by, limit bug is f

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Status: Patch Available (was: Open) > Support Union Distinct > -- > >

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-09 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Status: Open (was: Patch Available) > Support Union Distinct > -- > >

[jira] [Updated] (HIVE-9318) Add UnionMerge rule on cbo path

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9318: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-8696) HCatClientHMSImpl doesn't use a Retrying-HiveMetastoreClient.

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271973#comment-14271973 ] Hive QA commented on HIVE-8696: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9316) TestSqoop tests in WebHCat testsuite hardcode libdir path to hdfs

2015-01-09 Thread Deepesh Khandelwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271972#comment-14271972 ] Deepesh Khandelwal commented on HIVE-9316: -- Thanks [~ekoifman] for the review and

[jira] [Commented] (HIVE-9172) Merging HIVE-5871 into LazySimpleSerDe

2015-01-09 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271943#comment-14271943 ] Jason Dere commented on HIVE-9172: -- Haven't really taken a detailed look yet, but a few qu

[jira] [Updated] (HIVE-9296) Need to add schema upgrade changes for queueing events in the database

2015-01-09 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9296: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Need to add schema upgrade

[jira] [Commented] (HIVE-9296) Need to add schema upgrade changes for queueing events in the database

2015-01-09 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271942#comment-14271942 ] Sushanth Sowmyan commented on HIVE-9296: Committed to trunk. > Need to add schema

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271918#comment-14271918 ] Szehon Ho commented on HIVE-9257: - Actually this is not going to work, the other patch is s

[jira] [Updated] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9257: Attachment: (was: HIVE-9257.newfiles.patch) > Merge from spark to trunk January 2015 > --

[jira] [Updated] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9257: Attachment: (was: HIVE-9257.patch.newfiles) > Merge from spark to trunk January 2015 > --

[jira] [Updated] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9257: Attachment: HIVE-9257.newfiles.patch > Merge from spark to trunk January 2015 > -

[jira] [Updated] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9257: Attachment: HIVE-9257.patch.newfiles This patch is totally 13mb and too big for JIRA. Adding in two parts- o

[jira] [Commented] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271909#comment-14271909 ] Thejas M Nair commented on HIVE-9234: - +1 for the 0.14 patch. > HiveServer2 leaks Fil

[jira] [Updated] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-9234: --- Attachment: HIVE-9234.branch-14.patch [~thejas] Patch for 14.1 focussing just on the fix, witho

[jira] [Commented] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271885#comment-14271885 ] Thejas M Nair commented on HIVE-9234: - +1 Vaibhav, As discussed offline, for 0.14, it w

[jira] [Created] (HIVE-9333) Move parquet serialize implementation to DataWritableWriter to improve write speeds

2015-01-09 Thread JIRA
Sergio Peña created HIVE-9333: - Summary: Move parquet serialize implementation to DataWritableWriter to improve write speeds Key: HIVE-9333 URL: https://issues.apache.org/jira/browse/HIVE-9333 Project: Hi

[jira] [Updated] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-9234: --- Attachment: (was: HIVE-9234.branch-14.patch) > HiveServer2 leaks FileSystem objects in File

Re: Review Request 29635: HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Thejas Nair
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29635/#review67523 --- Ship it! Ship It! - Thejas Nair On Jan. 9, 2015, 9:01 p.m., Vaib

[jira] [Commented] (HIVE-9322) Make null-checks consistent for MapObjectInspector subclasses.

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271876#comment-14271876 ] Hive QA commented on HIVE-9322: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271867#comment-14271867 ] Vaibhav Gumashta commented on HIVE-9234: [~thejas] New patch attached incorporating

[jira] [Updated] (HIVE-9234) HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vaibhav Gumashta updated HIVE-9234: --- Attachment: HIVE-9234.2.patch > HiveServer2 leaks FileSystem objects in FileSystem.CACHE >

Re: Review Request 29635: HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29635/ --- (Updated Jan. 9, 2015, 9:01 p.m.) Review request for hive and Thejas Nair. Bu

[jira] [Updated] (HIVE-9316) TestSqoop tests in WebHCat testsuite hardcode libdir path to hdfs

2015-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-9316: - Resolution: Fixed Status: Resolved (was: Patch Available) > TestSqoop tests in WebHCat tes

[jira] [Updated] (HIVE-9316) TestSqoop tests in WebHCat testsuite hardcode libdir path to hdfs

2015-01-09 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-9316: - Affects Version/s: 0.14.0 > TestSqoop tests in WebHCat testsuite hardcode libdir path to hdfs > ---

[jira] [Updated] (HIVE-9331) get rid of pre-optimized-hashtable memory optimizations

2015-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9331: --- Attachment: HIVE-9331.patch mostly removing code, there was also a small bug in one of the clas

[jira] [Updated] (HIVE-9331) get rid of pre-optimized-hashtable memory optimizations

2015-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9331: --- Status: Patch Available (was: Open) > get rid of pre-optimized-hashtable memory optimizations

Re: hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Alexander Pivovarov
Thank you correction, we are using hive-0.13.1 Thank you for pointing me to the JIRA On Fri, Jan 9, 2015 at 12:13 PM, Gopal V wrote: > On 1/9/15, 11:53 AM, Alexander Pivovarov wrote: > >> I noticed that if amount of data which should be sent to reducers is small >> then tez might throw NPE. >>

Re: hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Gopal V
On 1/9/15, 11:53 AM, Alexander Pivovarov wrote: I noticed that if amount of data which should be sent to reducers is small then tez might throw NPE. I noticed that you sent it to the tez lists as well. This is a hive specific issue. https://issues.apache.org/jira/browse/HIVE-8361 to be prec

[jira] [Updated] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9326: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

hive 0.14.1 + tez 0.4 sometimes throws NPE on small data

2015-01-09 Thread Alexander Pivovarov
I noticed that if amount of data which should be sent to reducers is small then tez might throw NPE. workaround is to set number of reducers to some small value. e.g. if initially I have set hive.exec.reducers.max=25; then to solve the issue I might try set hive.exec.reducers.max=13; or even small

[jira] [Commented] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271772#comment-14271772 ] Xuefu Zhang commented on HIVE-9326: --- +1 > BaseProtocol.Error failed to deserialization d

[jira] [Assigned] (HIVE-9290) Make some test results deterministic

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho reassigned HIVE-9290: --- Assignee: Szehon Ho (was: Rui Li) > Make some test results deterministic > --

[jira] [Updated] (HIVE-9290) Make some test results deterministic

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9290: Assignee: Rui Li (was: Szehon Ho) > Make some test results deterministic > -

[jira] [Updated] (HIVE-9290) Make some test results deterministic

2015-01-09 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9290: Resolution: Fixed Status: Resolved (was: Patch Available) > Make some test results deterministic > -

[jira] [Commented] (HIVE-9320) Add UnionEliminatorRule on cbo path

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271743#comment-14271743 ] Ashutosh Chauhan commented on HIVE-9320: Failure is unrelated. [~jpullokkaran] this

[jira] [Created] (HIVE-9332) Warn user when parquet mm kicks in

2015-01-09 Thread Brock Noland (JIRA)
Brock Noland created HIVE-9332: -- Summary: Warn user when parquet mm kicks in Key: HIVE-9332 URL: https://issues.apache.org/jira/browse/HIVE-9332 Project: Hive Issue Type: Sub-task Comp

[jira] [Created] (HIVE-9331) get rid of pre-optimized-hashtable memory optimizations

2015-01-09 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-9331: -- Summary: get rid of pre-optimized-hashtable memory optimizations Key: HIVE-9331 URL: https://issues.apache.org/jira/browse/HIVE-9331 Project: Hive Issue

[jira] [Updated] (HIVE-9331) get rid of pre-optimized-hashtable memory optimizations

2015-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-9331: --- Fix Version/s: 0.15.0 > get rid of pre-optimized-hashtable memory optimizations > -

[jira] [Commented] (HIVE-9318) Add UnionMerge rule on cbo path

2015-01-09 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271673#comment-14271673 ] Laljo John Pullokkaran commented on HIVE-9318: -- +1 > Add UnionMerge rule on c

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2015-01-09 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- (Updated Ene. 9, 2015, 6:38 p.m.) Review request for hive, Brock Noland and che

[jira] [Updated] (HIVE-9330) DummyTxnManager will throw NPE if WriteEntity writeType has not been set

2015-01-09 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-9330: -- Attachment: HIVE-9330.patch The patch checks if the writeType is null or not before it is used in switch.

[jira] [Commented] (HIVE-9320) Add UnionEliminatorRule on cbo path

2015-01-09 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271654#comment-14271654 ] Hive QA commented on HIVE-9320: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9330) DummyTxnManager will throw NPE if WriteEntity writeType has not been set

2015-01-09 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-9330: -- Status: Patch Available (was: Open) > DummyTxnManager will throw NPE if WriteEntity writeType has not be

[jira] [Commented] (HIVE-8121) Create micro-benchmarks for ParquetSerde and evaluate performance

2015-01-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271653#comment-14271653 ] Sergio Peña commented on HIVE-8121: --- Hi All, I added a new patch to review that uses the

Re: Review Request 28964: HIVE-8121 Create micro-benchmarks for ParquetSerde and evaluate performance

2015-01-09 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28964/ --- (Updated Ene. 9, 2015, 6:26 p.m.) Review request for hive. Changes --- T

[jira] [Created] (HIVE-9330) DummyTxnManager will throw NPE if WriteEntity writeType has not been set

2015-01-09 Thread Chaoyu Tang (JIRA)
Chaoyu Tang created HIVE-9330: - Summary: DummyTxnManager will throw NPE if WriteEntity writeType has not been set Key: HIVE-9330 URL: https://issues.apache.org/jira/browse/HIVE-9330 Project: Hive

[jira] [Updated] (HIVE-8327) mvn site -Pfindbugs

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8327: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks,

Re: Review Request 29635: HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Vaibhav Gumashta
> On Jan. 9, 2015, 5:45 p.m., Brock Noland wrote: > > service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java, > > line 153 > > > > > > Would you mind updating: > > > > "fail to load reloada

[jira] [Commented] (HIVE-9318) Add UnionMerge rule on cbo path

2015-01-09 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271626#comment-14271626 ] Ashutosh Chauhan commented on HIVE-9318: Failures are unrelated. [~jpullokkaran] th

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2015-01-09 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271601#comment-14271601 ] Jihong Liu commented on HIVE-8966: -- Make sense. It is so great if that solution can be imp

Re: Review Request 29702: HIVE-9309 : schematool fails on Postgres 8.1

2015-01-09 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29702/#review67460 --- Ship it! Ship It! - Brock Noland On Jan. 8, 2015, 8:16 a.m., Moh

Re: Review Request 29625: HIVE-9200

2015-01-09 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29625/#review67459 --- ql/src/java/org/apache/hadoop/hive/ql/optimizer/NonBlockingOpDeDupP

Re: Review Request 29635: HiveServer2 leaks FileSystem objects in FileSystem.CACHE

2015-01-09 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29635/#review67455 --- Hi, I happened to see this randomly. Since you are cleaning up some

[jira] [Updated] (HIVE-9329) The qtest can't handle the statements which contains semicolons in qfile

2015-01-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9329: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thank you much Ferd! I have committe

[jira] [Updated] (HIVE-9328) Tests cannot move files due to change on HIVE-9325

2015-01-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9328: --- Resolution: Fixed Fix Version/s: encryption-branch Status: Resolved (was: Patch Avail

[jira] [Commented] (HIVE-9329) The qtest can't handle the statements which contains semicolons in qfile

2015-01-09 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271580#comment-14271580 ] Brock Noland commented on HIVE-9329: =1 > The qtest can't handle the statements which

[jira] [Commented] (HIVE-9329) The qtest can't handle the statements which contains semicolons in qfile

2015-01-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-9329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271579#comment-14271579 ] Sergio Peña commented on HIVE-9329: --- +1 Thanks Ferd > The qtest can't handle the stateme

  1   2   >