[jira] [Commented] (HIVE-16948) Invalid explain when running dynamic partition pruning query in Hive On Spark

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16130024#comment-16130024 ] Rui Li commented on HIVE-16948: --- [~kellyzly], sorry about the delay. I've left some comments

[jira] [Commented] (HIVE-16948) Invalid explain when running dynamic partition pruning query in Hive On Spark

2017-08-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129993#comment-16129993 ] liyunzhang_intel commented on HIVE-16948: - [~lirui]: Can you spend some time to re

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129989#comment-16129989 ] liyunzhang_intel commented on HIVE-17321: - [~lirui]: +1 > HoS: analyze ORC table

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129982#comment-16129982 ] Rui Li commented on HIVE-17321: --- [~kellyzly], yes they're all related to orc tables. > HoS:

[jira] [Comment Edited] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129923#comment-16129923 ] liyunzhang_intel edited comment on HIVE-17321 at 8/17/17 5:06 AM: --

[jira] [Comment Edited] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129923#comment-16129923 ] liyunzhang_intel edited comment on HIVE-17321 at 8/17/17 5:06 AM: --

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129923#comment-16129923 ] liyunzhang_intel commented on HIVE-17321: - [~lirui]: patch looks good. But I have

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129911#comment-16129911 ] Xuefu Zhang commented on HIVE-17321: +1 patch looks good to me. [~kellyzly], please le

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-08-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129895#comment-16129895 ] Xuefu Zhang commented on HIVE-15104: Hi [~lirui], thanks for continuing the work here.

[jira] [Commented] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129890#comment-16129890 ] Hive QA commented on HIVE-17343: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129891#comment-16129891 ] Rui Li commented on HIVE-17321: --- Latest failures are not related. Changes to the golden file

[jira] [Assigned] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-17343: --- Assignee: Sergey Shelukhin > create a mechanism to get rid of some globals in HS2 > -

[jira] [Commented] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129875#comment-16129875 ] Hive QA commented on HIVE-17321: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17343: Description: The intent is to initialize things once in HS2 ctor/init, and then be able to

[jira] [Updated] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17343: Status: Patch Available (was: Open) > create a mechanism to get rid of some globals in HS2

[jira] [Updated] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17343: Attachment: HIVE-17343.patch [~thejas] does this make sense? I might add this to a couple mo

[jira] [Commented] (HIVE-15104) Hive on Spark generate more shuffle data than hive on mr

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129871#comment-16129871 ] Rui Li commented on HIVE-15104: --- Hi [~xuefuz], with HIVE-17114 and HIVE-17321 the benchmark

[jira] [Updated] (HIVE-17343) create a mechanism to get rid of some globals in HS2

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17343: Summary: create a mechanism to get rid of some globals in HS2 (was: create a mechanism to g

[jira] [Commented] (HIVE-17286) Avoid expensive String serialization/deserialization for bitvectors

2017-08-16 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129832#comment-16129832 ] Ashutosh Chauhan commented on HIVE-17286: - +1 pending tests > Avoid expensive Str

[jira] [Commented] (HIVE-17292) Change TestMiniSparkOnYarnCliDriver test configuration to use the configured cores

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129807#comment-16129807 ] Rui Li commented on HIVE-17292: --- Hi [~pvary], as Xuefu agrees, let's only fix the yarn tests

[jira] [Updated] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified

2017-08-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-17321: -- Attachment: HIVE-17321.2.patch Update golden files > HoS: analyze ORC table doesn't compute raw data size when

[jira] [Updated] (HIVE-17342) Where condition with 1=0 should be treated similar to limit 0

2017-08-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-17342: --- Description: In some cases, queries may get executed with where condition mentioning to "1=0" to get schema.

[jira] [Updated] (HIVE-17340) TxnHandler.checkLock() - reduce number of SQL statements

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17340: -- Summary: TxnHandler.checkLock() - reduce number of SQL statements (was: TxnHandler.checkLock(Co

[jira] [Updated] (HIVE-17341) DbTxnManger.startHeartbeat() - randomize initial delay

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17341: -- Summary: DbTxnManger.startHeartbeat() - randomize initial delay (was: DbTxnManger.startHeartbea

[jira] [Assigned] (HIVE-17341) DbTxnManger.startHeartbeat()

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17341: - > DbTxnManger.startHeartbeat() > > > Key: HIVE-1

[jira] [Assigned] (HIVE-17340) TxnHandler.checkLock(Connection dbConn, long extLockId) optimization

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17340: - > TxnHandler.checkLock(Connection dbConn, long extLockId) optimization >

[jira] [Commented] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129712#comment-16129712 ] Hive QA commented on HIVE-17100: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17233) Set "mapred.input.dir.recursive" for HCatInputFormat-based jobs.

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17233: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.4.0

[jira] [Commented] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129700#comment-16129700 ] Vihang Karajgaonkar commented on HIVE-17336: LGTM +1 thanks for the change [~a

[jira] [Updated] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-15686: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.4.0

[jira] [Commented] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129693#comment-16129693 ] Mithun Radhakrishnan commented on HIVE-15686: - As established in [HIVE-8472|h

[jira] [Commented] (HIVE-17327) LLAP IO: restrict native file ID usage to default FS to avoid hypothetical collisions when HDFS federation is used

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129628#comment-16129628 ] Hive QA commented on HIVE-17327: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17325) Clean up intermittently failing unit tests

2017-08-16 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17325: -- Summary: Clean up intermittently failing unit tests (was: Clean up intermittently failing uni tests) >

[jira] [Updated] (HIVE-15899) check CTAS over acid table

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-15899: -- Issue Type: Sub-task (was: Task) Parent: HIVE-17204 > check CTAS over acid table > ---

[jira] [Commented] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129527#comment-16129527 ] Hive QA commented on HIVE-17336: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17325) Clean up intermittently failing uni tests

2017-08-16 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129515#comment-16129515 ] Alan Gates commented on HIVE-17325: --- Thanks for tracking down all these things. I'm all

[jira] [Commented] (HIVE-17233) Set "mapred.input.dir.recursive" for HCatInputFormat-based jobs.

2017-08-16 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129473#comment-16129473 ] Thejas M Nair commented on HIVE-17233: -- +1 > Set "mapred.input.dir.recursive" for HC

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Attachment: HIVE-17100.04.patch Added 04.patch with below changes. - Added new metastore api

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Status: Patch Available (was: Open) > Improve HS2 operation logs for REPL commands. > -

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Status: Open (was: Patch Available) > Improve HS2 operation logs for REPL commands. > -

[jira] [Commented] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129423#comment-16129423 ] Hive QA commented on HIVE-15686: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17327) LLAP IO: restrict native file ID usage to default FS to avoid hypothetical collisions when HDFS federation is used

2017-08-16 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129352#comment-16129352 ] Gopal V commented on HIVE-17327: LGTM - +1 tests pending on 01 patch > LLAP IO: restrict

[jira] [Commented] (HIVE-17233) Set "mapred.input.dir.recursive" for HCatInputFormat-based jobs.

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129347#comment-16129347 ] Hive QA commented on HIVE-17233: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-17256) add a notion of a guaranteed task to LLAP

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-17256. - Resolution: Fixed Fix Version/s: 3.0.0 Committed to master. Thanks for the review!

[jira] [Updated] (HIVE-17330) refactor TezSessionPoolManager to separate its multiple functions

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17330: Attachment: HIVE-17330.01.patch Accounting for nulls in non-HS2 case > refactor TezSessionP

[jira] [Comment Edited] (HIVE-15899) check CTAS over acid table

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013166#comment-16013166 ] Eugene Koifman edited comment on HIVE-15899 at 8/16/17 7:40 PM:

[jira] [Commented] (HIVE-17195) Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129300#comment-16129300 ] Sankar Hariappan commented on HIVE-17195: - Thanks for the commit [~thejas] and for

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Status: Patch Available (was: Open) > Disable rename operations during bootstrap dump > ---

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Attachment: HIVE-17183.03.patch > Disable rename operations during bootstrap dump >

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Attachment: (was: HIVE-17183.03.patch) > Disable rename operations during bootstrap dump

[jira] [Assigned] (HIVE-17339) Acid feature parity laundry list

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman reassigned HIVE-17339: - > Acid feature parity laundry list > > > Key

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Status: Open (was: Patch Available) > Disable rename operations during bootstrap dump > ---

[jira] [Commented] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129284#comment-16129284 ] Hive QA commented on HIVE-17183: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17328) Remove special handling for Acid tables wherever possible

2017-08-16 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-17328: -- Description: There are various places in the code that do something like {noformat} if(acid upd

[jira] [Updated] (HIVE-17327) LLAP IO: restrict native file ID usage to default FS to avoid hypothetical collisions when HDFS federation is used

2017-08-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17327: Attachment: HIVE-17327.01.patch Fixing the NPE. Looks like setupPool is not called outside o

[jira] [Commented] (HIVE-13875) Beeline ignore where clause when it is the last line of file and missing a EOL hence give wrong query result

2017-08-16 Thread Chad Laurent (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129205#comment-16129205 ] Chad Laurent commented on HIVE-13875: - affects last line of query in general, not just

[jira] [Commented] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129182#comment-16129182 ] Aihua Xu commented on HIVE-17336: - [~xuefuz] Can you take a look the simple change? Also,

[jira] [Updated] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-17336: Status: Patch Available (was: Open) patch-1: Hive on spark is incorrectly adding jar from conf (tmpjar is e

[jira] [Updated] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-17336: Attachment: HIVE-17336.1.patch > Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from

[jira] [Updated] (HIVE-17195) Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.

2017-08-16 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-17195: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch [~sankarh]

[jira] [Commented] (HIVE-17195) Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.

2017-08-16 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129160#comment-16129160 ] Thejas M Nair commented on HIVE-17195: -- +1 The cleanup of older code can be done in a

[jira] [Commented] (HIVE-17233) Set "mapred.input.dir.recursive" for HCatInputFormat-based jobs.

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129156#comment-16129156 ] Mithun Radhakrishnan commented on HIVE-17233: - [~thejas], could I please bothe

[jira] [Updated] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-15686: Status: Patch Available (was: Open) > Partitions on Remote HDFS break encryption-zo

[jira] [Updated] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-15686: Status: Open (was: Patch Available) Re-submitting for {{branch-2}} tests. > Partit

[jira] [Updated] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-15686: Attachment: HIVE-15686.1-branch-2.patch Renamed patch, to apply to {{branch-2}}. >

[jira] [Updated] (HIVE-15686) Partitions on Remote HDFS break encryption-zone checks

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-15686: Attachment: (was: HIVE-15686.branch-2.patch) > Partitions on Remote HDFS break e

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Status: Patch Available (was: Open) > Disable rename operations during bootstrap dump > ---

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Attachment: HIVE-17183.03.patch Added 03.patch with fixes for Anishek's comments. > Disable

[jira] [Updated] (HIVE-17218) Canonical-ize hostnames for Hive metastore, and HS2 servers.

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17218: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.4.0

[jira] [Updated] (HIVE-17183) Disable rename operations during bootstrap dump

2017-08-16 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17183: Status: Open (was: Patch Available) > Disable rename operations during bootstrap dump > ---

[jira] [Updated] (HIVE-17272) when hive.vectorized.execution.enabled is true, query on empty partitioned table fails with NPE

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated HIVE-17272: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed to

[jira] [Updated] (HIVE-17169) Avoid extra call to KeyProvider::getMetadata()

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17169: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.4.0

[jira] [Commented] (HIVE-17169) Avoid extra call to KeyProvider::getMetadata()

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129118#comment-16129118 ] Mithun Radhakrishnan commented on HIVE-17169: - As established in [HIVE-8472|h

[jira] [Commented] (HIVE-17292) Change TestMiniSparkOnYarnCliDriver test configuration to use the configured cores

2017-08-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129121#comment-16129121 ] Xuefu Zhang commented on HIVE-17292: Given that we need to update a lot of test files,

[jira] [Updated] (HIVE-17316) Use String.startsWith for the hidden configuration variables

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-17316: --- Description: Currently HiveConf variables which should not be displayed to the user ne

[jira] [Updated] (HIVE-17316) Use String.startsWith for the hidden configuration variables

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-17316: --- Summary: Use String.startsWith for the hidden configuration variables (was: Use Strin

[jira] [Commented] (HIVE-17322) Serialise BeeLine qtest execution to prevent flakyness

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129117#comment-16129117 ] Barna Zsombor Klara commented on HIVE-17322: [~pvary] I agree. I raised and li

[jira] [Resolved] (HIVE-16959) Flaky Test : TestBeeLineDriver.testCliDriver[insert_overwrite_local_directory_1]

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara resolved HIVE-16959. Resolution: Fixed Flakiness should be fixed by HIVE-17322. Please reopen if test sta

[jira] [Resolved] (HIVE-16796) Flaky Test : TestBeeLineDriver.testCliDriver[create_merge_compressed]

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara resolved HIVE-16796. Resolution: Fixed Flakiness should be fixed by HIVE-17322. Please reopen if test sta

[jira] [Updated] (HIVE-17181) HCatOutputFormat should expose complete output-schema (including partition-keys) for dynamic-partitioning MR jobs

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-17181: Resolution: Fixed Fix Version/s: 2.4.0 3.0.0 T

[jira] [Updated] (HIVE-8472) Add ALTER DATABASE SET LOCATION

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-8472: --- Fix Version/s: (was: 2.2.0) > Add ALTER DATABASE SET LOCATION > ---

[jira] [Commented] (HIVE-17181) HCatOutputFormat should expose complete output-schema (including partition-keys) for dynamic-partitioning MR jobs

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129106#comment-16129106 ] Mithun Radhakrishnan commented on HIVE-17181: - As established in [HIVE-8472|h

[jira] [Updated] (HIVE-8472) Add ALTER DATABASE SET LOCATION

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mithun Radhakrishnan updated HIVE-8472: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.2.0

[jira] [Commented] (HIVE-8472) Add ALTER DATABASE SET LOCATION

2017-08-16 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129084#comment-16129084 ] Mithun Radhakrishnan commented on HIVE-8472: Ok, that settles it. These tests a

[jira] [Assigned] (HIVE-17336) Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from Hive on Spark when inserting into hbase based table

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu reassigned HIVE-17336: --- > Missing class 'org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat' from > Hive on Spark when inser

[jira] [Commented] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129003#comment-16129003 ] Hive QA commented on HIVE-17300: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17272) when hive.vectorized.execution.enabled is true, query on empty partitioned table fails with NPE

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128999#comment-16128999 ] Aihua Xu commented on HIVE-17272: - [~ngangam] With my fix above, we shouldn't run into NPE

[jira] [Commented] (HIVE-17272) when hive.vectorized.execution.enabled is true, query on empty partitioned table fails with NPE

2017-08-16 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128971#comment-16128971 ] Aihua Xu commented on HIVE-17272: - [~ngangam] I don't see a case which will fail in that f

[jira] [Commented] (HIVE-17267) Make HMS Notification Listeners typesafe

2017-08-16 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128913#comment-16128913 ] Peter Vary commented on HIVE-17267: --- +1 LGTM > Make HMS Notification Listeners typesafe

[jira] [Updated] (HIVE-17322) Serialise BeeLine qtest execution to prevent flakyness

2017-08-16 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-17322: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Pushed

[jira] [Commented] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128904#comment-16128904 ] Hive QA commented on HIVE-17300: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17198) Flaky test: TestBeeLineDriver [smb_mapjoin_7]

2017-08-16 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128901#comment-16128901 ] Peter Vary commented on HIVE-17198: --- [~janulatha]: Is it possible to have a little more

[jira] [Commented] (HIVE-17322) Serialise BeeLine qtest execution to prevent flakyness

2017-08-16 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128859#comment-16128859 ] Barna Zsombor Klara commented on HIVE-17322: [~pvary] BeeLineTest failures see

[jira] [Assigned] (HIVE-17333) Schema changes in HIVE-12274 for Oracle may not work for upgrade

2017-08-16 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naveen Gangam reassigned HIVE-17333: > Schema changes in HIVE-12274 for Oracle may not work for upgrade > --

[jira] [Updated] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Karen Coppage (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-17300: - Description: Hi all, I’m working on a feature of the Hive WebUI Query Plan tab that would provide

[jira] [Updated] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Karen Coppage (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-17300: - Attachment: HIVE-17300.3.patch > WebUI query plan graphs > --- > >

[jira] [Updated] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Karen Coppage (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-17300: - Attachment: (was: HIVE-17300.2.patch) > WebUI query plan graphs > --- > >

[jira] [Updated] (HIVE-17300) WebUI query plan graphs

2017-08-16 Thread Karen Coppage (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karen Coppage updated HIVE-17300: - Attachment: HIVE-17300.2.patch > WebUI query plan graphs > --- > >

[jira] [Commented] (HIVE-17332) NullPointer exception when processing query

2017-08-16 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128805#comment-16128805 ] Lukas Waldmann commented on HIVE-17332: --- When hive.auto.convert.join is set to true

[jira] [Commented] (HIVE-17332) NullPointer exception when processing query

2017-08-16 Thread Lukas Waldmann (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16128801#comment-16128801 ] Lukas Waldmann commented on HIVE-17332: --- snapshot is partitioning column exception t

  1   2   >