[jira] [Commented] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146685#comment-16146685 ] Hive QA commented on HIVE-17410: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17399: -- Attachment: HIVE-17399.2.patch Implemented the comments. Improved the test with non-zero results

[jira] [Commented] (HIVE-17195) Long chain of tasks created by REPL LOAD shouldn't cause stack corruption.

2017-08-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146635#comment-16146635 ] ASF GitHub Bot commented on HIVE-17195: --- Github user sankarh closed the pull request

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-29 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Status: Patch Available (was: Open) > Improve HS2 operation logs for REPL commands. > -

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-29 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Attachment: HIVE-17100.10.patch Added 10.patch with below change - Replaced addTask with upd

[jira] [Commented] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146615#comment-16146615 ] Hive QA commented on HIVE-17307: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-29 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146616#comment-16146616 ] Rui Li commented on HIVE-17405: --- [~stakiar], I think the root cause is the vector GBY has so

[jira] [Updated] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

2017-08-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated HIVE-17412: Attachment: HIVE-17412.patch [~stakiar], [~lirui]: Please help review, thanks! > Add "-- SO

[jira] [Updated] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-29 Thread Sankar Hariappan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sankar Hariappan updated HIVE-17100: Status: Open (was: Patch Available) > Improve HS2 operation logs for REPL commands. > -

[jira] [Assigned] (HIVE-17412) Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

2017-08-29 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel reassigned HIVE-17412: --- > Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q >

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146590#comment-16146590 ] Sahil Takiar commented on HIVE-17405: - Oh wow, thanks for pointing that out [~lirui]!

[jira] [Updated] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17405: Attachment: HIVE-17405.3.patch > HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTC

[jira] [Commented] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146556#comment-16146556 ] Hive QA commented on HIVE-17304: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17100) Improve HS2 operation logs for REPL commands.

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146548#comment-16146548 ] anishek commented on HIVE-17100: +1 only issue left is the dependency logger added to root

[jira] [Commented] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146537#comment-16146537 ] Gopal V commented on HIVE-17399: [~djaiswal]: left some comments - I like this approach of

[jira] [Updated] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17399: -- Attachment: HIVE-17399.1.patch [~gopalv] can you please review? > Do not remove semijoin branc

[jira] [Work started] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17399 started by Deepak Jaiswal. - > Do not remove semijoin branch if it feeds to TS->DPP_EVENT >

[jira] [Updated] (HIVE-17399) Do not remove semijoin branch if it feeds to TS->DPP_EVENT

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17399: -- Status: Patch Available (was: In Progress) > Do not remove semijoin branch if it feeds to TS->D

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146512#comment-16146512 ] Hive QA commented on HIVE-16886: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17323: -- Attachment: HIVE-17323.5.patch > Improve upon HIVE-16260 > --- > >

[jira] [Commented] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146498#comment-16146498 ] Deepak Jaiswal commented on HIVE-17323: --- Redid the logic to handle operators with mo

[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join

2017-08-29 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.03.patch > Check max shuffle size when converting to dy

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146481#comment-16146481 ] Hive QA commented on HIVE-17409: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17405) HoS DPP ConstantPropagate should use ConstantPropagateOption.SHORTCUT

2017-08-29 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146478#comment-16146478 ] Rui Li commented on HIVE-17405: --- It seems this also fixes spark_vectorized_dynamic_partition

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146477#comment-16146477 ] Sergey Shelukhin commented on HIVE-17409: - Yes; not necessarily just takeover, sha

[jira] [Updated] (HIVE-17225) HoS DPP pruning sink ops can target parallel work objects

2017-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17225: Attachment: HIVE-17225.4.patch > HoS DPP pruning sink ops can target parallel work objects > ---

[jira] [Commented] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146446#comment-16146446 ] Sergey Shelukhin commented on HIVE-17411: - No, there's no consistent repro > LLAP

[jira] [Commented] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146439#comment-16146439 ] Prasanth Jayachandran commented on HIVE-17411: -- Not sure if there is repro fo

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Status: Patch Available (was: Open) > LLAP IO may incorrectly release a refcount in some ra

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Description: In a large stream whose buffers are not reused, and that is separated into many

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Description: In a large stream whose buffers are not reused, and that is separated into many

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Attachment: HIVE-17411.patch [~prasanth_j] can you take a look? small bugfix > LLAP IO may

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Description: In a large stream whose buffers are not reused, separated into many buffers (e

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Summary: LLAP IO may incorrectly release a refcount in some rare cases (was: LLAP IO may in

[jira] [Updated] (HIVE-17411) LLAP IO may incorrectly release a refcount in some rare cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17411: Description: In a large stream whose buffers are not reused (e.g. a dictionary, that is loc

[jira] [Assigned] (HIVE-17411) LLAP IO may incorrectly release a refcount in some cases

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-17411: --- > LLAP IO may incorrectly release a refcount in some cases >

[jira] [Commented] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146408#comment-16146408 ] Hive QA commented on HIVE-17408: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread Alexander Kolbasov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146384#comment-16146384 ] Alexander Kolbasov commented on HIVE-16886: --- Looks like SQLGenerator.createInser

[jira] [Commented] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146373#comment-16146373 ] anishek commented on HIVE-17410: [~sankarh]/[~thejas]/[~daijy] please review > repl load

[jira] [Updated] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17410: --- Attachment: HIVE-17410.1.patch > repl load task during subsequent DAG generation does not start from the last

[jira] [Updated] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17410: --- Status: Patch Available (was: In Progress) > repl load task during subsequent DAG generation does not start f

[jira] [Work started] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17410 started by anishek. -- > repl load task during subsequent DAG generation does not start from the last > partition p

[jira] [Commented] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146340#comment-16146340 ] Hive QA commented on HIVE-17323: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17307: -- Attachment: HIVE-17307.4.patch A new patch that addresses Vihang's comments from the PR. > Change the m

[jira] [Updated] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17307: -- Status: Patch Available (was: Open) > Change the metastore to not use the metrics code in hive/common >

[jira] [Updated] (HIVE-17307) Change the metastore to not use the metrics code in hive/common

2017-08-29 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-17307: -- Status: Open (was: Patch Available) > Change the metastore to not use the metrics code in hive/common >

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146290#comment-16146290 ] Prasanth Jayachandran commented on HIVE-17409: -- bq. Are you talking about the

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146257#comment-16146257 ] Hive QA commented on HIVE-16886: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146252#comment-16146252 ] Sergey Shelukhin commented on HIVE-17409: - LLAP ZK code is better and easier to re

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146245#comment-16146245 ] Gopal V commented on HIVE-17409: bq. But at some point both registry codes diverged and i

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146239#comment-16146239 ] Prasanth Jayachandran commented on HIVE-17409: -- I am not exactly sure about t

[jira] [Updated] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-17304: - Attachment: HIVE-17304.2.patch Rebased patch > ThreadMXBean based memory allocati

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146211#comment-16146211 ] Sergey Shelukhin commented on HIVE-17409: - The AM registry logic is more similar

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146202#comment-16146202 ] Prasanth Jayachandran commented on HIVE-17409: -- The concern I have is around

[jira] [Commented] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146152#comment-16146152 ] Hive QA commented on HIVE-17323: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-17410) repl load task during subsequent DAG generation does not start from the last partition processed

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-17410: -- Assignee: anishek > repl load task during subsequent DAG generation does not start from the last > par

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: HIVE-16886.6.patch fixing configuration object reference > HMS log notifications may have duplica

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: (was: HIVE-16886.6.patch) > HMS log notifications may have duplicated event IDs if multiple HM

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: HIVE-16886.6.patch fixing the Configuration object reference > HMS log notifications may have dup

[jira] [Commented] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146111#comment-16146111 ] Sergey Shelukhin commented on HIVE-17304: - +1 with some testing > ThreadMXBean ba

[jira] [Commented] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146107#comment-16146107 ] Prasanth Jayachandran commented on HIVE-17304: -- The config changed because we

[jira] [Updated] (HIVE-17239) HoS doesn't trigger mapjoins against subquery with union all

2017-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-17239: Issue Type: Sub-task (was: Bug) Parent: HIVE-16923 > HoS doesn't trigger mapjoins against s

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146103#comment-16146103 ] Sergey Shelukhin commented on HIVE-17409: - Seems to work ok on the cluster > refa

[jira] [Commented] (HIVE-17006) LLAP: Parquet caching

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146102#comment-16146102 ] Sergey Shelukhin commented on HIVE-17006: - [~hagleitn] ping? > LLAP: Parquet cach

[jira] [Commented] (HIVE-17304) ThreadMXBean based memory allocation monitory for hash table loader

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146089#comment-16146089 ] Sergey Shelukhin commented on HIVE-17304: - Why did the config change? Otherwise lo

[jira] [Commented] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146071#comment-16146071 ] Thejas M Nair commented on HIVE-17408: -- +1 > replication distcp should only be invok

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146028#comment-16146028 ] Hive QA commented on HIVE-16886: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-17298) export when running distcp for large number of files should not run as privileged user

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek resolved HIVE-17298. Resolution: Duplicate > export when running distcp for large number of files should not run as > privileged

[jira] [Commented] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145999#comment-16145999 ] Sergey Shelukhin commented on HIVE-17409: - I'm going to test on a cluster > refac

[jira] [Comment Edited] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145991#comment-16145991 ] Sergey Shelukhin edited comment on HIVE-17409 at 8/29/17 7:50 PM: --

[jira] [Updated] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17409: Status: Patch Available (was: Open) > refactor LLAP ZK registry to make the ZK-registry par

[jira] [Updated] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-17409: Attachment: HIVE-17409.patch > refactor LLAP ZK registry to make the ZK-registry part reusab

[jira] [Commented] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145975#comment-16145975 ] anishek commented on HIVE-17408: [~sankarh]/[~thejas]/[~daijy] please review > replicatio

[jira] [Updated] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17408: --- Status: Patch Available (was: In Progress) > replication distcp should only be invoked if number of files AND

[jira] [Updated] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-17408: --- Attachment: HIVE-17408.1.patch > replication distcp should only be invoked if number of files AND file size >

[jira] [Assigned] (HIVE-17409) refactor LLAP ZK registry to make the ZK-registry part reusable

2017-08-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-17409: --- > refactor LLAP ZK registry to make the ZK-registry part reusable > -

[jira] [Work started] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-17408 started by anishek. -- > replication distcp should only be invoked if number of files AND file size > cross configu

[jira] [Updated] (HIVE-16924) Support distinct in presence Gby

2017-08-29 Thread Damien Carol (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damien Carol updated HIVE-16924: Description: {code:sql} create table e011_01 (c1 int, c2 smallint); insert into e011_01 values (1,

[jira] [Updated] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17323: -- Attachment: HIVE-17323.4.patch Updated the test to work with and without semijoin reduction for

[jira] [Commented] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145938#comment-16145938 ] Hive QA commented on HIVE-17276: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-17408) replication distcp should only be invoked if number of files AND file size cross configured limits

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek reassigned HIVE-17408: -- > replication distcp should only be invoked if number of files AND file size > cross configured limits > -

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: HIVE-16886.5.patch configurations for sleep and retry intervals for notification sequence lock >

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: (was: HIVE-16886.5.patch) > HMS log notifications may have duplicated event IDs if multiple HM

[jira] [Commented] (HIVE-17373) Upgrade some dependency versions

2017-08-29 Thread Naveen Gangam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145866#comment-16145866 ] Naveen Gangam commented on HIVE-17373: -- The patch looks good to me. +1 for me. > Upg

[jira] [Updated] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] anishek updated HIVE-16886: --- Attachment: HIVE-16886.5.patch adding configurations to manage retry limit and sleep time for acquiring the l

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145845#comment-16145845 ] anishek commented on HIVE-16886: add {{NOTIFICATION_SEQUENCE_LOCK_MAX_RETRIES}} and {{NOT

[jira] [Updated] (HIVE-17323) Improve upon HIVE-16260

2017-08-29 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-17323: -- Attachment: HIVE-17323.3.patch Fixed a ConcurrentModificationException > Improve upon HIVE-162

[jira] [Commented] (HIVE-17359) Deal with TypeInfo dependencies in the metastore

2017-08-29 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145797#comment-16145797 ] Hive QA commented on HIVE-17359: Here are the results of testing the latest attachment:

[jira] [Assigned] (HIVE-16924) Support distinct in presence Gby

2017-08-29 Thread Julian Hyde (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julian Hyde reassigned HIVE-16924: -- Assignee: Julian Hyde (was: Remus Rusanu) > Support distinct in presence Gby > --

[jira] [Commented] (HIVE-17280) Data loss in CONCATENATE ORC created by Spark

2017-08-29 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145785#comment-16145785 ] Prasanth Jayachandran commented on HIVE-17280: -- Do you happen to know the fil

[jira] [Commented] (HIVE-16886) HMS log notifications may have duplicated event IDs if multiple HMS are running concurrently

2017-08-29 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145772#comment-16145772 ] anishek commented on HIVE-16886: [~akolb] the transaction for handling the dbnotification

[jira] [Updated] (HIVE-12157) Support unicode for table/column names

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-12157: -- Component/s: (was: hpl/sql) > Support unicode for table/column names >

[jira] [Updated] (HIVE-14160) Reduce-task costs a long time to finish on the condition that the certain sql "select a,distinct(b) group by a" has been executed on the data which has skew distribution

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-14160: -- Component/s: (was: hpl/sql) > Reduce-task costs a long time to finish on the condition that

[jira] [Updated] (HIVE-13992) Insert overwrite from Parquet Source Table to Parquet Destination Table throws InvocationTargetException

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-13992: -- Component/s: (was: hpl/sql) > Insert overwrite from Parquet Source Table to Parquet Destinat

[jira] [Updated] (HIVE-12745) Hive Timestamp value change after joining two tables

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-12745: -- Component/s: (was: hpl/sql) > Hive Timestamp value change after joining two tables > ---

[jira] [Updated] (HIVE-12226) Support unicode for table names

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-12226: -- Component/s: (was: hpl/sql) > Support unicode for table names >

[jira] [Updated] (HIVE-16968) MAPJOIN hint error

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-16968: -- Component/s: (was: hpl/sql) > MAPJOIN hint error > -- > > Ke

[jira] [Updated] (HIVE-12216) WHERE on the FROM table not (always) working when JOIN are present

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-12216: -- Component/s: (was: hpl/sql) > WHERE on the FROM table not (always) working when JOIN are pre

[jira] [Updated] (HIVE-13136) Create index failed because index table not found.

2017-08-29 Thread Dmitry Tolpeko (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Tolpeko updated HIVE-13136: -- Component/s: (was: hpl/sql) > Create index failed because index table not found. > -

[jira] [Updated] (HIVE-17276) Check max shuffle size when converting to dynamically partitioned hash join

2017-08-29 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-17276: --- Attachment: HIVE-17276.02.patch Rebasing patch and triggering ptest again. >

  1   2   >