[jira] [Commented] (HIVE-18390) IndexOutOfBoundsException when query a partitioned view in ColumnPruner

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317922#comment-16317922 ] Hive QA commented on HIVE-18390: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18079) Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator bit-size

2018-01-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-18079: --- Attachment: HIVE-18079.8.patch > Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator

[jira] [Resolved] (HIVE-18402) load data should rename files consistent with insert statements (bucketed tables only) Part4

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal resolved HIVE-18402. --- Resolution: Fixed No test changes required. > load data should rename files consistent with i

[jira] [Updated] (HIVE-18079) Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator bit-size

2018-01-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-18079: --- Attachment: (was: HIVE-18079.8.patch) > Statistics: Allow HyperLogLog to be merged to the lowest-common-de

[jira] [Updated] (HIVE-18079) Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator bit-size

2018-01-08 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-18079: --- Attachment: HIVE-18079.8.patch > Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator

[jira] [Resolved] (HIVE-18382) Duplicate entry key when create_table/add_partition

2018-01-08 Thread Biao Wu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biao Wu resolved HIVE-18382. Resolution: Not A Bug load error JDO ConnectionFactoryImpl > Duplicate entry key when create_table/add_part

[jira] [Updated] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18400: -- Attachment: HIVE-18400.1.patch [~ekoifman] can you please review the result only changes? No cod

[jira] [Updated] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18400: -- Status: Patch Available (was: In Progress) > load data should rename files consistent with inse

[jira] [Work started] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-18400 started by Deepak Jaiswal. - > load data should rename files consistent with insert statements (bucketed >

[jira] [Updated] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18399: -- Attachment: (was: HIVE-18399.1.patch) > load data should rename files consistent with insert

[jira] [Updated] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18399: -- Attachment: HIVE-18399.1.patch [~ekoifman] can you please review the result only changes? No cod

[jira] [Updated] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18399: -- Status: Patch Available (was: In Progress) > load data should rename files consistent with inse

[jira] [Issue Comment Deleted] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18399: -- Comment: was deleted (was: [~ekoifman] can you please review the result only changes? No code c

[jira] [Updated] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18399: -- Attachment: HIVE-18399.1.patch [~ekoifman] can you please review the result only changes? No co

[jira] [Work started] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-18399 started by Deepak Jaiswal. - > load data should rename files consistent with insert statements (bucketed >

[jira] [Commented] (HIVE-18390) IndexOutOfBoundsException when query a partitioned view in ColumnPruner

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317836#comment-16317836 ] Hive QA commented on HIVE-18390: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317820#comment-16317820 ] Hive QA commented on HIVE-18269: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317742#comment-16317742 ] Hive QA commented on HIVE-18269: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread anishek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317741#comment-16317741 ] anishek commented on HIVE-18352: [~thejas] yes it is > introduce a METADATAONLY option wh

[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table

2018-01-08 Thread Madhudeep Petwal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317732#comment-16317732 ] Madhudeep Petwal commented on HIVE-18373: - Oh. sorry for misreading the statement.

[jira] [Commented] (HIVE-18359) Extend grouping set limits from int to long

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317719#comment-16317719 ] Hive QA commented on HIVE-18359: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317692#comment-16317692 ] Rui Li commented on HIVE-16484: --- bq. Hive wouldn't need a separate Spark installation to be

[jira] [Commented] (HIVE-18359) Extend grouping set limits from int to long

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317672#comment-16317672 ] Hive QA commented on HIVE-18359: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18367) Describe Extended output is truncated on a table with an explicit row format containing tabs or newlines.

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317648#comment-16317648 ] Hive QA commented on HIVE-18367: Here are the results of testing the latest attachment:

[jira] [Resolved] (HIVE-17916) remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED

2018-01-08 Thread Teddy Choi (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teddy Choi resolved HIVE-17916. --- Resolution: Fixed > remove ConfVars.HIVE_VECTORIZATION_ROW_IDENTIFIER_ENABLED > --

[jira] [Commented] (HIVE-18367) Describe Extended output is truncated on a table with an explicit row format containing tabs or newlines.

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317604#comment-16317604 ] Hive QA commented on HIVE-18367: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HIVE-18411) Fix ArrayIndexOutOfBoundsException for VectorizedListColumnReader

2018-01-08 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Ma updated HIVE-18411: Status: Patch Available (was: Open) [~Ferd], can you help to review the fix, thanks. > Fix ArrayIndexOutOf

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317572#comment-16317572 ] Hive QA commented on HIVE-18391: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18411) Fix ArrayIndexOutOfBoundsException for VectorizedListColumnReader

2018-01-08 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Ma updated HIVE-18411: Attachment: HIVE-18411.001.patch > Fix ArrayIndexOutOfBoundsException for VectorizedListColumnReader > -

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317557#comment-16317557 ] Hive QA commented on HIVE-18391: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317556#comment-16317556 ] Vihang Karajgaonkar commented on HIVE-18323: Are timestamps are serialized as

[jira] [Updated] (HIVE-18229) add the unmanaged mapping command

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18229: Attachment: HIVE-18229.01.patch Fixing issues, addressing RB feedback, also fixed an unrelat

[jira] [Assigned] (HIVE-18411) Fix ArrayIndexOutOfBoundsException for VectorizedListColumnReader

2018-01-08 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Ma reassigned HIVE-18411: --- > Fix ArrayIndexOutOfBoundsException for VectorizedListColumnReader > ---

[jira] [Updated] (HIVE-18221) test acid default

2018-01-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated HIVE-18221: -- Attachment: HIVE-18221.26.patch patch 26 fixes (hacks) MetastoreConf so that it agrees with Hive

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Status: Patch Available (was: In Progress) > [Performance][Avro] Reading flat Avro tables is

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Attachment: HIVE-18410.patch > [Performance][Avro] Reading flat Avro tables is very expensive

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Affects Version/s: 2.3.2 > [Performance][Avro] Reading flat Avro tables is very expensive in H

[jira] [Commented] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317521#comment-16317521 ] Ratandeep Ratti commented on HIVE-18410: Attached profiling data > [Performance][

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Fix Version/s: 2.3.2 > [Performance][Avro] Reading flat Avro tables is very expensive in Hive

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Attachment: profiling_with_patch.png profiling_without_patch.png > [Performanc

[jira] [Work started] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-18410 started by Ratandeep Ratti. -- > [Performance][Avro] Reading flat Avro tables is very expensive in Hive > --

[jira] [Updated] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti updated HIVE-18410: --- Attachment: profiling_with_patch.nps profiling_without_patch.nps > [Performanc

[jira] [Assigned] (HIVE-18410) [Performance][Avro] Reading flat Avro tables is very expensive in Hive

2018-01-08 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ratandeep Ratti reassigned HIVE-18410: -- > [Performance][Avro] Reading flat Avro tables is very expensive in Hive >

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317508#comment-16317508 ] Hive QA commented on HIVE-18326: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-18352) introduce a METADATAONLY option while doing REPL DUMP to allow integrations of other tools

2018-01-08 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317505#comment-16317505 ] Thejas M Nair commented on HIVE-18352: -- [~anishek] Is the github pull request updated

[jira] [Updated] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-18323: Issue Type: Sub-task (was: Improvement) Parent: HIVE-14826 > Vectorization: add the support

[jira] [Commented] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317493#comment-16317493 ] Ferdinand Xu commented on HIVE-18323: - Thanks [~aihuaxu] for the patch. Generally LGTM

[jira] [Commented] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317486#comment-16317486 ] Sergey Shelukhin commented on HIVE-18379: - What was the error, is the table object

[jira] [Commented] (HIVE-18380) ALTER TABLE CONCATENATE is not supported on Micro-managed table

2018-01-08 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317481#comment-16317481 ] Eugene Koifman commented on HIVE-18380: --- I think concatenating/compacting contiguous

[jira] [Commented] (HIVE-18397) Support vectorization for INTERVAL_DAY_TIME type

2018-01-08 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317479#comment-16317479 ] Ferdinand Xu commented on HIVE-18397: - I think Parquet doesn't support interval_day_ti

[jira] [Comment Edited] (HIVE-18380) ALTER TABLE CONCATENATE is not supported on Micro-managed table

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317467#comment-16317467 ] Sergey Shelukhin edited comment on HIVE-18380 at 1/9/18 1:12 AM: ---

[jira] [Commented] (HIVE-18380) ALTER TABLE CONCATENATE is not supported on Micro-managed table

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317467#comment-16317467 ] Sergey Shelukhin commented on HIVE-18380: - [~ekoifman] [~steveyeom2017] should it

[jira] [Commented] (HIVE-18397) Support vectorization for INTERVAL_DAY_TIME type

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317465#comment-16317465 ] Vihang Karajgaonkar commented on HIVE-18397: Based on what I see in https://g

[jira] [Assigned] (HIVE-18409) load data should rename files consistent with insert statements (bucketed tables only) Part11

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18409: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18407) load data should rename files consistent with insert statements (bucketed tables only) Part9

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18407: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18408) load data should rename files consistent with insert statements (bucketed tables only) Part10

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18408: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18406) load data should rename files consistent with insert statements (bucketed tables only) Part8

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18406: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18405) load data should rename files consistent with insert statements (bucketed tables only) Part7

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18405: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18404) load data should rename files consistent with insert statements (bucketed tables only) Part6

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18404: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18403) load data should rename files consistent with insert statements (bucketed tables only) Part5

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18403: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Updated] (HIVE-18402) load data should rename files consistent with insert statements (bucketed tables only) Part4

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal updated HIVE-18402: -- Summary: load data should rename files consistent with insert statements (bucketed tables only)

[jira] [Assigned] (HIVE-18402) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18402: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18401) load data should rename files consistent with insert statements (bucketed tables only) Part3

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18401: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18400) load data should rename files consistent with insert statements (bucketed tables only) Part2

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18400: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Assigned] (HIVE-18399) load data should rename files consistent with insert statements (bucketed tables only) Part1

2018-01-08 Thread Deepak Jaiswal (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Jaiswal reassigned HIVE-18399: - > load data should rename files consistent with insert statements (bucketed > tables only) P

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317425#comment-16317425 ] Hive QA commented on HIVE-18326: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Commented] (HIVE-18326) LLAP Tez scheduler - only preempt tasks if there's a dependency between them

2018-01-08 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317403#comment-16317403 ] Siddharth Seth commented on HIVE-18326: --- On DAG itself - I think this is the only pl

[jira] [Commented] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317398#comment-16317398 ] Hive QA commented on HIVE-18379: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317380#comment-16317380 ] Sahil Takiar commented on HIVE-16484: - [~xuefuz] makes sense. In that case, maybe maki

[jira] [Comment Edited] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317336#comment-16317336 ] Xuefu Zhang edited comment on HIVE-16484 at 1/8/18 11:57 PM: -

[jira] [Updated] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Yeom updated HIVE-18379: -- Attachment: HIVE-18379.03.patch Cleared checkstyle warning.. > ALTER TABLE authorization_part SET PROPE

[jira] [Commented] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317372#comment-16317372 ] Vihang Karajgaonkar commented on HIVE-18323: Also, looks like there is some co

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317336#comment-16317336 ] Xuefu Zhang commented on HIVE-16484: [~stakiar], I'm not denying the potential benefit

[jira] [Commented] (HIVE-18379) ALTER TABLE authorization_part SET PROPERTIES ("PARTITIONL_LEVEL_PRIVILEGE"="TRUE"); fails when authorization_part is MicroManaged table.

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317331#comment-16317331 ] Hive QA commented on HIVE-18379: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Updated] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Janaki Lahorani (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Janaki Lahorani updated HIVE-18393: --- Attachment: HIVE-18393.1.patch The build failures doesn't make sense. Resubmitting to evaluat

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317318#comment-16317318 ] Marcelo Vanzin commented on HIVE-16484: --- Just amending my previous response: if the

[jira] [Updated] (HIVE-18330) Fix TestMsgBusConnection - doesn't test tests the original intention

2018-01-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-18330: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Availa

[jira] [Commented] (HIVE-18330) Fix TestMsgBusConnection - doesn't test tests the original intention

2018-01-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317304#comment-16317304 ] Ashutosh Chauhan commented on HIVE-18330: - +1 lets get test fix in. > Fix TestMsg

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317302#comment-16317302 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-18390) IndexOutOfBoundsException when query a partitioned view in ColumnPruner

2018-01-08 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-18390: Status: Patch Available (was: Open) > IndexOutOfBoundsException when query a partitioned v

[jira] [Commented] (HIVE-18323) Vectorization: add the support of timestamp in VectorizedPrimitiveColumnReader for parquet

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317297#comment-16317297 ] Vihang Karajgaonkar commented on HIVE-18323: Thanks [~aihuaxu] for taking this

[jira] [Updated] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18269: Attachment: HIVE-18269.03.patch I cannot repro the new failures and they look like they are

[jira] [Updated] (HIVE-18152) Idempotent state change for resource plan

2018-01-08 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-18152: Resolution: Done Status: Resolved (was: Patch Available) Looks like it's already fi

[jira] [Updated] (HIVE-18359) Extend grouping set limits from int to long

2018-01-08 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-18359: - Attachment: HIVE-18359.4.patch [~mmccline]/[~kgyrtkirk] vector_grouping_sets.q is

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317197#comment-16317197 ] Hive QA commented on HIVE-17396: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HIVE-18372) Create testing infra to test different HMS instances

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317175#comment-16317175 ] Alan Gates commented on HIVE-18372: --- Peter, could you comment a bit on the goals behind

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317173#comment-16317173 ] Prasanth Jayachandran commented on HIVE-18349: -- bq. Why should this method be

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317160#comment-16317160 ] Hive QA commented on HIVE-18391: Here are the results of testing the latest attachment:

[jira] [Comment Edited] (HIVE-18395) Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317130#comment-16317130 ] Steve Yeom edited comment on HIVE-18395 at 1/8/18 9:46 PM: --- I ta

[jira] [Commented] (HIVE-18349) Misc metastore changes for debuggability, error on commit txn failures

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317133#comment-16317133 ] Alan Gates commented on HIVE-18349: --- HiveMetaStore.endFunction, lines 887 after your pat

[jira] [Commented] (HIVE-18395) Using stats for aggregates on Acid/MM is off even with "hive.compute.query.using.stats" is true.

2018-01-08 Thread Steve Yeom (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317130#comment-16317130 ] Steve Yeom commented on HIVE-18395: --- I talked with Ashutosh Chauhan. We turned off usin

[jira] [Commented] (HIVE-18391) load data should rename files consistent with insert statements (bucketed tables only)

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317110#comment-16317110 ] Hive QA commented on HIVE-18391: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || S

[jira] [Updated] (HIVE-18367) Describe Extended output is truncated on a table with an explicit row format containing tabs or newlines.

2018-01-08 Thread Andrew Sherman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Sherman updated HIVE-18367: -- Attachment: HIVE-18367.3.patch Some test changes because the 'describe extended' output now alwa

[jira] [Commented] (HIVE-18355) Add builder for metastore Thrift classes missed in the first pass - FunctionBuilder

2018-01-08 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317103#comment-16317103 ] Alan Gates commented on HIVE-18355: --- A couple of comments in the build method: # It shou

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317066#comment-16317066 ] Sahil Takiar commented on HIVE-16484: - [~xuefuz] thanks for voicing your concern, I se

[jira] [Updated] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17580: --- Status: Patch Available (was: In Progress) > Remove dependency of get_fields_with_env

[jira] [Updated] (HIVE-17580) Remove dependency of get_fields_with_environment_context API to serde

2018-01-08 Thread Vihang Karajgaonkar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17580: --- Attachment: HIVE-17580-standalone-metastore.001.patch attaching the first version of t

[jira] [Commented] (HIVE-16484) Investigate SparkLauncher for HoS as alternative to bin/spark-submit

2018-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317034#comment-16317034 ] Xuefu Zhang commented on HIVE-16484: I'd echo with [~lirui], wondering the benefits th

[jira] [Commented] (HIVE-18393) Error returned when some other type is read as string from parquet tables

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317028#comment-16317028 ] Hive QA commented on HIVE-18393: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-17396) Support DPP with map joins where the source and target belong in the same stage

2018-01-08 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317014#comment-16317014 ] Hive QA commented on HIVE-17396: Here are the results of testing the latest attachment:

  1   2   >