Review Request 28936: Set completer in CliDriver is not working

2014-12-10 Thread Navis Ryu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28936/ --- Review request for hive. Bugs: HIVE-9077 https://issues.apache.org/jira/bro

[jira] [Updated] (HIVE-9077) Set completer in CliDriver is not working

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9077: Attachment: HIVE-9077.2.patch.txt > Set completer in CliDriver is not working > -

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242270#comment-14242270 ] Chengxiang Li commented on HIVE-9078: - We may need to move all spark branch issues as s

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242266#comment-14242266 ] Chengxiang Li commented on HIVE-9078: - Oh, yes, [~csun], Brock bring this issue out tod

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242249#comment-14242249 ] Chao commented on HIVE-9078: [~chengxiang li] Does this make HIVE-9046 duplicate? > Hive shoul

[jira] [Updated] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9079: Status: Patch Available (was: Open) > Hive hangs while failed to get executorCount[Spark Branch] > -

[jira] [Updated] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9079: Attachment: HIVE-9078.1-spark.patch Add 5s timeout to wait for executorCount result. > Hive hangs wh

[jira] [Created] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-9079: --- Summary: Hive hangs while failed to get executorCount[Spark Branch] Key: HIVE-9079 URL: https://issues.apache.org/jira/browse/HIVE-9079 Project: Hive Issue Typ

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9078: Status: Patch Available (was: Open) > Hive should not submit second SparkTask while previous one has

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9078: Summary: Hive should not submit second SparkTask while previous one has failed.[Spark Branch] (was:

Review Request 28934: HIVE-9078 Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-10 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28934/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-9078 https://issues.apa

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9078: Attachment: HIVE-9078.1-spark.patch > Hive should not submit second SparkTask while previous one has

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9078: Summary: Hive should not submit second SparkTask while previous one has failed.[Spark Branch]] (was:

[jira] [Created] (HIVE-9078) Hive should not submit second SparkTask is previous one has failed.[Spark Branch]]

2014-12-10 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-9078: --- Summary: Hive should not submit second SparkTask is previous one has failed.[Spark Branch]] Key: HIVE-9078 URL: https://issues.apache.org/jira/browse/HIVE-9078 Project:

[jira] [Commented] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-10 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242208#comment-14242208 ] Hive QA commented on HIVE-8639: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Assigned] (HIVE-8816) Create unit test join of two encrypted tables with different keys

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu reassigned HIVE-8816: -- Assignee: Ferdinand Xu > Create unit test join of two encrypted tables with different keys > ---

[jira] [Assigned] (HIVE-8820) Create unit test where we read from a read only unencrypted table

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu reassigned HIVE-8820: -- Assignee: Ferdinand Xu > Create unit test where we read from a read only unencrypted table > ---

[jira] [Resolved] (HIVE-8940) add createZones and listZones supports in HdfsEncryptionShim for the test purposes

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu resolved HIVE-8940. Resolution: Invalid close this jira since resolved in HIVE-8900 > add createZones and listZones supp

[jira] [Commented] (HIVE-8131) Support timestamp in Avro

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242197#comment-14242197 ] Ferdinand Xu commented on HIVE-8131: Hi [~mohitsabharwal], can you please help me revie

Review Request 28933: HIVE-8131:Support timestamp in Avro

2014-12-10 Thread cheng xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28933/ --- Review request for hive. Repository: hive-git Description --- The patch

[jira] [Updated] (HIVE-8131) Support timestamp in Avro

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8131: --- Attachment: HIVE-8131.patch > Support timestamp in Avro > - > >

[jira] [Updated] (HIVE-8131) Support timestamp in Avro

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8131: --- Status: Patch Available (was: Open) > Support timestamp in Avro > - > >

[jira] [Commented] (HIVE-9066) temporarily disable CBO for non-deterministic functions

2014-12-10 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242175#comment-14242175 ] Laljo John Pullokkaran commented on HIVE-9066: -- This fix is not needed as HIVE

[jira] [Updated] (HIVE-9077) Set completer in CliDriver is not working

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9077: Status: Patch Available (was: Open) > Set completer in CliDriver is not working > --

[jira] [Updated] (HIVE-9077) Set completer in CliDriver is not working

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9077: Description: NO PRECOMMIT TESTS Seemed broken in HIVE-8609 {noformat} hive (default)> set Exception in thread "main"

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242154#comment-14242154 ] Xuefu Zhang commented on HIVE-9060: --- +1 pending on tests. > Fix child operator reference

[jira] [Created] (HIVE-9077) Set completer in CliDriver is not working

2014-12-10 Thread Navis (JIRA)
Navis created HIVE-9077: --- Summary: Set completer in CliDriver is not working Key: HIVE-9077 URL: https://issues.apache.org/jira/browse/HIVE-9077 Project: Hive Issue Type: Bug Components: CLI

[jira] [Updated] (HIVE-9077) Set completer in CliDriver is not working

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9077: Attachment: HIVE-9077.1.patch.txt > Set completer in CliDriver is not working > -

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-10 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9060: Attachment: HIVE-9060.3.patch Actually seems precommit tests hasnt started yet. I'll just make the fix. > F

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-10 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242149#comment-14242149 ] Szehon Ho commented on HIVE-9060: - Sorry I missed that, that would be good thanks. > Fix c

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242148#comment-14242148 ] Chao commented on HIVE-8913: Looking at the log, something interesting.. {noformat} 2014-12-10

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242145#comment-14242145 ] Rui Li commented on HIVE-8913: -- I think the call path should be {{ExecMapperContext.clear -> I

[jira] [Updated] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-10 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8639: Affects Version/s: spark-branch Status: Patch Available (was: Open) I have a patch for this J

[jira] [Assigned] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8639: - Assignee: Szehon Ho (was: Chinna Rao Lalam) > Convert SMBJoin to MapJoin [Spark Branch] > ---

[jira] [Updated] (HIVE-8639) Convert SMBJoin to MapJoin [Spark Branch]

2014-12-10 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8639: Attachment: HIVE-8639.1-spark.patch > Convert SMBJoin to MapJoin [Spark Branch] > ---

Review Request 28930: HIVE-8639 : Convert SMBJoin to MapJoin [Spark Branch]

2014-12-10 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28930/ --- Review request for hive. Bugs: HIVE-8639 https://issues.apache.org/jira/bro

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242133#comment-14242133 ] Navis commented on HIVE-9076: - Test always makes file composition like below, {noformat} 00

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242125#comment-14242125 ] Prasanth Jayachandran commented on HIVE-9076: - [~navis] I am wondering how test

[jira] [Commented] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242124#comment-14242124 ] Xuefu Zhang commented on HIVE-9060: --- It seems there is still a duplication of {code}qbJo

[jira] [Updated] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8993: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-9060) Fix child operator references after NonBlockingOpDeDupProc

2014-12-10 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9060: Attachment: HIVE-9060.2.patch Addressing review comments. > Fix child operator references after NonBlockingO

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9025: --- Status: Patch Available (was: Open) > join38.q (without map join) produces incorrect result wh

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9025: --- Status: Open (was: Patch Available) > join38.q (without map join) produces incorrect result wh

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242117#comment-14242117 ] Xuefu Zhang commented on HIVE-8993: --- The test failures are concerning, but I don't think

[jira] [Commented] (HIVE-5538) Turn on vectorization by default.

2014-12-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242111#comment-14242111 ] Sergey Shelukhin commented on HIVE-5538: We should be thinking about eliminating so

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242108#comment-14242108 ] Hive QA commented on HIVE-8993: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242107#comment-14242107 ] Sergey Shelukhin commented on HIVE-9067: +1 if tests pass > OrcFileMergeOperator m

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242104#comment-14242104 ] Xuefu Zhang commented on HIVE-8913: --- {quote} Just quick thought, maybe IOContext.inputNam

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242100#comment-14242100 ] Xuefu Zhang commented on HIVE-8913: --- Yes, it's possible, but we already have that in Spar

[jira] [Updated] (HIVE-9055) Tez: union all followed by group by followed by another union all gives error

2014-12-10 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-9055: - Attachment: HIVE-9055.WIP.patch > Tez: union all followed by group by followed by another union all

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242095#comment-14242095 ] Prasanth Jayachandran commented on HIVE-9076: - Thanks [~navis] for the logs and

[jira] [Commented] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-10 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242094#comment-14242094 ] Sergey Shelukhin commented on HIVE-9035: can you post RB? > CBO: Disable PPD when

[jira] [Updated] (HIVE-9055) Tez: union all followed by group by followed by another union all gives error

2014-12-10 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-9055: - Status: Patch Available (was: Open) > Tez: union all followed by group by followed by another unio

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242087#comment-14242087 ] Rui Li commented on HIVE-8913: -- Another possible issue is that we have to make sure the thread

[jira] [Updated] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9076: Status: Patch Available (was: Open) > incompatFileSet in AbstractFileMergeOperator should be marked to skip task id

[jira] [Updated] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9076: Attachment: HIVE-9076.1.patch.txt > incompatFileSet in AbstractFileMergeOperator should be marked to skip task id >

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242082#comment-14242082 ] Navis commented on HIVE-9076: - Result {noformat} hive (default)> dfs -ls ${hiveconf:hive.metast

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242076#comment-14242076 ] Chao commented on HIVE-8913: (cc [~jxiang]) Not sure - maybe we can try that. The interesting t

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242050#comment-14242050 ] Brock Noland commented on HIVE-8993: +1 pending tests > Make sure Spark + HS2 work [Sp

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242045#comment-14242045 ] Prasanth Jayachandran commented on HIVE-9076: - [~navis] Log file should tell wh

Re: Review Request 28894: HIVE-8993 Make sure HoS works with HS2[Spark Branch]

2014-12-10 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28894/ --- (Updated Dec. 11, 2014, 2:49 a.m.) Review request for hive and Xuefu Zhang. C

[jira] [Updated] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8993: Attachment: HIVE-8993.3-spark.patch Move spark download script to itests/pom.xml, which would be used

[jira] [Commented] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242044#comment-14242044 ] Prasanth Jayachandran commented on HIVE-9076: - What is the resultant file set a

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-10 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/#review64671 --- This looks great!! I have a few comments below.. ql/src/java/org/a

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242035#comment-14242035 ] Rui Li commented on HIVE-8913: -- Just quick thought, maybe {{IOContext.inputNameIOContextMap}}

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242026#comment-14242026 ] Chao commented on HIVE-8913: Looks like there's still some concurrency issue related to IOConte

[jira] [Created] (HIVE-9076) incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check

2014-12-10 Thread Navis (JIRA)
Navis created HIVE-9076: --- Summary: incompatFileSet in AbstractFileMergeOperator should be marked to skip task id check Key: HIVE-9076 URL: https://issues.apache.org/jira/browse/HIVE-9076 Project: Hive

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242020#comment-14242020 ] Rui Li commented on HIVE-8913: -- I think the failure is not related because it passes on my mac

[jira] [Updated] (HIVE-8900) Create encryption testing framework

2014-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8900: --- Resolution: Fixed Fix Version/s: encryption-branch Status: Resolved (was: Patch Avail

[jira] [Commented] (HIVE-8900) Create encryption testing framework

2014-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242013#comment-14242013 ] Brock Noland commented on HIVE-8900: +1 Thank you [~Ferd] and [~spena]! I have committ

[jira] [Updated] (HIVE-9075) Allow RPC Configuration [Spark Branch]

2014-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9075: --- Affects Version/s: spark-branch Summary: Allow RPC Configuration [Spark Branch] (was: All

[jira] [Created] (HIVE-9075) Allow RPC Configuration

2014-12-10 Thread Brock Noland (JIRA)
Brock Noland created HIVE-9075: -- Summary: Allow RPC Configuration Key: HIVE-9075 URL: https://issues.apache.org/jira/browse/HIVE-9075 Project: Hive Issue Type: Sub-task Reporter: Bro

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242011#comment-14242011 ] Brock Noland commented on HIVE-8993: That sounds good! > Make sure Spark + HS2 work [S

[jira] [Commented] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242006#comment-14242006 ] Vikram Dixit K commented on HIVE-9025: -- +1 for 0.14 > join38.q (without map join) pro

[jira] [Updated] (HIVE-9001) Ship with log4j.properties file that has a reliable time based rolling policy

2014-12-10 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-9001: - Labels: (was: TODOC15) > Ship with log4j.properties file that has a reliable time based rolling p

[jira] [Commented] (HIVE-9001) Ship with log4j.properties file that has a reliable time based rolling policy

2014-12-10 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241995#comment-14241995 ] Lefty Leverenz commented on HIVE-9001: -- Yes, you can remove TODOC15 as soon as it's do

[jira] [Commented] (HIVE-9019) Avoid using SPARK_JAVA_OPTS [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241993#comment-14241993 ] Rui Li commented on HIVE-9019: -- OK... let me know if you find other problems with this :-) >

[jira] [Commented] (HIVE-9062) Explain plan doesn't print join keys for Tez shuffle join

2014-12-10 Thread Vikram Dixit K (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241987#comment-14241987 ] Vikram Dixit K commented on HIVE-9062: -- LGTM +1. +1 for 0.14 as well. > Explain plan

[jira] [Commented] (HIVE-9063) NPE in RemoteSparkJobStatus.getSparkStatistics [Spark Branch]

2014-12-10 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241984#comment-14241984 ] Rui Li commented on HIVE-9063: -- [~xuefuz] - that seems to be an auto optimize of IntelliJ. I'l

Re: Review Request 28791: HIVE-9025 join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28791/#review64666 --- Ship it! Ship It! - Chao Sun On Dec. 11, 2014, 1:36 a.m., Ted Xu

[jira] [Updated] (HIVE-8049) Transparent column level encryption using kms

2014-12-10 Thread Xiaomeng Huang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaomeng Huang updated HIVE-8049: - Status: Patch Available (was: In Progress) > Transparent column level encryption using kms > -

[jira] [Resolved] (HIVE-8969) getChildPrivileges should in one transaction with revoke

2014-12-10 Thread Xiaomeng Huang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaomeng Huang resolved HIVE-8969. -- Resolution: Invalid Sorry, I want to create this jira in Sentry project, but I made a mistake in

[jira] [Updated] (HIVE-8900) Create encryption testing framework

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8900: --- Description: As [mentioned by Alan|https://issues.apache.org/jira/browse/HIVE-8821?focusedCommentId=14

[jira] [Commented] (HIVE-8993) Make sure Spark + HS2 work [Spark Branch]

2014-12-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241977#comment-14241977 ] Chengxiang Li commented on HIVE-8993: - Should we put download spark logic in itests pom

Re: Review Request 28791: HIVE-9025 join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Ted Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28791/ --- (Updated 十二月 11, 2014, 1:36 a.m.) Review request for hive, Ashutosh Chauhan and

[jira] [Updated] (HIVE-9025) join38.q (without map join) produces incorrect result when testing with multiple reducers

2014-12-10 Thread Ted Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Xu updated HIVE-9025: - Attachment: HIVE-9025.1.patch > join38.q (without map join) produces incorrect result when testing with > multiple

[jira] [Assigned] (HIVE-8932) Enable n-way join on CBO

2014-12-10 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran reassigned HIVE-8932: Assignee: Laljo John Pullokkaran > Enable n-way join on CBO > -

[jira] [Updated] (HIVE-8900) Create encryption testing framework

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-8900: --- Attachment: HIVE-8900.1.patch > Create encryption testing framework > -

[jira] [Updated] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-10 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-9035: - Status: Patch Available (was: Open) > CBO: Disable PPD when functions are non-dete

[jira] [Updated] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-10 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-9035: - Attachment: HIVE-9035.patch > CBO: Disable PPD when functions are non-deterministic

[jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14241966#comment-14241966 ] Prasanth Jayachandran commented on HIVE-9067: - [~gopalv]/[~sershe] Can someone

[jira] [Created] (HIVE-9074) add ability to force direct sql usage for perf reasons

2014-12-10 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-9074: -- Summary: add ability to force direct sql usage for perf reasons Key: HIVE-9074 URL: https://issues.apache.org/jira/browse/HIVE-9074 Project: Hive Issue T

[jira] [Updated] (HIVE-9035) CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non-deterministic udf rand() pushed above join)

2014-12-10 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-9035: - Summary: CBO: Disable PPD when functions are non-deterministic (ppd_random.q - non

[jira] [Updated] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Priority: Minor (was: Major) > OrcFileMergeOperator may create merge file that does

[jira] [Updated] (HIVE-860) Persistent distributed cache

2014-12-10 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-860: -- Attachment: HIVE-860.4.patch > Persistent distributed cache > > >

[jira] [Updated] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Labels: Orc (was: ) > OrcFileMergeOperator may create merge file that does not match

[jira] [Updated] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Status: Patch Available (was: Open) > OrcFileMergeOperator may create merge file tha

[jira] [Updated] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Attachment: HIVE-9067.1.patch > OrcFileMergeOperator may create merge file that does

[jira] [Updated] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Summary: OrcFileMergeOperator may create merge file that does not match properties of

[jira] [Updated] (HIVE-9067) ORC stripe merge does not work properly when orc index is disabled

2014-12-10 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-9067: Description: OrcFileMergeOperator creates a new ORC file and appends the stripes from

  1   2   3   >