[jira] [Updated] (HIVE-9095) permanent functions' ClassLoader should be global instead of per-session

2014-12-12 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-9095: Description: FunctionRegistry.mFunctions is static. That means that in HS2 case, all users will share the sa

[jira] [Commented] (HIVE-9082) Update Accumulo storage handler to build against Accumulo 1.7

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245235#comment-14245235 ] Hive QA commented on HIVE-9082: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-9095) permanent functions' ClassLoader should be global instead of per-session

2014-12-12 Thread Nemon Lou (JIRA)
Nemon Lou created HIVE-9095: --- Summary: permanent functions' ClassLoader should be global instead of per-session Key: HIVE-9095 URL: https://issues.apache.org/jira/browse/HIVE-9095 Project: Hive Is

[jira] [Commented] (HIVE-7943) hive.security.authorization.createtable.owner.grants is ineffective with Default Authorization

2014-12-12 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245229#comment-14245229 ] Lefty Leverenz commented on HIVE-7943: -- bq. "A reference patch that could be used by

[jira] [Commented] (HIVE-9090) Rename "Tez File Merge Work" to smaller name

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245222#comment-14245222 ] Hive QA commented on HIVE-9090: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Updated] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8982: --- Attachment: HIVE-8982.2-spark.patch Regenerated some golden files. > IndexOutOfBounds exception in mapjoin [Spark Bran

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245217#comment-14245217 ] Chao commented on HIVE-8982: OK, let me try it. > IndexOutOfBounds exception in mapjoin [Spark

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.2-spark.patch) > Investigate IOContext object initialization problem [Spa

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.1-spark.patch) > Investigate IOContext object initialization problem [Spa

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: (was: HIVE-9084.2-spark.patch) > Investigate IOContext object initialization problem [Spa

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.2-spark.patch > Investigate IOContext object initialization problem [Spark Branch]

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245216#comment-14245216 ] Xuefu Zhang commented on HIVE-8982: --- [~csun], for some reason, I wasn't able to generate

[jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-12 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245204#comment-14245204 ] Prasanth Jayachandran commented on HIVE-9067: - Committed patch to trunk. Waitin

[jira] [Commented] (HIVE-9039) Support Union Distinct

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245203#comment-14245203 ] Pengcheng Xiong commented on HIVE-9039: --- [~jpullokkaran], could you please review the

Re: Review Request 28797: Support Union Distinct

2014-12-12 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28797/ --- (Updated Dec. 13, 2014, 4:55 a.m.) Review request for hive and John Pullokkaran

[jira] [Commented] (HIVE-9039) Support Union Distinct

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245199#comment-14245199 ] Hive QA commented on HIVE-9039: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-12 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245198#comment-14245198 ] Prasanth Jayachandran commented on HIVE-9067: - [~vikram.dixit] Can we have this

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245191#comment-14245191 ] Xuefu Zhang commented on HIVE-8982: --- That's good. +1 > IndexOutOfBounds exception in map

[jira] [Created] (HIVE-9094) join25.q fails because of timeout when trying get executor count from RSC [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9094: - Summary: join25.q fails because of timeout when trying get executor count from RSC [Spark Branch] Key: HIVE-9094 URL: https://issues.apache.org/jira/browse/HIVE-9094 Projec

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245181#comment-14245181 ] Chao commented on HIVE-8982: The "Status: Failed" messages for ppd_join4.q and smb_mapjoin_25.q

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245177#comment-14245177 ] Xuefu Zhang commented on HIVE-8982: --- Actually Chengxiang's patch (HIVE-9079) is to timeou

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245173#comment-14245173 ] Xuefu Zhang commented on HIVE-8982: --- join25.q failed because: {code} 2014-12-12 19:14:50,

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245169#comment-14245169 ] Chao commented on HIVE-8982: Not sure why {{join25.q}} failed - it runs OK on my machine. > In

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245164#comment-14245164 ] Hive QA commented on HIVE-8982: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8988) Support advanced aggregation in Hive to Calcite path

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245157#comment-14245157 ] Hive QA commented on HIVE-8988: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-7641) INSERT ... SELECT with no source table leads to NPE

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245156#comment-14245156 ] Hive QA commented on HIVE-7641: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9087) The move task does not handle properly in the case of loading data from the local file system path.

2014-12-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-9087: --- Attachment: HIVE-9087.1.patch > The move task does not handle properly in the case of loading data from

[jira] [Commented] (HIVE-9087) The move task does not handle properly in the case of loading data from the local file system path.

2014-12-12 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245152#comment-14245152 ] Ferdinand Xu commented on HIVE-9087: Yes, from the stack, we can see that hdfs has a ch

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245126#comment-14245126 ] Hive QA commented on HIVE-9078: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9067) OrcFileMergeOperator may create merge file that does not match properties of input files

2014-12-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245112#comment-14245112 ] Sergey Shelukhin commented on HIVE-9067: +1 > OrcFileMergeOperator may create merg

[jira] [Commented] (HIVE-7270) SerDe Properties are not considered by show create table Command

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245107#comment-14245107 ] Hive QA commented on HIVE-7270: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-12 Thread Ryan Blue
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/#review65004 --- I don't know why I didn't catch this earlier, but I'd also like to s

[jira] [Commented] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245083#comment-14245083 ] Hive QA commented on HIVE-9084: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8395) CBO: enable by default

2014-12-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-8395: --- Attachment: HIVE-8395.32.patch Merges recent changes; removes both fixes from the patch. Previo

[jira] [Commented] (HIVE-7351) ANALYZE TABLE statement fails on postgres metastore

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245065#comment-14245065 ] Hive QA commented on HIVE-7351: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Commented] (HIVE-8098) The spark golden file for union_remove_25 is different from MR version [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245056#comment-14245056 ] Xuefu Zhang commented on HIVE-8098: --- As of now, the difference is 6814 for spark vs 6812

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245051#comment-14245051 ] Marcelo Vanzin commented on HIVE-9017: -- In Spark-speak, "executor" is the JVM that exe

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245042#comment-14245042 ] Xuefu Zhang commented on HIVE-9017: --- Okay, I think we have difference in the term "execut

Re: Review Request 28889: HIVE-8911 - Enable mapjoin hints [Spark Branch]

2014-12-12 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28889/ --- (Updated Dec. 13, 2014, 12:24 a.m.) Review request for hive, Szehon Ho and Xuef

[jira] [Updated] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8911: --- Attachment: HIVE-8911.6-spark.patch Looks like the last patch didn't run again.. Addressed RB comments, and rebased to

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245029#comment-14245029 ] Marcelo Vanzin commented on HIVE-9017: -- I filed https://issues.apache.org/jira/browse/

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245020#comment-14245020 ] Xuefu Zhang commented on HIVE-9017: --- To clarify, when Spark lunched multiple executors in

Re: Review Request 28973: select constant in union all followed by group by gives wrong result

2014-12-12 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28973/ --- (Updated Dec. 13, 2014, 12:08 a.m.) Review request for hive, Ashutosh Chauhan a

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Attachment: (was: HIVE-9053.03.patch) > select constant in union all followed by group by giv

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Status: Open (was: Patch Available) > select constant in union all followed by group by gives wr

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Status: Patch Available (was: Open) > select constant in union all followed by group by gives wr

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Attachment: HIVE-9053.03.patch > select constant in union all followed by group by gives wrong re

[jira] [Updated] (HIVE-9053) select constant in union all followed by group by gives wrong result

2014-12-12 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9053: -- Attachment: HIVE-9053.03.patch address golden file diff > select constant in union all followed

[jira] [Updated] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-12 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated HIVE-8950: - Attachment: HIVE-8950.5.patch Addressed review comments. > Add support in ParquetHiveSerde

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-12 Thread Ashish Singh
> On Dec. 11, 2014, 2:41 a.m., Brock Noland wrote: > > This looks great!! I have a few comments below.. Thanks for the review. Addressed your comments. > On Dec. 11, 2014, 2:41 a.m., Brock Noland wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ParquetToHiveSchemaConverter.j

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-12-12 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/ --- (Updated Dec. 13, 2014, 12:03 a.m.) Review request for hive. Changes ---

[jira] [Reopened] (HIVE-8431) Enable smb_mapjoin_11.q and smb_mapjoin_12.q [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao reopened HIVE-8431: Assignee: Chao They are not actually - they can be re-enabled after HIVE-8640 is resolved. > Enable smb_mapjoin_11

[jira] [Resolved] (HIVE-8431) Enable smb_mapjoin_11.q and smb_mapjoin_12.q [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8431. --- Resolution: Fixed Fix Version/s: spark-branch >From testconfiguration.properties, these two test

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244992#comment-14244992 ] Marcelo Vanzin commented on HIVE-9017: -- See https://github.com/apache/spark/commit/7aa

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244990#comment-14244990 ] Marcelo Vanzin commented on HIVE-9017: -- You can't do that, because these files are mea

[jira] [Updated] (HIVE-9088) Spark counter serialization error in spark.log [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9088: -- Summary: Spark counter serialization error in spark.log [Spark Branch] (was: Spark counter serialization

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244987#comment-14244987 ] Xuefu Zhang commented on HIVE-9017: --- It seem the right way is to ask Spark to do the clea

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-12 Thread Laljo John Pullokkaran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244985#comment-14244985 ] Laljo John Pullokkaran commented on HIVE-8395: -- +1 > CBO: enable by default >

[jira] [Commented] (HIVE-7981) alias of compound aggregation functions fails in having clause

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244984#comment-14244984 ] Hive QA commented on HIVE-7981: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Review Request 28930: HIVE-8639 : Convert SMBJoin to MapJoin [Spark Branch]

2014-12-12 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28930/#review64988 --- The patch looks nice and clean. I'm wondering if bucke map join opti

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244951#comment-14244951 ] Marcelo Vanzin commented on HIVE-9017: -- Correct. All files written by spark will end u

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244948#comment-14244948 ] Marcelo Vanzin commented on HIVE-9017: -- P.S.: that solution will probably not work ver

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244949#comment-14244949 ] Brock Noland commented on HIVE-9017: bq. set spark.local.dir to that location This pro

[jira] [Commented] (HIVE-9017) Clean up temp files of RSC [Spark Branch]

2014-12-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244944#comment-14244944 ] Marcelo Vanzin commented on HIVE-9017: -- These files are created by Spark when download

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244942#comment-14244942 ] Brock Noland commented on HIVE-9078: I tried testing this patch and it looks like some

[jira] [Updated] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9081: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Jim

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244933#comment-14244933 ] Xuefu Zhang commented on HIVE-9081: --- +1 > Bucket mapjoin should use the new alias in pos

[jira] [Commented] (HIVE-8913) Make SparkMapJoinResolver handle runtime skew join [Spark Branch]

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244913#comment-14244913 ] Hive QA commented on HIVE-8913: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8395) CBO: enable by default

2014-12-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244912#comment-14244912 ] Sergey Shelukhin commented on HIVE-8395: Massive number of out files have been chan

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244909#comment-14244909 ] Hive QA commented on HIVE-7816: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244910#comment-14244910 ] Jimmy Xiang commented on HIVE-9081: --- I think it is ready. Thanks. > Bucket mapjoin shoul

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244907#comment-14244907 ] Xuefu Zhang commented on HIVE-9081: --- Is the patch ready or waiting for another test run?

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244899#comment-14244899 ] Xuefu Zhang commented on HIVE-9081: --- FYI: They are already updated. > Bucket mapjoin sho

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Description: SPARK-4567 is resolved. We can remove the wrappers we added to solve the serailization issu

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Status: Patch Available (was: Open) > Remove wrappers for SparkJobInfo and SparkStageInfo >

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244895#comment-14244895 ] Chao commented on HIVE-9081: Yes, they are caused by HIVE-9025. We need to update these golden

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244886#comment-14244886 ] Jimmy Xiang commented on HIVE-9081: --- Yes, I saw this failure too. For other tests, the go

[jira] [Commented] (HIVE-8357) Path type entities should use qualified path rather than string

2014-12-12 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244881#comment-14244881 ] Hive QA commented on HIVE-8357: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9081) Bucket mapjoin should use the new alias in posToAliasMap [Spark Branch]

2014-12-12 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244871#comment-14244871 ] Chao commented on HIVE-9081: {{multi_insert_lateral_view.q}} failed because of the same issue o

[jira] [Commented] (HIVE-9057) port HIVE-8295 to 0.13.1

2014-12-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244865#comment-14244865 ] Sergey Shelukhin commented on HIVE-9057: I don't think this JIRA is enough justific

[jira] [Resolved] (HIVE-9057) port HIVE-8295 to 0.13.1

2014-12-12 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HIVE-9057. Resolution: Won't Fix > port HIVE-8295 to 0.13.1 > > >

[jira] [Updated] (HIVE-8816) Create unit test join of two encrypted tables with different keys

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8816: --- Fix Version/s: encryption-branch > Create unit test join of two encrypted tables with different keys >

[jira] [Updated] (HIVE-8817) Create unit test where we insert into an encrypted table and then read from it with pig

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8817: --- Fix Version/s: encryption-branch > Create unit test where we insert into an encrypted table and then re

[jira] [Updated] (HIVE-8817) Create unit test where we insert into an encrypted table and then read from it with pig

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8817: --- Affects Version/s: encryption-branch > Create unit test where we insert into an encrypted table and the

[jira] [Updated] (HIVE-9093) Fix hadoop-1 after HIVE-8864

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9093: --- Resolution: Fixed Fix Version/s: encryption-branch Status: Resolved (was: Patch Avail

[jira] [Commented] (HIVE-8165) Annotation changes for replication

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244835#comment-14244835 ] Sushanth Sowmyan commented on HIVE-8165: (a) is now moot, given that HIVE-7974 is c

[jira] [Commented] (HIVE-9001) Ship with log4j.properties file that has a reliable time based rolling policy

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244831#comment-14244831 ] Sushanth Sowmyan commented on HIVE-9001: Thanks for the clarification! :) > Ship w

[jira] [Updated] (HIVE-9093) Fix hadoop-1 after HIVE-8864

2014-12-12 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9093: Description: Unused Hadoop-2 import crept in in HIVE-8864, missed it in that JIRA. NO PRECOMMIT TESTS was

[jira] [Updated] (HIVE-9093) Fix hadoop-1 after HIVE-8864

2014-12-12 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9093: Status: Patch Available (was: Open) [~brocknoland] sorry i missed this in previous patch. > Fix hadoop-1 af

[jira] [Created] (HIVE-9093) Fix hadoop-1 after HIVE-8864

2014-12-12 Thread Szehon Ho (JIRA)
Szehon Ho created HIVE-9093: --- Summary: Fix hadoop-1 after HIVE-8864 Key: HIVE-9093 URL: https://issues.apache.org/jira/browse/HIVE-9093 Project: Hive Issue Type: Sub-task Reporter: Szeh

[jira] [Updated] (HIVE-9093) Fix hadoop-1 after HIVE-8864

2014-12-12 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9093: Attachment: HIVE-9093.patch > Fix hadoop-1 after HIVE-8864 > > >

[jira] [Commented] (HIVE-7974) Notification Event Listener movement to a new top level repl/ module

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244816#comment-14244816 ] Sushanth Sowmyan commented on HIVE-7974: Okay, understandable. I'll close this as W

[jira] [Updated] (HIVE-7974) Notification Event Listener movement to a new top level repl/ module

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-7974: --- Resolution: Won't Fix Status: Resolved (was: Patch Available) > Notification Event Lis

[jira] [Commented] (HIVE-9057) port HIVE-8295 to 0.13.1

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244811#comment-14244811 ] Sushanth Sowmyan commented on HIVE-9057: Removing fix version tag of 0.13.1 from th

[jira] [Updated] (HIVE-9057) port HIVE-8295 to 0.13.1

2014-12-12 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9057: --- Fix Version/s: (was: 0.13.1) > port HIVE-8295 to 0.13.1 > > >

[jira] [Commented] (HIVE-8866) Vectorization on partitioned table throws ArrayIndexOutOfBoundsException when partitions are not of same #of columns

2014-12-12 Thread Matt McCline (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244799#comment-14244799 ] Matt McCline commented on HIVE-8866: [~vikram.dixit]] can you +1 approve to for 0.14.1

[jira] [Updated] (HIVE-8864) Fix permission inheritance with HDFS encryption

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8864: --- Resolution: Fixed Fix Version/s: encryption-branch Status: Resolved (was: Patch Avail

[jira] [Commented] (HIVE-8864) Fix permission inheritance with HDFS encryption

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14244795#comment-14244795 ] Brock Noland commented on HIVE-8864: +1 thank you Szehon! > Fix permission inheritanc

[jira] [Updated] (HIVE-8864) Fix permission inheritance with HDFS encryption

2014-12-12 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8864: Affects Version/s: encryption-branch > Fix permission inheritance with HDFS encryption >

[jira] [Assigned] (HIVE-9091) Add additional unit tests for HiveSQLException

2014-12-12 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland reassigned HIVE-9091: -- Assignee: Brock Noland > Add additional unit tests for HiveSQLException > --

  1   2   3   >