Review Request 30208: HIVE-9449 Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]

2015-01-22 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30208/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-9449 https://issues.apa

[jira] [Updated] (HIVE-9449) Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9449: Attachment: HIVE-9449.1-spark.patch > Push YARN configuration to Spark while deply Spark on YARN[Spar

[jira] [Updated] (HIVE-9449) Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9449: Status: Patch Available (was: Open) > Push YARN configuration to Spark while deply Spark on YARN[Spa

[jira] [Created] (HIVE-9449) Push YARN configuration to Spark while deply Spark on YARN[Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-9449: --- Summary: Push YARN configuration to Spark while deply Spark on YARN[Spark Branch] Key: HIVE-9449 URL: https://issues.apache.org/jira/browse/HIVE-9449 Project: Hive

[jira] [Commented] (HIVE-9434) Shim the method Path.getPathWithoutSchemeAndAuthority

2015-01-22 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288918#comment-14288918 ] Dong Chen commented on HIVE-9434: - Failed tests seem not related. > Shim the method Path.g

[jira] [Updated] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated HIVE-9410: -- Description: We have a hive query case with UDF defined (i.e. BigBench case Q10, Q18 etc.). It will be p

[jira] [Commented] (HIVE-9327) CBO (Calcite Return Path): Removing Row Resolvers from ParseContext

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288911#comment-14288911 ] Hive QA commented on HIVE-9327: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Creating a branch for hbase metastore work

2015-01-22 Thread Nick Dimiduk
+1 On Thursday, January 22, 2015, Brock Noland wrote: > +1 > > On Thu, Jan 22, 2015 at 8:19 PM, Alan Gates > wrote: > > I've been working on a prototype of using HBase to store Hive's metadata. > > Basically I've built a new implementation of RawStore that writes to > HBase > > rather than Data

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/ --- (Updated Jan. 23, 2015, 6:44 a.m.) Review request for hive and Xuefu Zhang. B

[jira] [Updated] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9410: Attachment: (was: HIVE-9410.4-spark.patch) > ClassNotFoundException occurs during hive query case

[jira] [Updated] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9410: Attachment: HIVE-9410.4-spark.patch > ClassNotFoundException occurs during hive query case execution

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/#review69357 --- Ship it! Ship It! - Xuefu Zhang On Jan. 23, 2015, 6:37 a.m., che

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288864#comment-14288864 ] Xuefu Zhang commented on HIVE-9410: --- +1 > ClassNotFoundException occurs during hive quer

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/ --- (Updated Jan. 23, 2015, 6:37 a.m.) Review request for hive and Xuefu Zhang. C

[jira] [Updated] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-9410: Attachment: HIVE-9410.4-spark.patch > ClassNotFoundException occurs during hive query case execution

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288855#comment-14288855 ] Xuefu Zhang commented on HIVE-9410: --- Yes. We need to resolve this w/o SPARK-5377. Please

[jira] [Updated] (HIVE-9441) Remove call to deprecated Calcite method

2015-01-22 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9441: --- Assignee: Julian Hyde (was: Ashutosh Chauhan) > Remove call to deprecated Calcite method > ---

[jira] [Updated] (HIVE-9441) Remove call to deprecated Calcite method

2015-01-22 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-9441: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available) Than

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288848#comment-14288848 ] Chengxiang Li commented on HIVE-9410: - As ser/deser between Hive driver and remote spar

Re: Created branch 1.0

2015-01-22 Thread Brock Noland
Hi Alan, I agree with Xuefu and what was suggested in your statement. I was thinking we'd release the next release as 0.15 and then later there would be 1.0 off trunk (e.g. what would have been 0.16) and thus be superset (minus anything we intentionally remove). As I have said several times, I'd

[jira] [Commented] (HIVE-9431) CBO (Calcite Return Path): Removing AST from ParseContext

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288826#comment-14288826 ] Hive QA commented on HIVE-9431: --- {color:red}Overall{color}: -1 at least one tests failed H

Re: Creating a branch for hbase metastore work

2015-01-22 Thread Brock Noland
+1 On Thu, Jan 22, 2015 at 8:19 PM, Alan Gates wrote: > I've been working on a prototype of using HBase to store Hive's metadata. > Basically I've built a new implementation of RawStore that writes to HBase > rather than DataNucleus. I want to see if I can build something that has a > much more

[jira] [Commented] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288800#comment-14288800 ] Thejas M Nair commented on HIVE-9436: - [~hsubramaniyan] that is a good point regarding

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288797#comment-14288797 ] Chengxiang Li commented on HIVE-9410: - Yes, Spark would address this issue more properl

Re: Review Request 29800: Apply ColumnPrunning for noop PTFs

2015-01-22 Thread Navis Ryu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29800/ --- (Updated Jan. 23, 2015, 5:41 a.m.) Review request for hive. Changes ---

[jira] [Updated] (HIVE-9228) Problem with subquery using windowing functions

2015-01-22 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9228: Status: Patch Available (was: Open) > Problem with subquery using windowing functions >

[jira] [Updated] (HIVE-9228) Problem with subquery using windowing functions

2015-01-22 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-9228: Attachment: HIVE-9228.1.patch.txt CP problem > Problem with subquery using windowing functions > ---

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288763#comment-14288763 ] Xuefu Zhang commented on HIVE-9410: --- Also, comments in the critical code section would he

[jira] [Commented] (HIVE-9020) When dropping external tables, Hive should not verify whether user has access to the data.

2015-01-22 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288752#comment-14288752 ] Thejas M Nair commented on HIVE-9020: - Will you be able to also include a unit test for

[jira] [Commented] (HIVE-9020) When dropping external tables, Hive should not verify whether user has access to the data.

2015-01-22 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288750#comment-14288750 ] Thejas M Nair commented on HIVE-9020: - [~nntnag17] Thanks for reporting the issue and s

[jira] [Commented] (HIVE-9443) ORC PPD - fix fuzzy case evaluation of IS_NULL

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288731#comment-14288731 ] Hive QA commented on HIVE-9443: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288708#comment-14288708 ] Xuefu Zhang commented on HIVE-9410: --- Also, can we enhance ./ql/src/test/queries/clientpos

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288707#comment-14288707 ] Xuefu Zhang commented on HIVE-9410: --- I think this makes sense. [~chengxiang li], could yo

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/#review69344 --- ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

[jira] [Commented] (HIVE-9370) SparkJobMonitor timeout as sortByKey would launch extra Spark job before original job get submitted [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288698#comment-14288698 ] Xuefu Zhang commented on HIVE-9370: --- I think asking user to log out and log in again woul

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/#review69341 --- ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
> On 一月 23, 2015, 3:02 a.m., chengxiang li wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java, line 371 > > > > > > #3 this would be executed in akka thread, get extra jar path from > > JobConf, and

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
> On Jan. 23, 2015, 3:02 a.m., chengxiang li wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java, line 371 > > > > > > #3 this would be executed in akka thread, get extra jar path from > > JobConf, an

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
> On Jan. 23, 2015, 2:05 a.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java, > > line 220 > > > > > > So, this is the code that adds the jars to the classpath of t

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
> On 一月 23, 2015, 2:05 a.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java, > > line 220 > > > > > > So, this is the code that adds the jars to the classpath of the

[jira] [Updated] (HIVE-6617) Reduce ambiguity in grammar

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-6617: -- Status: Patch Available (was: Open) > Reduce ambiguity in grammar > ---

[jira] [Updated] (HIVE-6617) Reduce ambiguity in grammar

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-6617: -- Attachment: HIVE-6617.07.patch add back some key words (e.g., default) which is reserved in SQL 1

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288680#comment-14288680 ] Rui Li commented on HIVE-9410: -- Shall we ask spark for an API to add jar to driver's classpath

[jira] [Commented] (HIVE-9370) SparkJobMonitor timeout as sortByKey would launch extra Spark job before original job get submitted [Spark Branch]

2015-01-22 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288684#comment-14288684 ] Chengxiang Li commented on HIVE-9370: - RSC have timeout in netty level, so if remote sp

[jira] [Updated] (HIVE-6617) Reduce ambiguity in grammar

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-6617: -- Status: Open (was: Patch Available) > Reduce ambiguity in grammar > ---

[jira] [Commented] (HIVE-9434) Shim the method Path.getPathWithoutSchemeAndAuthority

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288671#comment-14288671 ] Hive QA commented on HIVE-9434: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9425) External Function Jar files are not available for Driver when running with yarn-cluster mode [Spark Branch]

2015-01-22 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288666#comment-14288666 ] Xin Hao commented on HIVE-9425: --- Double checked with Big-Bench Q1 case (includes the hql ‘ADD

Creating a branch for hbase metastore work

2015-01-22 Thread Alan Gates
I've been working on a prototype of using HBase to store Hive's metadata. Basically I've built a new implementation of RawStore that writes to HBase rather than DataNucleus. I want to see if I can build something that has a much more straightforward schema than DN and that is much faster. I

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/#review69336 --- ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread chengxiang li
> On 一月 23, 2015, 2:05 a.m., Xuefu Zhang wrote: > > I'm wondering what's the story for Hive CLI. Hive CLI can add jars from > > local file system. Would this work for Hive on Spark? Hive CLI add jars to classpath dynamically same as this patch does for RemoteDriver, update thread context class

[jira] [Commented] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288623#comment-14288623 ] Sushanth Sowmyan commented on HIVE-9436: Hari, good point - I had a look at Retryin

[jira] [Commented] (HIVE-9428) LocalSparkJobStatus may return failed job as successful [Spark Branch]

2015-01-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288619#comment-14288619 ] Rui Li commented on HIVE-9428: -- And some examples when we need to check the future instead of

[jira] [Commented] (HIVE-9152) Dynamic Partition Pruning [Spark Branch]

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288622#comment-14288622 ] Hive QA commented on HIVE-9152: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9436: --- Attachment: HIVE-9436.2.patch Updated patch to multi-line match > RetryingMetaStoreClient does

[jira] [Updated] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9436: --- Status: Patch Available (was: Open) > RetryingMetaStoreClient does not retry JDOExceptions > -

[jira] [Commented] (HIVE-9428) LocalSparkJobStatus may return failed job as successful [Spark Branch]

2015-01-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288605#comment-14288605 ] Rui Li commented on HIVE-9428: -- [~xuefuz] - thanks for the review! 1. We have to check Future.

Re: Review Request 30107: HIVE-9410, ClassNotFoundException occurs during hive query case execution with UDF defined[Spark Branch]

2015-01-22 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30107/#review69329 --- I'm wondering what's the story for Hive CLI. Hive CLI can add jars f

[jira] [Commented] (HIVE-9253) MetaStore server should support timeout for long running requests

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288583#comment-14288583 ] Hive QA commented on HIVE-9253: --- {color:green}Overall{color}: +1 all checks pass Here are

[jira] [Updated] (HIVE-9447) Metastore: inefficient Oracle query for removing unused column descriptors when add/drop table/partition

2015-01-22 Thread Selina Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Selina Zhang updated HIVE-9447: --- Affects Version/s: 0.14.0 Status: Patch Available (was: In Progress) > Metastore: ineff

[jira] [Updated] (HIVE-9447) Metastore: inefficient Oracle query for removing unused column descriptors when add/drop table/partition

2015-01-22 Thread Selina Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Selina Zhang updated HIVE-9447: --- Attachment: HIVE-9447.1.patch > Metastore: inefficient Oracle query for removing unused column descript

[jira] [Work started] (HIVE-9447) Metastore: inefficient Oracle query for removing unused column descriptors when add/drop table/partition

2015-01-22 Thread Selina Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-9447 started by Selina Zhang. -- > Metastore: inefficient Oracle query for removing unused column descriptors > when a

[jira] [Updated] (HIVE-9448) Merge spark to trunk 1/23/15

2015-01-22 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9448: Status: Patch Available (was: Open) > Merge spark to trunk 1/23/15 > > >

[jira] [Updated] (HIVE-9448) Merge spark to trunk 1/23/15

2015-01-22 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9448: Attachment: HIVE-9448.patch > Merge spark to trunk 1/23/15 > > >

[jira] [Commented] (HIVE-9410) ClassNotFoundException occurs during hive query case execution with UDF defined [Spark Branch]

2015-01-22 Thread Xin Hao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288554#comment-14288554 ] Xin Hao commented on HIVE-9410: --- Chengxiang, I used patch HIVE-9410.3-spark.patch to validate

[jira] [Created] (HIVE-9448) Merge spark to trunk 1/23/15

2015-01-22 Thread Szehon Ho (JIRA)
Szehon Ho created HIVE-9448: --- Summary: Merge spark to trunk 1/23/15 Key: HIVE-9448 URL: https://issues.apache.org/jira/browse/HIVE-9448 Project: Hive Issue Type: Bug Components: Spark

[jira] [Commented] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288534#comment-14288534 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-9436: - A minor

[jira] [Updated] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9378: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks, Jim

[jira] [Commented] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288524#comment-14288524 ] Hive QA commented on HIVE-9378: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-6970) HCatInputFormat in hive-hcatalog-core 0.13 does not compatible with hadoop2

2015-01-22 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-6970: Assignee: (was: Navis) > HCatInputFormat in hive-hcatalog-core 0.13 does not compatible with hadoop2 > --

[jira] [Created] (HIVE-9447) Metastore: inefficient Oracle query for removing unused column descriptors when add/drop table/partition

2015-01-22 Thread Selina Zhang (JIRA)
Selina Zhang created HIVE-9447: -- Summary: Metastore: inefficient Oracle query for removing unused column descriptors when add/drop table/partition Key: HIVE-9447 URL: https://issues.apache.org/jira/browse/HIVE-9447

[jira] [Updated] (HIVE-9152) Dynamic Partition Pruning [Spark Branch]

2015-01-22 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-9152: --- Attachment: HIVE-9152.1-spark.patch > Dynamic Partition Pruning [Spark Branch] > --

[jira] [Commented] (HIVE-9441) Remove call to deprecated Calcite method

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288492#comment-14288492 ] Hive QA commented on HIVE-9441: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9436) RetryingMetaStoreClient does not retry JDOExceptions

2015-01-22 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-9436: --- Status: Open (was: Patch Available) Canceling patch to update one more thing - this needs to b

Re: Created branch 1.0

2015-01-22 Thread Thejas Nair
On Thu, Jan 22, 2015 at 2:49 PM, Edward Capriolo wrote: > If we do a 1.0.0 release there is no problem with us later releasing 14.1 > or a 14.2. I think everyone would understand that the 14.2 being released > after 1.0.0 would likely have back ported features. Releasing a 15.0 after > 1.0 would n

[jira] [Updated] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-01-22 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-9378: -- Attachment: HIVE-9378.4-spark.patch Right. Attached v4 that's rebased to Spark latest. > Spark qfile tes

Re: Created branch 1.0

2015-01-22 Thread Thejas Nair
On Thu, Jan 22, 2015 at 12:31 PM, Xuefu Zhang wrote: > Hi Thejas/Alan, > > From all the argument, I think there was an assumption that the proposed > 1.0 release will be imminent and 0.15 will happen far after that. Based on > that assumption, 0.15 will become 1.1, which is greater in scope than 1

[jira] [Commented] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-01-22 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288393#comment-14288393 ] Xuefu Zhang commented on HIVE-9378: --- Looks like the patch needs to be rebased. > Spark q

[jira] [Commented] (HIVE-9392) JoinStatsRule miscalculates join cardinality as incorrect NDV is used due to column names having duplicated fqColumnName

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288383#comment-14288383 ] Hive QA commented on HIVE-9392: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9416) Get rid of Extract Operator

2015-01-22 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9416: --- Status: Patch Available (was: Open) > Get rid of Extract Operator > --

[jira] [Updated] (HIVE-9416) Get rid of Extract Operator

2015-01-22 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9416: --- Attachment: HIVE-9416.2.patch Fixed optimizers except SortedDynPartitionOptimizer. > Get rid o

[jira] [Updated] (HIVE-9416) Get rid of Extract Operator

2015-01-22 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-9416: --- Status: Open (was: Patch Available) > Get rid of Extract Operator > --

[jira] [Commented] (HIVE-9208) MetaStore DB schema inconsistent for MS SQL Server in use of varchar/nvarchar

2015-01-22 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288370#comment-14288370 ] Eugene Koifman commented on HIVE-9208: -- I was asking if you are sure those fields repr

Re: Created branch 1.0

2015-01-22 Thread Edward Capriolo
If we do a 1.0.0 release there is no problem with us later releasing 14.1 or a 14.2. I think everyone would understand that the 14.2 being released after 1.0.0 would likely have back ported features. Releasing a 15.0 after 1.0 would not make as much sense as we probably do not want two active branc

[jira] [Commented] (HIVE-9378) Spark qfile tests should reuse RSC [Spark Branch]

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288364#comment-14288364 ] Hive QA commented on HIVE-9378: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9434) Shim the method Path.getPathWithoutSchemeAndAuthority

2015-01-22 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288356#comment-14288356 ] Brock Noland commented on HIVE-9434: +1 > Shim the method Path.getPathWithoutSchemeAnd

[jira] [Updated] (HIVE-9327) CBO (Calcite Return Path): Removing Row Resolvers from ParseContext

2015-01-22 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-9327: -- Attachment: HIVE-9327.05.patch New patch with updated golden files. > CBO (Calci

[jira] [Updated] (HIVE-9327) CBO (Calcite Return Path): Removing Row Resolvers from ParseContext

2015-01-22 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-9327: -- Status: Patch Available (was: Open) > CBO (Calcite Return Path): Removing Row Re

[jira] [Updated] (HIVE-9327) CBO (Calcite Return Path): Removing Row Resolvers from ParseContext

2015-01-22 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-9327: -- Status: Open (was: Patch Available) > CBO (Calcite Return Path): Removing Row Re

[jira] [Updated] (HIVE-9327) CBO (Calcite Return Path): Removing Row Resolvers from ParseContext

2015-01-22 Thread Jesus Camacho Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesus Camacho Rodriguez updated HIVE-9327: -- Attachment: (was: HIVE-9327.05.patch) > CBO (Calcite Return Path): Removing R

[jira] [Updated] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2015-01-22 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-9026: Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HIVE-9446) JDBC DatabaseMetadata.getColumns() does not work for temporary tables

2015-01-22 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288286#comment-14288286 ] Thejas M Nair commented on HIVE-9446: - +1 > JDBC DatabaseMetadata.getColumns() does no

[jira] [Commented] (HIVE-9208) MetaStore DB schema inconsistent for MS SQL Server in use of varchar/nvarchar

2015-01-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288275#comment-14288275 ] Xiaobing Zhou commented on HIVE-9208: - They are partition name with multi-bytes support

[jira] [Commented] (HIVE-9208) MetaStore DB schema inconsistent for MS SQL Server in use of varchar/nvarchar

2015-01-22 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288271#comment-14288271 ] Xiaobing Zhou commented on HIVE-9208: - I don't think we need to change length, right?

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288257#comment-14288257 ] Hive QA commented on HIVE-9026: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-9416) Get rid of Extract Operator

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288252#comment-14288252 ] Hive QA commented on HIVE-9416: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-9271) Add ability for client to request metastore to fire an event

2015-01-22 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14288250#comment-14288250 ] Hive QA commented on HIVE-9271: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Attachment: HIVE-9039.20.patch address [~jpullokkaran]'s comments > Support Union Distinct > ---

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Status: Patch Available (was: Open) > Support Union Distinct > -- > >

[jira] [Updated] (HIVE-9039) Support Union Distinct

2015-01-22 Thread Pengcheng Xiong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pengcheng Xiong updated HIVE-9039: -- Status: Open (was: Patch Available) > Support Union Distinct > -- > >

Re: Review Request 28797: Support Union Distinct

2015-01-22 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28797/ --- (Updated Jan. 22, 2015, 9:16 p.m.) Review request for hive and John Pullokkaran

  1   2   >