[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224170#comment-14224170 ] Szehon Ho commented on HIVE-8836: - Thanks for the details, Chengxiang. > Enable automatic

[jira] [Commented] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224148#comment-14224148 ] Hive QA commented on HIVE-8946: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-8958) Make sure map join tasks created by runtime skew join can fit into memory [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
Rui Li created HIVE-8958: Summary: Make sure map join tasks created by runtime skew join can fit into memory [Spark Branch] Key: HIVE-8958 URL: https://issues.apache.org/jira/browse/HIVE-8958 Project: Hive

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224124#comment-14224124 ] Chengxiang Li commented on HIVE-8836: - Hi, [~szehon] and [~brocknoland] I'm not 100% pe

Out of commission (temporarily)

2014-11-24 Thread Lefty Leverenz
My laptop broke last week and I haven't been able to check email or Jiras. Now I'm using an iPad with limited gmail functionality (and no access to my reference files). So I'm not going to be very useful until I fix the laptop or buy a replacement. You might see a bit of activity from me but I'm

[jira] [Commented] (HIVE-8536) Enable SkewJoinResolver for spark [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224122#comment-14224122 ] Rui Li commented on HIVE-8536: -- Hi [~szehon], {{skewjoin_noskew}} failed to run because our r

[jira] [Commented] (HIVE-8848) data loading from text files or text file processing doesn't handle nulls correctly

2014-11-24 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224115#comment-14224115 ] Navis commented on HIVE-8848: - cbo test files provided 'null' rather than null. Updated result

[jira] [Updated] (HIVE-8848) data loading from text files or text file processing doesn't handle nulls correctly

2014-11-24 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated HIVE-8848: Attachment: HIVE-8848.3.patch.txt Updated results & Added more null handling for lazy array, map, structs and subcla

[jira] [Commented] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224113#comment-14224113 ] Hive QA commented on HIVE-8855: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Assigned] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution[Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8956: Assignee: Rui Li > Hive hangs while some error/exception happens beyond job execution[Spark > Branch] > ---

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224100#comment-14224100 ] Brock Noland commented on HIVE-8836: bq. Spark assembly dependency can be fetched from

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224098#comment-14224098 ] Szehon Ho commented on HIVE-8836: - bq. Spark assembly dependency can be fetched from public

[jira] [Commented] (HIVE-8828) Remove hadoop 20 shims

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224096#comment-14224096 ] Hive QA commented on HIVE-8828: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224079#comment-14224079 ] Chengxiang Li commented on HIVE-8951: - Add log4j.properties into remote spark context c

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224065#comment-14224065 ] Chengxiang Li commented on HIVE-8836: - The join0.q output diff should because of HIVE-8

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8836: Attachment: HIVE-8836.2-spark.patch Hi, [~brocknoland], thanks for working on this. I've verified tha

[jira] [Comment Edited] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224055#comment-14224055 ] Brock Noland edited comment on HIVE-8936 at 11/25/14 4:53 AM: --

[jira] [Updated] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8936: --- Attachment: HIVE-8936.3.patch Re-uploading the patch for trunk. PTest does not support uploading patche

[jira] [Commented] (HIVE-8834) enable job progress monitoring of Remote Spark Context [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224045#comment-14224045 ] Rui Li commented on HIVE-8834: -- Thanks guys for the review! > enable job progress monitoring

[jira] [Updated] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8946: --- Attachment: HIVE-8946.2-spark.patch > Enable Map Join [Spark Branch] > -- > >

[jira] [Updated] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8946: --- Attachment: (was: HIVE-8946.2-spark.patch) > Enable Map Join [Spark Branch] > -- > >

[jira] [Updated] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8946: --- Attachment: HIVE-8946.2-spark.patch > Enable Map Join [Spark Branch] > -- > >

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836-brock-3.patch Sorry, I added {{.gitignore}} change which is required as well. No

[jira] [Commented] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224037#comment-14224037 ] Xuefu Zhang commented on HIVE-8855: --- +1 pending on test. > Automatic calculate reduce nu

[jira] [Updated] (HIVE-8834) enable job progress monitoring of Remote Spark Context [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8834: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-8834) enable job progress monitoring of Remote Spark Context [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224033#comment-14224033 ] Xuefu Zhang commented on HIVE-8834: --- +1. Thanks to Marcelo for the review. > enable job

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836-brock-2.patch Actually I see the changes to {{HiveSparkClientFactory.java}} were

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224029#comment-14224029 ] Xuefu Zhang commented on HIVE-8951: --- Hi [~vanzin], yes, I created HIVE-8957 to track that

[jira] [Commented] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224026#comment-14224026 ] Hive QA commented on HIVE-8946: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-8834) enable job progress monitoring of Remote Spark Context [Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224024#comment-14224024 ] Hive QA commented on HIVE-8834: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224022#comment-14224022 ] Marcelo Vanzin commented on HIVE-8951: -- Xuefu, increasing the timeout should be fine,

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836-brock-1.patch Here is an alternative. The build downloads a spark tar and *caches

Re: Review Request 28422: HIVE-8855 Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28422/#review62935 --- Ship it! Ship It! - Xuefu Zhang On Nov. 25, 2014, 3:39 a.m., Jim

[jira] [Commented] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224000#comment-14224000 ] Jimmy Xiang commented on HIVE-8855: --- Attached v2 that addressed Xuefu's review comment.

Re: Review Request 28422: HIVE-8855 Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28422/ --- (Updated Nov. 25, 2014, 3:39 a.m.) Review request for hive and Xuefu Zhang. C

[jira] [Updated] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8855: -- Attachment: HIVE-8855.2-spark.patch > Automatic calculate reduce number for spark job[Spark Branch] > ---

[jira] [Commented] (HIVE-8192) Check DDL's writetype in DummyTxnManager

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223995#comment-14223995 ] Hive QA commented on HIVE-8192: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Created] (HIVE-8957) Remote spark context needs to clean up itself in case of connection timeout [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-8957: - Summary: Remote spark context needs to clean up itself in case of connection timeout [Spark Branch] Key: HIVE-8957 URL: https://issues.apache.org/jira/browse/HIVE-8957 Proj

[jira] [Updated] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8951: -- Status: Patch Available (was: Open) > Spark remote context doesn't work with local-cluster [Spark Branch

[jira] [Updated] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8951: -- Attachment: HIVE-8951.1-spark.patch > Spark remote context doesn't work with local-cluster [Spark Branch]

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223984#comment-14223984 ] Xuefu Zhang commented on HIVE-8951: --- Increasing the default time out to 1 min seems solvi

[jira] [Assigned] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8951: - Assignee: Xuefu Zhang > Spark remote context doesn't work with local-cluster [Spark Branch] >

[jira] [Updated] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8946: --- Assignee: Chao Status: Patch Available (was: Open) > Enable Map Join [Spark Branch] > --

[jira] [Updated] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8946: --- Attachment: HIVE-8946.1-spark.patch > Enable Map Join [Spark Branch] > -- > >

[jira] [Created] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution[Spark Branch]

2014-11-24 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8956: --- Summary: Hive hangs while some error/exception happens beyond job execution[Spark Branch] Key: HIVE-8956 URL: https://issues.apache.org/jira/browse/HIVE-8956 Project: H

[jira] [Commented] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223980#comment-14223980 ] Hive QA commented on HIVE-8855: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8946) Enable Map Join [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223966#comment-14223966 ] Xuefu Zhang commented on HIVE-8946: --- [~csun], given that HIVE-8936 is fixed in Spark bran

[jira] [Commented] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223964#comment-14223964 ] Xuefu Zhang commented on HIVE-8936: --- Patch HIVE-8936.4-spark.patch committed to Spark bra

[jira] [Updated] (HIVE-8834) enable job progress monitoring of Remote Spark Context [Spark Branch]

2014-11-24 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8834: - Attachment: HIVE-8834.6-spark.patch Address RB comments. Thanks [~vanzin] for the review! > enable job progress mo

[jira] [Updated] (HIVE-7924) auto_sortmerge_join_8 sometimes fails with OOM

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7924: --- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-8895) bugs in mergejoin

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223926#comment-14223926 ] Ashutosh Chauhan commented on HIVE-8895: +1 > bugs in mergejoin >

[jira] [Commented] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223921#comment-14223921 ] Hive QA commented on HIVE-8936: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8848) data loading from text files or text file processing doesn't handle nulls correctly

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223891#comment-14223891 ] Ashutosh Chauhan commented on HIVE-8848: Test output for many queries changed. Not

[jira] [Updated] (HIVE-8848) data loading from text files or text file processing doesn't handle nulls correctly

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8848: --- Status: Open (was: Patch Available) > data loading from text files or text file processing doe

[jira] [Updated] (HIVE-8923) HIVE-8512 needs to be fixed also for CBO

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8923: --- Status: Open (was: Patch Available) Test failures look legit. Needs to be looked at. > HIVE-8

[jira] [Updated] (HIVE-8922) CBO: assorted date and timestamp issues

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8922: --- Status: Open (was: Patch Available) Patch needs a rebase. > CBO: assorted date and timestamp

Re: Review Request 28422: HIVE-8855 Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang
> On Nov. 25, 2014, 1:08 a.m., Xuefu Zhang wrote: > > ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkClient.java, > > line 92 > > > > > > Could we add an interface at SparkClient and call that directly

Re: Review Request 28422: HIVE-8855 Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28422/#review62913 --- ql/src/java/org/apache/hadoop/hive/ql/exec/spark/RemoteHiveSparkCli

Hive-0.14 - Build # 746 - Still Failing

2014-11-24 Thread Apache Jenkins Server
Changes for Build #696 [rohini] PIG-4186: Fix e2e run against new build of pig and some enhancements (rohini) Changes for Build #697 Changes for Build #698 Changes for Build #699 Changes for Build #700 Changes for Build #701 Changes for Build #702 Changes for Build #703 [daijy] HIVE-8484:

[jira] [Commented] (HIVE-7073) Implement Binary in ParquetSerDe

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223852#comment-14223852 ] Hive QA commented on HIVE-7073: --- {color:green}Overall{color}: +1 all checks pass Here are

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-24 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/#review62911 --- ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ColInfoFro

[jira] [Updated] (HIVE-6421) abs() should preserve precision/scale of decimal input

2014-11-24 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-6421: - Attachment: HIVE-6421.3.patch Fix test failures > abs() should preserve precision/scale of decimal input >

[jira] [Updated] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8855: -- Fix Version/s: spark-branch Status: Patch Available (was: Open) > Automatic calculate reduce

[jira] [Updated] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8855: -- Attachment: HIVE-8855.1-spark.patch Patch v1: https://reviews.apache.org/r/28422/ > Automatic calculate

[jira] [Updated] (HIVE-8784) Querying partition does not work with JDO enabled against PostgreSQL

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8784: Affects Version/s: (was: 0.15.0) 0.14.1 Fix Version/s: (was: 0.15.0)

Review Request 28422: HIVE-8855 Automatic calculate reduce number for spark job[Spark Branch]

2014-11-24 Thread Jimmy Xiang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28422/ --- Review request for hive and Xuefu Zhang. Bugs: HIVE-8855 https://issues.apa

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223797#comment-14223797 ] Pankit Thapar commented on HIVE-8955: - if I insert overwrite into an already existing p

[jira] [Commented] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223796#comment-14223796 ] Szehon Ho commented on HIVE-4766: - Great thanks Chaoyu for the changes. +1 pending tests f

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223791#comment-14223791 ] Ashutosh Chauhan commented on HIVE-8955: Is there a specific query where you are no

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223788#comment-14223788 ] Szehon Ho commented on HIVE-8955: - I see, feel free to submit a patch if you have a test ca

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223782#comment-14223782 ] Pankit Thapar commented on HIVE-8955: - [~ashutoshc] , can you please confirm if this is

[jira] [Updated] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8936: --- Attachment: HIVE-8936.4-spark.patch > Add SORT_QUERY_RESULTS for join tests that do not guarantee order > -

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223778#comment-14223778 ] Pankit Thapar commented on HIVE-8955: - Yes you are correct that the stats are updated i

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223776#comment-14223776 ] Xuefu Zhang commented on HIVE-8951: --- One side-effect of the timeout is that the remote sp

[jira] [Commented] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223758#comment-14223758 ] Hive QA commented on HIVE-8936: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223745#comment-14223745 ] Szehon Ho commented on HIVE-8955: - I meant the stats do seem to be updated in [here|https:

[jira] [Commented] (HIVE-7751) Mapjoin set in a non-conditional task can fail in MR mode because of memory overhead issues

2014-11-24 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223741#comment-14223741 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-7751: - Revisiti

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223736#comment-14223736 ] Xuefu Zhang commented on HIVE-8951: --- FYI, I increased the connection timeout by 10x and i

Re: Review Request 27895: Remove Hadoop 20 shims

2014-11-24 Thread Ashutosh Chauhan
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27895/ --- (Updated Nov. 24, 2014, 11:05 p.m.) Review request for hive and Thejas Nair.

[jira] [Updated] (HIVE-8828) Remove hadoop 20 shims

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8828: --- Status: Open (was: Patch Available) > Remove hadoop 20 shims > -- > >

[jira] [Updated] (HIVE-8828) Remove hadoop 20 shims

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8828: --- Attachment: HIVE-8828.8.patch > Remove hadoop 20 shims > -- > >

[jira] [Updated] (HIVE-8828) Remove hadoop 20 shims

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8828: --- Status: Patch Available (was: Open) > Remove hadoop 20 shims > -- > >

Hive-0.14 - Build # 745 - Still Failing

2014-11-24 Thread Apache Jenkins Server
Changes for Build #696 [rohini] PIG-4186: Fix e2e run against new build of pig and some enhancements (rohini) Changes for Build #697 Changes for Build #698 Changes for Build #699 Changes for Build #700 Changes for Build #701 Changes for Build #702 Changes for Build #703 [daijy] HIVE-8484:

[jira] [Comment Edited] (HIVE-8609) Move beeline to jline2

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223706#comment-14223706 ] Brock Noland edited comment on HIVE-8609 at 11/24/14 10:58 PM: --

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Pankit Thapar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223712#comment-14223712 ] Pankit Thapar commented on HIVE-8955: - Thanks for a quick glance [~szehon]. As far as I

[jira] [Commented] (HIVE-8706) Table statistic collection on counter failed due to table name character case.

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223708#comment-14223708 ] Ashutosh Chauhan commented on HIVE-8706: committed to 0.14 > Table statistic colle

[jira] [Commented] (HIVE-8609) Move beeline to jline2

2014-11-24 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223706#comment-14223706 ] Brock Noland commented on HIVE-8609: [~leftymi...@yahoo.com] an alternative to deleting

[jira] [Updated] (HIVE-8706) Table statistic collection on counter failed due to table name character case.

2014-11-24 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8706: --- Fix Version/s: 0.14.1 > Table statistic collection on counter failed due to table name characte

[jira] [Updated] (HIVE-8889) JDBC Driver ResultSet.getXXXXXX(String columnLabel) methods Broken

2014-11-24 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-8889: -- Attachment: HIVE-8889.1.patch Thanks, [~brocknoland]. I have revised the patch based on your review comme

Re: Review Request 28403: HIVE-8889:JDBC Driver ResultSet.getXXXXXX(String columnLabel) methods Broken

2014-11-24 Thread Chaoyu Tang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28403/ --- (Updated Nov. 24, 2014, 10:44 p.m.) Review request for hive, Ashutosh Chauhan,

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-24 Thread Sergio Pena
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/#review62889 --- ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveS

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223686#comment-14223686 ] Xuefu Zhang commented on HIVE-8951: --- If you can run hive CLI, the following steps, which

[jira] [Commented] (HIVE-8955) alter partition should check for "hive.stats.autogather" in hiveConf

2014-11-24 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223674#comment-14223674 ] Szehon Ho commented on HIVE-8955: - Hi Pankit, I took a look. It seems like for alter table

[jira] [Commented] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-24 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223673#comment-14223673 ] Chaoyu Tang commented on HIVE-4766: --- [~leftylev] Please let me know if you have any bette

[jira] [Updated] (HIVE-4766) Support HS2 client login timeout when the thrift thread max# is reached

2014-11-24 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoyu Tang updated HIVE-4766: -- Attachment: HIVE-4766.1.patch Thanks, [~szehon]. I have addressed all the issues you raised in the patch

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223661#comment-14223661 ] Marcelo Vanzin commented on HIVE-8951: -- Not from just those logs. Is this easily repro

[jira] [Commented] (HIVE-8951) Spark remote context doesn't work with local-cluster [Spark Branch]

2014-11-24 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223646#comment-14223646 ] Xuefu Zhang commented on HIVE-8951: --- okay. I saw this in Hive log: {code} 2014-11-24 14:1

Review Request 28416: HIVE-4766:Support HS2 client login timeout when the thrift thread max# is reached

2014-11-24 Thread Chaoyu Tang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28416/ --- Review request for hive. Repository: hive-git Description --- Hive has u

[jira] [Commented] (HIVE-8706) Table statistic collection on counter failed due to table name character case.

2014-11-24 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223644#comment-14223644 ] Gunther Hagleitner commented on HIVE-8706: -- +1 for 0.14 branch > Table statistic

[jira] [Commented] (HIVE-8936) Add SORT_QUERY_RESULTS for join tests that do not guarantee order

2014-11-24 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223637#comment-14223637 ] Hive QA commented on HIVE-8936: --- {color:red}Overall{color}: -1 at least one tests failed H

  1   2   >