[jira] [Commented] (HIVE-8986) Add limit_partition_metadataonly.q in testconfiguration.properties [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227359#comment-14227359 ] Hive QA commented on HIVE-8986: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8836: Attachment: HIVE-8836.11-spark.patch Several case failed due to recursive substitute ${spark.home}, f

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.10-spark.patch A bunch of new order failures. I am going to run a second time to

[jira] [Updated] (HIVE-8984) Enable job metrics/statistics gathering for remote spark context [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8984: - Description: stats_counter fails due to this issue > Enable job metrics/statistics gathering for remote spark conte

[jira] [Commented] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227315#comment-14227315 ] Hive QA commented on HIVE-8797: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227316#comment-14227316 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8986) Add limit_partition_metadataonly.q in testconfiguration.properties [Spark Branch]

2014-11-26 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8986: --- Attachment: HIVE-8986-spark.patch > Add limit_partition_metadataonly.q in testconfiguration.pro

[jira] [Updated] (HIVE-8986) Add limit_partition_metadataonly.q in testconfiguration.properties [Spark Branch]

2014-11-26 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-8986: --- Status: Patch Available (was: Open) > Add limit_partition_metadataonly.q in testconfiguration.

[jira] [Created] (HIVE-8986) Add limit_partition_metadataonly.q in testconfiguration.properties [Spark Branch]

2014-11-26 Thread Chinna Rao Lalam (JIRA)
Chinna Rao Lalam created HIVE-8986: -- Summary: Add limit_partition_metadataonly.q in testconfiguration.properties [Spark Branch] Key: HIVE-8986 URL: https://issues.apache.org/jira/browse/HIVE-8986 Pro

[jira] [Assigned] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2014-11-26 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao reassigned HIVE-8981: -- Assignee: Chao > Not a directory error in mapjoin_hook.q [Spark Branch] > --

[jira] [Commented] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2014-11-26 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227295#comment-14227295 ] Chao commented on HIVE-8981: [~szehon] OK, I'll take a look. Thanks > Not a directory error i

Review Request 28500: HIVE-8943 : Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-26 Thread Szehon Ho
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28500/ --- Review request for hive, Chao Sun, Suhas Satish, and Xuefu Zhang. Bugs: HIVE-89

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8924: Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227290#comment-14227290 ] Szehon Ho commented on HIVE-8924: - I'm going to commit this as the test doesnt seem related

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227279#comment-14227279 ] Hive QA commented on HIVE-8924: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8977) TestParquetDirect should be abstract

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227276#comment-14227276 ] Hive QA commented on HIVE-8977: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227244#comment-14227244 ] Hive QA commented on HIVE-8943: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8976) Make nine additional tests deterministic

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227240#comment-14227240 ] Hive QA commented on HIVE-8976: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227237#comment-14227237 ] Szehon Ho commented on HIVE-8982: - Yea you're right but it also happens in other ones like:

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227234#comment-14227234 ] Xuefu Zhang commented on HIVE-8982: --- I assume the q test is mapjoin_mapjoin.q (HIVE-8985)

[jira] [Resolved] (HIVE-8985) Investigate mapjoin_mapjoin.q failure [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8985. --- Resolution: Duplicate Duplicate of HIVE-8982. > Investigate mapjoin_mapjoin.q failure [Spark Branch] >

[jira] [Updated] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8982: -- Issue Type: Sub-task (was: Bug) Parent: HIVE-8699 > IndexOutOfBounds exception in mapjoin [Spark

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227226#comment-14227226 ] Xuefu Zhang commented on HIVE-8934: --- Okay. I will take a look. Thanks. > Investigate tes

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227224#comment-14227224 ] Szehon Ho commented on HIVE-8934: - @Xuefu I already provided a patch to bucketmapjoin7 fail

[jira] [Created] (HIVE-8985) Investigate mapjoin_mapjoin.q failure [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-8985: - Summary: Investigate mapjoin_mapjoin.q failure [Spark Branch] Key: HIVE-8985 URL: https://issues.apache.org/jira/browse/HIVE-8985 Project: Hive Issue Type: Sub-tas

Issue with windowing function UDAF registeration

2014-11-26 Thread wesley dias
Hi, While executing a simple select query using a custom windowing UDAF I created I am constantly running into this error. Error: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109) at org.a

[jira] [Updated] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8934: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available)

[jira] [Assigned] (HIVE-8984) Enable job metrics/statistics gathering for remote spark context [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li reassigned HIVE-8984: Assignee: Rui Li > Enable job metrics/statistics gathering for remote spark context [Spark > Branch] >

[jira] [Commented] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227206#comment-14227206 ] Hive QA commented on HIVE-8934: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.10-spark.patch > Enable automatic tests with remote spark client [Spark Branch] >

[jira] [Created] (HIVE-8984) Enable job metrics/statistics gathering for remote spark context [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
Rui Li created HIVE-8984: Summary: Enable job metrics/statistics gathering for remote spark context [Spark Branch] Key: HIVE-8984 URL: https://issues.apache.org/jira/browse/HIVE-8984 Project: Hive I

[jira] [Updated] (HIVE-8984) Enable job metrics/statistics gathering for remote spark context [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-8984: - Issue Type: Sub-task (was: Improvement) Parent: HIVE-8548 > Enable job metrics/statistics gathering for re

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227201#comment-14227201 ] Brock Noland commented on HIVE-8836: FYI I am generating a new patch which incorporates

[jira] [Commented] (HIVE-8948) TestStreaming is flaky

2014-11-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227192#comment-14227192 ] Eugene Koifman commented on HIVE-8948: -- +1 > TestStreaming is flaky > ---

[jira] [Commented] (HIVE-8978) Fix test determinism issue for qfile: smb_mapjoin_1.q etc

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227188#comment-14227188 ] Brock Noland commented on HIVE-8978: +1 pending tests > Fix test determinism issue for

[jira] [Commented] (HIVE-8983) PTest Backup spark.log in addition to hive.log

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227185#comment-14227185 ] Szehon Ho commented on HIVE-8983: - +1 looks ok to me > PTest Backup spark.log in addition

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227184#comment-14227184 ] Brock Noland commented on HIVE-8836: Thank you [~chengxiang li]! I will apply that on t

[jira] [Updated] (HIVE-8983) PTest Backup spark.log in addition to hive.log

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8983: --- Attachment: HIVE-8983.patch > PTest Backup spark.log in addition to hive.log >

[jira] [Created] (HIVE-8983) PTest Backup spark.log in addition to hive.log

2014-11-26 Thread Brock Noland (JIRA)
Brock Noland created HIVE-8983: -- Summary: PTest Backup spark.log in addition to hive.log Key: HIVE-8983 URL: https://issues.apache.org/jira/browse/HIVE-8983 Project: Hive Issue Type: Improvement

[jira] [Updated] (HIVE-8983) PTest Backup spark.log in addition to hive.log

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8983: --- Status: Patch Available (was: Open) > PTest Backup spark.log in addition to hive.log > ---

[jira] [Commented] (HIVE-8326) Using DbTxnManager with concurrency off results in run time error

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227178#comment-14227178 ] Hive QA commented on HIVE-8326: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8836: Attachment: additional-enable-spark-log.patch I upload a additional patch which would enable Spark dr

[jira] [Commented] (HIVE-8948) TestStreaming is flaky

2014-11-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227167#comment-14227167 ] Alan Gates commented on HIVE-8948: -- prepDb is only used by Derby, and I don't know how it

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227157#comment-14227157 ] Szehon Ho commented on HIVE-8924: - mapjoin_mapjoin is transient error which I tracked in HI

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8924: Attachment: HIVE-8924.4-spark.patch [~xuefuz] I think bucketmapjoin7 failure is caused by HIVE-8967 which did

[jira] [Created] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
Szehon Ho created HIVE-8982: --- Summary: IndexOutOfBounds exception in mapjoin [Spark Branch] Key: HIVE-8982 URL: https://issues.apache.org/jira/browse/HIVE-8982 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-8982) IndexOutOfBounds exception in mapjoin [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227139#comment-14227139 ] Szehon Ho commented on HIVE-8982: - Also FYI if you've seen the issue, [~csun] > IndexOutOf

[jira] [Commented] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227135#comment-14227135 ] Szehon Ho commented on HIVE-8981: - FYI [~csun] > Not a directory error in mapjoin_hook.q [

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227134#comment-14227134 ] Hive QA commented on HIVE-8924: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8981: Component/s: (was: spark-branch) Spark Affects Version/s: spark-branch >

[jira] [Created] (HIVE-8981) Not a directory error in mapjoin_hook.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
Szehon Ho created HIVE-8981: --- Summary: Not a directory error in mapjoin_hook.q [Spark Branch] Key: HIVE-8981 URL: https://issues.apache.org/jira/browse/HIVE-8981 Project: Hive Issue Type: Bug

[jira] [Commented] (HIVE-8839) Support "alter table .. add/replace columns cascade"

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227127#comment-14227127 ] Szehon Ho commented on HIVE-8839: - I did some doc cleanup in that section: [https://cwiki.

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227118#comment-14227118 ] Rui Li commented on HIVE-8836: -- Thanks [~brocknoland] and [~xuefuz] for the work. Maybe we can

[jira] [Commented] (HIVE-8956) Hive hangs while some error/exception happens beyond job execution [Spark Branch]

2014-11-26 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227107#comment-14227107 ] Rui Li commented on HIVE-8956: -- OK I see. Thanks [~vanzin] for the explanation. > Hive hangs

[jira] [Commented] (HIVE-6361) Un-fork Sqlline

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227102#comment-14227102 ] Hive QA commented on HIVE-6361: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8978) Fix test determinism issue for qfile: smb_mapjoin_1.q etc

2014-11-26 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8978: -- Priority: Minor (was: Major) > Fix test determinism issue for qfile: smb_mapjoin_1.q etc > -

[jira] [Updated] (HIVE-8978) Fix test determinism issue for qfile: smb_mapjoin_1.q etc

2014-11-26 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8978: -- Attachment: HIVE-8978.1.patch > Fix test determinism issue for qfile: smb_mapjoin_1.q etc > -

[jira] [Updated] (HIVE-8978) Fix test determinism issue for qfile: smb_mapjoin_1.q etc

2014-11-26 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jimmy Xiang updated HIVE-8978: -- Status: Patch Available (was: Open) > Fix test determinism issue for qfile: smb_mapjoin_1.q etc > --

[jira] [Commented] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-26 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227100#comment-14227100 ] Ashish Kumar Singh commented on HIVE-8950: -- [~brocknoland] Updated patch with bunc

[jira] [Updated] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-26 Thread Ashish Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Kumar Singh updated HIVE-8950: - Attachment: HIVE-8950.1.patch > Add support in ParquetHiveSerde to create table schema from

[jira] [Commented] (HIVE-8763) Support for use of enclosed quotes in LazySimpleSerde

2014-11-26 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227096#comment-14227096 ] Ferdinand Xu commented on HIVE-8763: Hi [~rstokes], can you please create a review boar

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-26 Thread Ashish Singh
> On Nov. 25, 2014, 12:37 a.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ColInfoFromParquetFile.java, > > line 35 > > > > > > This class will need more work in order to detect una

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-26 Thread Ashish Singh
> On Nov. 24, 2014, 10:44 p.m., Sergio Pena wrote: > > ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java, > > line 107 > > > > > > Avro uses avro.schema.url to specify the file that will be

[jira] [Commented] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227092#comment-14227092 ] Ashutosh Chauhan commented on HIVE-8828: Thanks Brock for confirmation. > Remove h

[jira] [Commented] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227090#comment-14227090 ] Ashutosh Chauhan commented on HIVE-8828: There are two more follow-up tasks to comp

[jira] [Created] (HIVE-8980) Remove shimming of CombineHiveInputFormat

2014-11-26 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-8980: -- Summary: Remove shimming of CombineHiveInputFormat Key: HIVE-8980 URL: https://issues.apache.org/jira/browse/HIVE-8980 Project: Hive Issue Type: Task

[jira] [Created] (HIVE-8979) Merge shims/common-secure into shims/common

2014-11-26 Thread Ashutosh Chauhan (JIRA)
Ashutosh Chauhan created HIVE-8979: -- Summary: Merge shims/common-secure into shims/common Key: HIVE-8979 URL: https://issues.apache.org/jira/browse/HIVE-8979 Project: Hive Issue Type: Task

[jira] [Commented] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227088#comment-14227088 ] Brock Noland commented on HIVE-8828: The {{TestMiniTezCliDriver}} error is tracked by H

[jira] [Updated] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8828: --- Fix Version/s: (was: 0.14.0) 0.15.0 > Remove hadoop 20 shims > -

[jira] [Updated] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-8828: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (HIVE-8948) TestStreaming is flaky

2014-11-26 Thread Eugene Koifman (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227084#comment-14227084 ] Eugene Koifman commented on HIVE-8948: -- [~alangates] I thought prepDb() is only used f

Re: Review Request 28372: HIVE-8950: Add support in ParquetHiveSerde to create table schema from a parquet file

2014-11-26 Thread Ashish Singh
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28372/ --- (Updated Nov. 27, 2014, 1:08 a.m.) Review request for hive. Changes ---

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227075#comment-14227075 ] Brock Noland commented on HIVE-8836: The non-spark failures are my fault due to not inc

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227073#comment-14227073 ] Hive QA commented on HIVE-8836: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8976) Make nine additional tests deterministic

2014-11-26 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227061#comment-14227061 ] Xuefu Zhang commented on HIVE-8976: --- LGTM. +1 pending on test. > Make nine additional te

[jira] [Created] (HIVE-8978) Fix test determinism issue for qfile: smb_mapjoin_1.q etc

2014-11-26 Thread Jimmy Xiang (JIRA)
Jimmy Xiang created HIVE-8978: - Summary: Fix test determinism issue for qfile: smb_mapjoin_1.q etc Key: HIVE-8978 URL: https://issues.apache.org/jira/browse/HIVE-8978 Project: Hive Issue Type: Bu

[jira] [Commented] (HIVE-8880) non-synchronized access to split list in OrcInputFormat

2014-11-26 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227048#comment-14227048 ] Gunther Hagleitner commented on HIVE-8880: -- +1, also for 0.14.1 > non-synchronize

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-11-26 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227045#comment-14227045 ] Gunther Hagleitner commented on HIVE-8966: -- +1 for 0.14.1 > Delta files created b

[jira] [Commented] (HIVE-8964) Some TestMiniTezCliDriver tests taking two hours

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227040#comment-14227040 ] Brock Noland commented on HIVE-8964: I am pretty sure this is {{lvj_mapjoin.q}} which w

[jira] [Commented] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227032#comment-14227032 ] Szehon Ho commented on HIVE-8943: - Forgot to generate the golden files for new tests in CLI

[jira] [Updated] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8943: Attachment: HIVE-8943.3-spark.patch > Fix memory limit check for combine nested mapjoins [Spark Branch] > ---

[jira] [Commented] (HIVE-8828) Remove hadoop 20 shims

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227028#comment-14227028 ] Hive QA commented on HIVE-8828: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Updated] (HIVE-8934) Investigate test failure on bucketmapjoin10.q and bucketmapjoin11.q [Spark Branch]

2014-11-26 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-8934: --- Attachment: HIVE-8934.3-spark.patch Regenerated test outputs. > Investigate test failure on bucketmapjoin10.q and buck

[jira] [Commented] (HIVE-8975) Possible performance regression on bucket_map_join_tez2.q

2014-11-26 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227005#comment-14227005 ] Prasanth J commented on HIVE-8975: -- [~ashutoshc] What are all the possible modes for map-s

[jira] [Commented] (HIVE-8943) Fix memory limit check for combine nested mapjoins [Spark Branch]

2014-11-26 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227004#comment-14227004 ] Hive QA commented on HIVE-8943: --- {color:red}Overall{color}: -1 at least one tests failed H

[jira] [Commented] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-26 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227003#comment-14227003 ] Thejas M Nair commented on HIVE-8797: - +1 > Simultaneous dynamic inserts can result in

[jira] [Commented] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226999#comment-14226999 ] Szehon Ho commented on HIVE-8924: - Correction: join_view looks ok, but optimize_nullscan ha

[jira] [Updated] (HIVE-8924) Investigate test failure for join_empty.q [Spark Branch]

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-8924: Attachment: HIVE-8924.3-spark.patch This changed diff of some tests including those with empty stages. And

[jira] [Commented] (HIVE-8977) TestParquetDirect should be abstract

2014-11-26 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226977#comment-14226977 ] Szehon Ho commented on HIVE-8977: - +1 pending tests > TestParquetDirect should be abstract

[jira] [Commented] (HIVE-8975) Possible performance regression on bucket_map_join_tez2.q

2014-11-26 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226955#comment-14226955 ] Ashutosh Chauhan commented on HIVE-8975: [~prasanth_j] Instead of trying to determi

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-11-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226943#comment-14226943 ] Alan Gates commented on HIVE-8966: -- Ok, that makes sense. You're current delta has the fi

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.9-spark.patch v9 of the patch does *not* clear the environment before starting sp

[jira] [Updated] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8797: - Attachment: HIVE-8797.3.patch > Simultaneous dynamic inserts can result in "partition already exists" error

[jira] [Updated] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8797: - Status: Patch Available (was: Open) > Simultaneous dynamic inserts can result in "partition already exists

[jira] [Commented] (HIVE-8966) Delta files created by hive hcatalog streaming cannot be compacted

2014-11-26 Thread Jihong Liu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226925#comment-14226925 ] Jihong Liu commented on HIVE-8966: -- That flush_length file is only in the most recent delt

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client [Spark Branch]

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8836: --- Attachment: HIVE-8836.8-spark.patch Latest patch incorporates my changes in HIVE-8976. We'll commit HIV

[jira] [Updated] (HIVE-8797) Simultaneous dynamic inserts can result in "partition already exists" error

2014-11-26 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-8797: - Status: Open (was: Patch Available) Makes sense. I'll put up a new patch. > Simultaneous dynamic inserts

[jira] [Updated] (HIVE-8977) TestParquetDirect should be abstract

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8977: --- Assignee: Brock Noland Affects Version/s: 0.15.0 Status: Patch Available (w

[jira] [Updated] (HIVE-8977) TestParquetDirect should be abstract

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8977: --- Attachment: HIVE-8977.patch > TestParquetDirect should be abstract > --

[jira] [Updated] (HIVE-8976) Make nine additional tests deterministic

2014-11-26 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland updated HIVE-8976: --- Attachment: HIVE-8976.patch Including tez tests > Make nine additional tests deterministic > -

  1   2   >