DataNucleus patches for Hive

2013-08-06 Thread Eric Chu
Hi, I'm a bit confused about what DataNucleus patches we should get for *Hive 0.11 with JDK 6*. It'd be great if people working on that could shed some light on the subject. Thanks in advance! After installing Hive 0.11 and applying the patch for HIVE-4619 (or else MR queries will result in error

java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.util.HostUtil for Hive 0.10.0

2013-02-26 Thread Eric Chu
(+hue-user since this issue prevents me from successfully installing Hue from source) Hi, I recently did the following with both the Hive-0.10 and Hive-0.9, and had a problem with 0.10 that I didn't see with 0.9 - Checked out the respective branch from github - Did an "ant package" - Co

unresolved dependency from ivy when building hive 0.10

2013-04-30 Thread Eric Chu
Hi, After upgrading Hive to 0.10 we often observe the following build error. We notice that when we run our dumpcache job (which includes deleting the ivy cache), the problem is *sometimes, but not always,* resolved. Does anyone know the cause of this problem or know of a better solution? Thanks

Re: DataNucleus patches for Hive

2013-08-20 Thread Eric Chu
ls datanu*". To avoid that, > you need to do "ant very-clean" before building hive. > > --Xuefu > > > On Tue, Aug 6, 2013 at 4:39 PM, Eric Chu wrote: > > > Hi, > > > > I'm a bit confused about what DataNucleus patches we should get fo

Re: Proposing a 0.11.1

2013-08-26 Thread Eric Chu
Hi, We recently tried to upgrade to Hive 0.11 from 0.10 and noticed we needed to add patches for the following JIRAs to make Hive 0.11 work: - HIVE-4619. None of our MR queries worked without it - HIVE-4003. We ran into this bug in 0.10 also - Data Nucleus-related: At first we were only

Re: No java compiler available exception for HWI

2013-08-26 Thread Eric Chu
already set the following properties in hive-site.xml > > > - hive.hwi.listen.host > > > - hive.hwi.listen.port > > > - hive.hwi.war.file > > > > > > And copied two jasper jars into hive/lib: > > > - jasper-compiler-5.5.23.jar > > > - jasper-

Hive unit test errors

2013-09-03 Thread Eric Chu
Hi, I'm trying to run unit tests on Hive 11 (with a few patches such as 4619, 4003, 4403, 4900, 3632, 4942) and encountering compile-test errors. I got the same thing when I ran on Trunk or just the 11 branch. Is there something I'm missing? Note that I could build and run Hive w/out problems. *C

Re: [jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-04 Thread Eric Chu
Hi Yin Huai, This patch doesn't apply cleanly in Hive 11. For example, ReduceSinkDeDuplication.java is in ql/src/java/org/apache/hadoop/hive/ql/optimizer/ in Hive 11 while the patch assumes the file is in ql/src/java/org/apache/hadoop/hive/ql/optimizer/correlation/. It seems like there are other c

Re: [jira] [Commented] (HIVE-5149) ReduceSinkDeDuplication can pick the wrong partitioning columns

2013-09-04 Thread Eric Chu
Wed, Sep 4, 2013 at 3:14 PM, Yin Huai wrote: > >> Sure. Let me take a look at 0.11 branch. >> >> >> On Wed, Sep 4, 2013 at 2:53 PM, Eric Chu wrote: >> >>> Hi Yin Huai, >>> >>> This patch doesn't apply cleanly in Hive 11. For examp

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-04-07 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962335#comment-13962335 ] Eric Chu commented on HIVE-6134: Hi [~xuefuz] and [~ashutoshc], it turns out this is

[jira] [Created] (HIVE-5970) ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java

2013-12-05 Thread Eric Chu (JIRA)
Eric Chu created HIVE-5970: -- Summary: ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java Key: HIVE-5970 URL: https://issues.apache.org/jira/browse/HIVE-5970 Project: Hive Issue Type

[jira] [Updated] (HIVE-5623) ORC accessing array column that's empty will fail with java out of bound exception

2013-12-05 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Chu updated HIVE-5623: --- Labels: orcfile (was: ) > ORC accessing array column that's empty will fail with java out

[jira] [Updated] (HIVE-5970) ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java

2013-12-05 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Chu updated HIVE-5970: --- Labels: orcfile (was: ) > ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.j

[jira] [Commented] (HIVE-5970) ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java

2013-12-05 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13840730#comment-13840730 ] Eric Chu commented on HIVE-5970: Looking at the code where the exception occurs, It s

[jira] [Commented] (HIVE-5970) ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java

2013-12-05 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13840743#comment-13840743 ] Eric Chu commented on HIVE-5970: Or pl could be 0 > ArrayIndexOutOfBoundsExcep

[jira] [Created] (HIVE-6005) BETWEEN is broken after using KRYO

2013-12-10 Thread Eric Chu (JIRA)
Eric Chu created HIVE-6005: -- Summary: BETWEEN is broken after using KRYO Key: HIVE-6005 URL: https://issues.apache.org/jira/browse/HIVE-6005 Project: Hive Issue Type: Bug Affects Versions

[jira] [Commented] (HIVE-5970) ArrayIndexOutOfBoundsException in RunLengthIntegerReaderV2.java

2013-12-10 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13845159#comment-13845159 ] Eric Chu commented on HIVE-5970: If we have already started using RLE 0.11 for

[jira] [Created] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-03 Thread Eric Chu (JIRA)
Eric Chu created HIVE-6134: -- Summary: Merging small files based on file size only works for CTAS queries Key: HIVE-6134 URL: https://issues.apache.org/jira/browse/HIVE-6134 Project: Hive Issue

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-03 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861818#comment-13861818 ] Eric Chu commented on HIVE-6134: [~brocknoland] and [~xuefuz]: I was talking to Yin

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-03 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861870#comment-13861870 ] Eric Chu commented on HIVE-6134: Thanks Xuefu for the quick response! A few quest

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-04 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13862462#comment-13862462 ] Eric Chu commented on HIVE-6134: [~xuefu.w...@kodak.com] We notice that the problem oc

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-06 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13863292#comment-13863292 ] Eric Chu commented on HIVE-6134: Thanks [~ashutoshc] for pointing out the concate

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-06 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13863512#comment-13863512 ] Eric Chu commented on HIVE-6134: [~xuefuz] Regarding when to merge, isn't that

[jira] [Commented] (HIVE-6134) Merging small files based on file size only works for CTAS queries

2014-01-06 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13863803#comment-13863803 ] Eric Chu commented on HIVE-6134: Good point [~xuefuz]. For the case of map-only jobs

[jira] [Commented] (HIVE-5379) NoClassDefFoundError is thrown when using lead/lag with kryo serialization

2014-01-07 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864428#comment-13864428 ] Eric Chu commented on HIVE-5379: We had the same error when we ran: SELECT count(num)

[jira] [Commented] (HIVE-5379) NoClassDefFoundError is thrown when using lead/lag with kryo serialization

2014-01-07 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864431#comment-13864431 ] Eric Chu commented on HIVE-5379: To continue from above, we applied this patch and

[jira] [Commented] (HIVE-5379) NoClassDefFoundError is thrown when using lead/lag with kryo serialization

2014-01-07 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13864487#comment-13864487 ] Eric Chu commented on HIVE-5379: Please ignore the above. False alarm. Sorry for

[jira] [Updated] (HIVE-6210) Default serde for RCFile has changed

2014-01-15 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Chu updated HIVE-6210: --- Description: In Hive 10 when I create a table in RCFile, the serde is org.apache.hadoop.hive.serde2

[jira] [Created] (HIVE-6210) Default serde for RCFile has changed

2014-01-15 Thread Eric Chu (JIRA)
Eric Chu created HIVE-6210: -- Summary: Default serde for RCFile has changed Key: HIVE-6210 URL: https://issues.apache.org/jira/browse/HIVE-6210 Project: Hive Issue Type: Bug Components

[jira] [Resolved] (HIVE-6210) Default serde for RCFile has changed

2014-01-15 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Chu resolved HIVE-6210. Resolution: Not A Problem > Default serde for RCFile has chan

[jira] [Commented] (HIVE-6210) Default serde for RCFile has changed

2014-01-15 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873022#comment-13873022 ] Eric Chu commented on HIVE-6210: Clarification: 1) I can set serde for partition.

[jira] [Created] (HIVE-5623) ORC accessing array column that's empty will fail with java out of bound exception

2013-10-23 Thread Eric Chu (JIRA)
Eric Chu created HIVE-5623: -- Summary: ORC accessing array column that's empty will fail with java out of bound exception Key: HIVE-5623 URL: https://issues.apache.org/jira/browse/HIVE-5623 Project:

[jira] [Commented] (HIVE-4975) Reading orc file throws exception after adding new column

2014-02-17 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903115#comment-13903115 ] Eric Chu commented on HIVE-4975: We've also run into this issue. [~owen.omalley]

[jira] [Commented] (HIVE-4975) Reading orc file throws exception after adding new column

2014-02-17 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903545#comment-13903545 ] Eric Chu commented on HIVE-4975: Also, the problem does not just happen when we do SE

[jira] [Commented] (HIVE-4703) Describe on a table returns "from deserializer" for column comments instead of values supplied in Create Table

2014-02-17 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903613#comment-13903613 ] Eric Chu commented on HIVE-4703: [~ottomata] We still see this issue in Hive

[jira] [Commented] (HIVE-4975) Reading orc file throws exception after adding new column

2014-02-17 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13903711#comment-13903711 ] Eric Chu commented on HIVE-4975: Hi [~kevinwilfong] do you have insights to this i

[jira] [Commented] (HIVE-3991) junit failure on Semantic Analysis

2013-09-07 Thread Eric Chu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761145#comment-13761145 ] Eric Chu commented on HIVE-3991: Is there any update to this? I also got the same e