Re: compiling hive on hadoop 23

Navis, org.apache.hadoop#hadoop-core;0-23.1 Do you know where is the corresponding jar stored ? I didn't find it in mvn. For now, I can try hardcoding ivy.xml and proceed. -namit From: Navis류승우 mailto:navis@nexr.com>> Reply-To: "dev@hive.apache.org" mailto:dev

[jira] [Updated] (HIVE-3293) Load file into a table does not update table statistics

[ https://issues.apache.org/jira/browse/HIVE-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3293: - Attachment: hive.3293.3.patch updated more test results > Load file into a table does not

[jira] [Updated] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3343: --- Attachment: hive-3343.patch > Hive: Query misaligned result for Group by followed by Join with fil

[jira] [Updated] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gang Tim Liu updated HIVE-3343: --- Status: Patch Available (was: Open) patch is submitted. > Hive: Query misaligned res

[jira] [Commented] (HIVE-3141) Bug in SELECT query

[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430898#comment-13430898 ] Ajesh Kumar commented on HIVE-3141: --- Hi Namit, Both positive and negative tests are inclu

Re: compiling hive on hadoop 23

Thanks Ashutosh, But I still got unresolved dependencies. org.apache.hadoop#hadoop-core;0-23.1: not found org.apache.hadoop#hadoop-test;0-23.1: not found org.apache.hadoop#hadoop-tools;0-23.1: not found I had done a ant very-clean before this, but it did not help. Thanks, -namit On 8/8/12

Re: compiling hive on hadoop 23

I've modified common/ivy file slightly (HIVE-2999+a) and it worked for me. But I don't know exact meaning of it. -navis 2012/8/8 Namit Jain > > > I was trying to add a test case which only works for hadoop 23. > However, I got some errors when I tried to compile: > > I tried the following: > >

Re: compiling hive on hadoop 23

Try with hadoop version as 0.23.1 (instead of 0.23) ant -Dhadoop.version=0.23.1 -Dhadoop.security.version=0.23.1 package Thanks, Ashutosh On Tue, Aug 7, 2012 at 10:41 PM, Namit Jain wrote: > > > I was trying to add a test case which only works for hadoop 23. > However, I got some errors when I

[jira] [Updated] (HIVE-3141) Bug in SELECT query

[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3141: - Status: Open (was: Patch Available) > Bug in SELECT query > --- > > K

[jira] [Commented] (HIVE-3141) Bug in SELECT query

[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430885#comment-13430885 ] Namit Jain commented on HIVE-3141: -- Can you add negative test for the scenarios you mentio

compiling hive on hadoop 23

I was trying to add a test case which only works for hadoop 23. However, I got some errors when I tried to compile: I tried the following: ant -Dhadoop.version=0.23.0 -Dhadoop.security.version=0.23.0 -Dhadoop.security.version.prefix=0.23 package ant -Dhadoop.version=0.23.0 package looking at

[jira] [Commented] (HIVE-2468) Make Hive compile against Hadoop 0.23

[ https://issues.apache.org/jira/browse/HIVE-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430881#comment-13430881 ] Namit Jain commented on HIVE-2468: -- @Carl: can the above be used to compile hive source co

[jira] [Commented] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430776#comment-13430776 ] Gang Tim Liu commented on HIVE-3343: https://reviews.facebook.net/D4563

[jira] [Commented] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430761#comment-13430761 ] Gang Tim Liu commented on HIVE-3343: root-cause is ColumnPrunerFilterProc doesn't perse

[jira] [Commented] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

[ https://issues.apache.org/jira/browse/HIVE-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430757#comment-13430757 ] Gang Tim Liu commented on HIVE-3343: If we remove "b.k1 < 5", it will generate right re

[jira] [Created] (HIVE-3343) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

Gang Tim Liu created HIVE-3343: -- Summary: Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result Key: HIVE-3343 URL: https://issues.apache.org/jira/browse/HIVE-3343

[jira] [Created] (HIVE-3342) Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result

Gang Tim Liu created HIVE-3342: -- Summary: Hive: Query misaligned result for Group by followed by Join with filter and skip a group-by result Key: HIVE-3342 URL: https://issues.apache.org/jira/browse/HIVE-3342

[jira] [Commented] (HIVE-3098) Memory leak from large number of FileSystem instances in FileSystem.CACHE. (Must cache UGIs.)

[ https://issues.apache.org/jira/browse/HIVE-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430748#comment-13430748 ] Rohini Palaniswamy commented on HIVE-3098: -- Daryn, bq. trying to cache UGIs wil

[jira] [Updated] (HIVE-3063) drop partition for non-string columns is failing

[ https://issues.apache.org/jira/browse/HIVE-3063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Gates updated HIVE-3063: - Attachment: HIVE-3063-branch9.patch Copy of the patch checked into branch 9 for reference.

About Usage of Hive Index

Hi, When I try to use Hive Indexing, I have the following questions. 1. Does Indexing have the same performance on both the partitioned and non-partitioned tables? How about bucketed and un-bucked tables? 2. Is it possible for us to build index of function of indexed columns, like create

Hive-trunk-h0.21 - Build # 1596 - Failure

Changes for Build #1596 1 tests failed. REGRESSION: org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1 Error Message: Unexpected exception See build/ql/tmp/hive.log, or try "ant test ... -Dtest.silent=false" to get more logs. Stack Trace: junit.framew

[jira] [Updated] (HIVE-3341) Making hive tests run against different MR versions

[ https://issues.apache.org/jira/browse/HIVE-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanth Sowmyan updated HIVE-3341: --- Status: Patch Available (was: Open) > Making hive tests run against different MR versions

[jira] [Commented] (HIVE-3341) Making hive tests run against different MR versions

[ https://issues.apache.org/jira/browse/HIVE-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430651#comment-13430651 ] Sushanth Sowmyan commented on HIVE-3341: Phabricator review request posted at : htt

RE: Changing table types from managed to external

Thanks Igor! It worked! Date: Mon, 6 Aug 2012 23:26:04 -0700 Subject: Re: Changing table types from managed to external From: i...@decide.com To: u...@hive.apache.org CC: dev@hive.apache.org TryALTER TABLE SET TBLPROPERTIES('EXTERNAL'='TRUE'); It worked for me. igordecide.com On Mon, Aug

Re: Logging info is not present in console output

That's what I'm using right now. It was totally functional in SymenticAnalyzer, but not working properly for JOIN. On Tue, Aug 7, 2012 at 5:28 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > Are you running via console? The default logging level is WARN. > > $HIVE_HOME/bin/h

Re: Logging info is not present in console output

Are you running via console? The default logging level is WARN. $HIVE_HOME/bin/hive -hiveconf hive.root.logger=INFO,console This should print the INFO messages onto the console. On Tue, Aug 7, 2012 at 4:07 PM, Ablimit Aji wrote: > Hi, > > I have put some LOG.info() statements inside the join

[jira] [Commented] (HIVE-3337) Create Table Like should copy configured Table Parameters

[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430602#comment-13430602 ] Carl Steinbach commented on HIVE-3337: -- +1. Will commit if tests pass.

[jira] [Created] (HIVE-3341) Making hive tests run against different MR versions

Sushanth Sowmyan created HIVE-3341: -- Summary: Making hive tests run against different MR versions Key: HIVE-3341 URL: https://issues.apache.org/jira/browse/HIVE-3341 Project: Hive Issue Type

[jira] [Updated] (HIVE-3340) shims unit test failures fails further test progress

[ https://issues.apache.org/jira/browse/HIVE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HIVE-3340: - Status: Patch Available (was: Open) > shims unit test failures fails further test pro

[jira] [Commented] (HIVE-3340) shims unit test failures fails further test progress

[ https://issues.apache.org/jira/browse/HIVE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430510#comment-13430510 ] Giridharan Kesavan commented on HIVE-3340: -- this patch sets the failonerror flag t

[jira] [Updated] (HIVE-3340) shims unit test failures fails further test progress

[ https://issues.apache.org/jira/browse/HIVE-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giridharan Kesavan updated HIVE-3340: - Attachment: HIVE-3340.patch > shims unit test failures fails further test progress > -

Re: Some Weird Behavior

Let me try that and I will update on this thread If I found something interesting. Thanks for the help kulkarni. On Tue, Aug 7, 2012 at 11:10 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > In that case you might want to try "count(1)" instead of "count(*)" and see > if t

[jira] [Updated] (HIVE-3337) Create Table Like should copy configured Table Parameters

[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhushan Mandhani updated HIVE-3337: --- Labels: configuration (was: ) Status: Patch Available (was: Open) Submitting patch corre

[jira] [Updated] (HIVE-3337) Create Table Like should copy configured Table Parameters

[ https://issues.apache.org/jira/browse/HIVE-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhushan Mandhani updated HIVE-3337: --- Attachment: HIVE-3337.1.patch.txt > Create Table Like should copy configured Table Paramet

[jira] [Created] (HIVE-3340) shims unit test failures fails further test progress

Giridharan Kesavan created HIVE-3340: Summary: shims unit test failures fails further test progress Key: HIVE-3340 URL: https://issues.apache.org/jira/browse/HIVE-3340 Project: Hive Issue

Re: Some Weird Behavior

In that case you might want to try "count(1)" instead of "count(*)" and see if that makes any difference. [1] [1] https://issues.apache.org/jira/browse/HIVE-287 On Tue, Aug 7, 2012 at 1:07 PM, Techy Teck wrote: > I am running Hive 0.6. > > > > > > On Tue, Aug 7, 2012 at 11:04 AM, kulkarni.swar.

Re: Custom UserDefinedFunction in Hive

Hi Jan, I have date in different format also, so that is the reason I was thinking to do by this approach. How can I make sure this will work on the selected partition only and it will not scan the entire table. I will add your suggestion in my UDF as deterministic thing. My simple question here

Re: Some Weird Behavior

I am running Hive 0.6. On Tue, Aug 7, 2012 at 11:04 AM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > What is the hive version that you are using? > > > On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck wrote: > >> I am not sure about the data, but when we do >> >> SELECT count(

Re: Some Weird Behavior

What is the hive version that you are using? On Tue, Aug 7, 2012 at 12:57 PM, Techy Teck wrote: > I am not sure about the data, but when we do > > SELECT count(*) from data_realtime where dt='20120730' and uid is null > > I get the count > > but If I do- > > SELECT * from data_realtime where dt=

Re: Custom UserDefinedFunction in Hive

@kulkarni, When I did explain on my query, I got these things, I am not sure how to understand these thing. Any help will be appreciated whether my approach is right or not?- hive> EXPLAIN SELECT * FROM PDS_ATTRIBUTE_DATA_REALTIME where dt=yesterdaydate('MMdd', 2) LIMIT 5; OK ABSTRACT S

Re: Some Weird Behavior

I am not sure about the data, but when we do SELECT count(*) from data_realtime where dt='20120730' and uid is null I get the count but If I do- SELECT * from data_realtime where dt='20120730' and uid is null I get zero record back. But if all the record is NULL then I should be getting NULL r

Re: Custom UserDefinedFunction in Hive

Oops, sorry I made a copy&paste mistake :) The annotation should read @*UDFType(deterministic=true*) Jan On Tue, Aug 7, 2012 at 7:37 PM, Jan Dolinár wrote: > I'm afraid that he query > > SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; > > will scan entire table, because th

Re: Custom UserDefinedFunction in Hive

I'm afraid that he query SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; will scan entire table, because the functions is evaluated at runtime, so Hive doesn't know what the value is when it decides which files to scan. I am not 100% sure though, you should try it. Also, yo

Re: Custom UserDefinedFunction in Hive

Have you tried using EXPLAIN[1] on your query? I usually like to use that to get a better understanding of what my query is actually doing and debugging at other times. [1] https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Explain On Tue, Aug 7, 2012 at 12:20 PM, Raihan Jamal wrote

Changing table types from managed to external

Hello, I created a managed table in HIVE when i intended for it to be external, is it possible for me to change the table back to external? OR do I have to copy the data to a new directory, drop the table, then copy it back? Thanks,George

Re: Changing table types from managed to external

Try ALTER TABLE SET TBLPROPERTIES('EXTERNAL'='TRUE'); It worked for me. igor decide.com On Mon, Aug 6, 2012 at 11:08 PM, Babe Ruth wrote: > Hello, > I created a managed table in HIVE when i intended for it to be external, > is it possible for me to change the table back to external? > > OR

Re: Custom UserDefinedFunction in Hive

Hi Jan, I figured that out, it is working fine for me now. The only question I have is, if I am doing like this- SELECT * FROM REALTIME where dt= yesterdaydate('MMdd') LIMIT 10; Then the above query will be evaluated as below right? SELECT * FROM REALTIME where dt= ‘20120806’ LIMIT 1

[jira] [Updated] (HIVE-967) Implement "show create table"

[ https://issues.apache.org/jira/browse/HIVE-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Lu updated HIVE-967: - Attachment: HIVE-967.3.patch.txt The diff is updated and a current patch is attached here. > Imple

Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #99

See -- [...truncated 10205 lines...] [echo] Project: odbc [copy] Warning:

Re: Possible patch to fix column comments with non-native SerDe

So, the patch doesn not seem to fix the problem we are having, but it combined with the one I sent to the list seems to take care of it. I will continue to study this issue and report back on any issues. Thanks again! On 08/06/2012 06:59 PM, Stephen Scaffid wrote: Thanks! I'll see how it goes

[jira] [Updated] (HIVE-3141) Bug in SELECT query

[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Labels: patch (was: ) Affects Version/s: 0.9.0 Status: Patch Available (w

[jira] [Updated] (HIVE-3141) Bug in SELECT query

[ https://issues.apache.org/jira/browse/HIVE-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajesh Kumar updated HIVE-3141: -- Attachment: HIVE-3141.1.patch.txt Made change in CliDriver.java to make a check on the syntax of select

[jira] [Commented] (HIVE-2843) UDAF to convert an aggregation to a map

[ https://issues.apache.org/jira/browse/HIVE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430324#comment-13430324 ] David Worms commented on HIVE-2843: --- Patch is now uploaded, let me know in case it need t

[jira] [Updated] (HIVE-2843) UDAF to convert an aggregation to a map

[ https://issues.apache.org/jira/browse/HIVE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Worms updated HIVE-2843: -- Attachment: HIVE-2843.1.patch.txt > UDAF to convert an aggregation to a map > --

[jira] [Updated] (HIVE-2843) UDAF to convert an aggregation to a map

[ https://issues.apache.org/jira/browse/HIVE-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Worms updated HIVE-2843: -- Affects Version/s: 0.10.0 Status: Patch Available (was: Open) > UDAF to convert an a

[jira] [Updated] (HIVE-3293) Load file into a table does not update table statistics

[ https://issues.apache.org/jira/browse/HIVE-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3293: - Component/s: Statistics > Load file into a table does not update table statistics > --

[jira] [Commented] (HIVE-3293) Load file into a table does not update table statistics

[ https://issues.apache.org/jira/browse/HIVE-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13429984#comment-13429984 ] Carl Steinbach commented on HIVE-3293: -- Thanks. Looks good to me. > L