[jira] Updated: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name

[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated HIVE-307: --- Attachment: HIVE-307.v3.patch v3 of patch includes Namit's suggested test case and rebased against SVN trunk.

[jira] Updated: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name

[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated HIVE-307: --- Affects Version/s: (was: 0.7.0) 0.5.0 Fix Version/s: (was: 0.7.0) > "LOA

[jira] Updated: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name

[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated HIVE-307: --- Fix Version/s: 0.7.0 Affects Version/s: (was: 0.5.0) 0.7.0 Sta

Re: [howldev] RE: Howl Authorization proposal

Ideally HDFS should allow plugin external authorization. Then the privilege inconsistent problem will gone. On Wed, Oct 13, 2010 at 4:49 PM, Pradeep Kamath wrote: > One related concern with not using hdfs permissions is that there can be > conflicts between what the hive authorization realm woul

[jira] Commented: (HIVE-1633) CombineHiveInputFormat fails with "cannot find dir for emptyFile"

[ https://issues.apache.org/jira/browse/HIVE-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920838#action_12920838 ] Sreekanth Ramakrishnan commented on HIVE-1633: -- This problem is caused in follo

RE: hive svn is up and hive.apache.org is up

Let us punt it for now From: John Sichi [jsi...@facebook.com] Sent: Wednesday, October 13, 2010 6:08 PM To: Cc: Subject: Re: hive svn is up and hive.apache.org is up A related question is whether we want to rename Java packages from org.apache.hadoop.hiv

Re: hive svn is up and hive.apache.org is up

A related question is whether we want to rename Java packages from org.apache.hadoop.hive.* to org.apache.hive.* Apparently the HBase folks decided to punt on this one since it's quite disruptive for in-flight patches, plugin loading, etc. I'd suggest that we defer this until a "Hive 1.0" eff

RE: [howldev] RE: Howl Authorization proposal

Moreover, there are metadata operations which do not require access to the dfs today (like alter table add columns...). This should also have some privilege model - depending on hdfs for that seems like a overkill. If the metastore stores all privilege information, and all access (hive/pig/ho

RE: [howldev] RE: Howl Authorization proposal

I think if the access to the files/directories (and their manipulations etc..) are through a single point (Hive) then this does not become an issue. However, if you have a usecase where direct manipulation of the files happens through hdfs then you do have to have 2 levels of authorization and y

RE: [howldev] RE: Howl Authorization proposal

One related concern with not using hdfs permissions is that there can be conflicts between what the hive authorization realm would permit versus what hdfs would permit. For instance a user X (in the hive authorization realm) has create table privilege for database db1 but the hdfs directory /us

[jira] Commented: (HIVE-1620) Patch to write directly to S3 from Hive

[ https://issues.apache.org/jira/browse/HIVE-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920808#action_12920808 ] Joydeep Sen Sarma commented on HIVE-1620: - i agree that the speed efficiency may be

Re: [howldev] RE: Howl Authorization proposal

On Oct 13, 2010, at 9:22 AM, Alan Gates wrote: > Our biggest concern is that HDFS already has a permissions model, why create > a whole new one? It is a lot of duplication. And that duplication will flow > through to things like logging and auditing, all of which Hive/Howl will now > need in

[jira] Created: (HIVE-1711) CREATE TABLE LIKE should not set stats in the new table

CREATE TABLE LIKE should not set stats in the new table --- Key: HIVE-1711 URL: https://issues.apache.org/jira/browse/HIVE-1711 Project: Hadoop Hive Issue Type: Bug Reporter: Ni

[jira] Commented: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920807#action_12920807 ] Namit Jain commented on HIVE-1660: -- I will take a look > Change get_partitions_ps to pass

[jira] Updated: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1660: Affects Version/s: 0.7.0 Status: Patch Available (was: Open) > Change get_partitions_ps to p

[jira] Updated: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1660: Attachment: HIVE-1660.2.patch > Change get_partitions_ps to pass partition filter to database >

Re: turn off Hudson tests on pre-0.20 Hadoop?

We have established access to Hudson via Namit; I've deleted the old projects and added 0.20 (which for now is the only one being built). Should I add one for 20S? JVS On Oct 13, 2010, at 1:20 PM, Carl Steinbach wrote: > Hi Ning, > > >> I logged in hudson but didn't see 'delete project'. I

[jira] Commented: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920797#action_12920797 ] Paul Yang commented on HIVE-1660: - HIVE-1660.1.patch is the main patch - it create a listPar

[jira] Updated: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1660: Attachment: HIVE-1660_regex.patch > Change get_partitions_ps to pass partition filter to database >

[jira] Updated: (HIVE-1660) Change get_partitions_ps to pass partition filter to database

[ https://issues.apache.org/jira/browse/HIVE-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1660: Attachment: HIVE-1660.1.patch > Change get_partitions_ps to pass partition filter to database >

[jira] Commented: (HIVE-1620) Patch to write directly to S3 from Hive

[ https://issues.apache.org/jira/browse/HIVE-1620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920788#action_12920788 ] Richard Cole commented on HIVE-1620: Hi Joydeep, The patch as proposed makes no attempt

[jira] Updated: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1709: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Commit

[jira] Commented: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920782#action_12920782 ] Namit Jain commented on HIVE-1709: -- Done - will look at the patch > Provide Postgres metas

[jira] Assigned: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1709: Assignee: Yuanjun Li > Provide Postgres metastore schema migration scripts (0.5 -> 0.6) > --

[jira] Assigned: (HIVE-1705) remove pre-0.20 Hadoop tweaks

[ https://issues.apache.org/jira/browse/HIVE-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi reassigned HIVE-1705: Assignee: Edward Capriolo (was: John Sichi) > remove pre-0.20 Hadoop tweaks > -

[jira] Updated: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1681: - Fix Version/s: 0.7.0 > ObjectStore.commitTransaction() does not properly handle transactions that

[jira] Updated: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1681: - Status: Patch Available (was: Open) > ObjectStore.commitTransaction() does not properly handle tr

[jira] Commented: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920771#action_12920771 ] Carl Steinbach commented on HIVE-1681: -- @Ning/Paul: We need to add concurrent metastore

[jira] Updated: (HIVE-1681) ObjectStore.commitTransaction() does not properly handle transactions that have already been rolled back

[ https://issues.apache.org/jira/browse/HIVE-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1681: - Attachment: HIVE-1681-backport06.1.patch.txt > ObjectStore.commitTransaction() does not properly h

Re: turn off Hudson tests on pre-0.20 Hadoop?

I just pinged Johan in IRC, and he says they recently changed the permissions so he no longer has access either, so I'm going to file an INFRA ticket. I think we'll need privs for keeping Hudson in sync with the TLP svn switch as well. JVS On Oct 13, 2010, at 1:20 PM, Carl Steinbach wrote: >

[jira] Created: (HIVE-1710) Add Metastore Concurrency Tests

Add Metastore Concurrency Tests --- Key: HIVE-1710 URL: https://issues.apache.org/jira/browse/HIVE-1710 Project: Hadoop Hive Issue Type: Test Components: Metastore Reporter: Carl Steinbach

Re: release 0.6

Hi Namit, I opened a ticket (HIVE-1709) for the postgres metastore upgrade script supplied by Yuanjun Li. Can you please commit this and then build a release candidate? Let me know if you need me to do anything else. Thanks. Carl On Wed, Oct 6, 2010 at 6:45 PM, Carl Steinbach wrote: > Hi Nami

Re: turn off Hudson tests on pre-0.20 Hadoop?

Hi Ning, > I logged in hudson but didn't see 'delete project'. I guess hudson has a > different set of committers? I'll ask around FB committers. > I remember John mentioned that Johan was the person who originally setup all of these jobs. It may be worth getting in touch with him and asking if

[jira] Commented: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920745#action_12920745 ] Carl Steinbach commented on HIVE-1709: -- Can someone please add Yuanjun Li to the list o

[jira] Updated: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1709: - Status: Patch Available (was: Open) > Provide Postgres metastore schema migration scripts (0.5 ->

[jira] Updated: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

[ https://issues.apache.org/jira/browse/HIVE-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1709: - Attachment: HIVE-1709.1.patch.txt > Provide Postgres metastore schema migration scripts (0.5 -> 0.

[jira] Created: (HIVE-1709) Provide Postgres metastore schema migration scripts (0.5 -> 0.6)

Provide Postgres metastore schema migration scripts (0.5 -> 0.6) Key: HIVE-1709 URL: https://issues.apache.org/jira/browse/HIVE-1709 Project: Hadoop Hive Issue Type: Task

Re: turn off Hudson tests on pre-0.20 Hadoop?

Thanks Carl. I logged in hudson but didn't see 'delete project'. I guess hudson has a different set of committers? I'll ask around FB committers. Also there is already a 0.20 project running https://hudson.apache.org/hudson/view/Hive/job/Hive-trunk-h0.20/

Re: turn off Hudson tests on pre-0.20 Hadoop?

Hi Ning, Here are links to the Hudson Hive jobs: https://hudson.apache.org/hudson/view/Hive/job/Hive-trunk-h0.17/ https://hudson.apache.org/hudson/view/Hive/job/Hive-trunk-h0.18/ https://hudson.apache.org/hudson/view/Hive/job/Hive-trunk-h0.19/ If you are a committer and are logged in you should

Build failed in Hudson: Hive-trunk-h0.20 #391

See Changes: [namit] HIVE-1699 Incorrect partition pruning ANALYZE TABLE (Ning Zhang via namit) [nzhang] HIVE-1701. drop support for pre-0.20 Hadoop versions (jvs via Ning Zhang) [nzhang] HIVE-1658. Fix describe [extended] col

[jira] Created: (HIVE-1708) make hive history file configurable

make hive history file configurable --- Key: HIVE-1708 URL: https://issues.apache.org/jira/browse/HIVE-1708 Project: Hadoop Hive Issue Type: Improvement Components: Query Processor Report

[jira] Commented: (HIVE-1707) bug when different partitions are present in different dfs

[ https://issues.apache.org/jira/browse/HIVE-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920697#action_12920697 ] Namit Jain commented on HIVE-1707: -- Thats fine - I agree it will be difficult to add a unit

[jira] Commented: (HIVE-1707) bug when different partitions are present in different dfs

[ https://issues.apache.org/jira/browse/HIVE-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920696#action_12920696 ] He Yongqiang commented on HIVE-1707: Yes. We should delete the old data. Even today, if

[jira] Commented: (HIVE-1707) bug when different partitions are present in different dfs

[ https://issues.apache.org/jira/browse/HIVE-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920683#action_12920683 ] Namit Jain commented on HIVE-1707: -- Also, can you make sure that the old location gets dele

[jira] Assigned: (HIVE-1508) Add cleanup method to HiveHistory class

[ https://issues.apache.org/jira/browse/HIVE-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo reassigned HIVE-1508: - Assignee: Edward Capriolo > Add cleanup method to HiveHistory class >

Re: [howldev] RE: Howl Authorization proposal

John, It's not clear to us whether, if a traditional ACL model was available, we would still need the HDFS model. I suspect so, but I'm not sure. We had a few concerns with the full ACL model that caused us to avoid it at least initially. In this model Hive/Howl has to own all the fil

[jira] Created: (HIVE-1707) bug when different partitions are present in different dfs

bug when different partitions are present in different dfs -- Key: HIVE-1707 URL: https://issues.apache.org/jira/browse/HIVE-1707 Project: Hadoop Hive Issue Type: Bug Componen

[jira] Assigned: (HIVE-1705) remove pre-0.20 Hadoop tweaks

[ https://issues.apache.org/jira/browse/HIVE-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1705: Assignee: John Sichi > remove pre-0.20 Hadoop tweaks > - > >

Build failed in Hudson: Hive-trunk-h0.19 #568

See Changes: [nzhang] HIVE-1701. drop support for pre-0.20 Hadoop versions (jvs via Ning Zhang) [nzhang] HIVE-1658. Fix describe [extended] column formatting (Thiruvel Thirumoolan via Ning Zhang) -

turn off Hudson tests on pre-0.20 Hadoop?

Hi, I've just committed HIVE-1701, which removes pre-0.20 hadoop support in Hive. Anyone knows how to turn off Hudson tests for Hive on pre-0.20 hadoop? Thanks, Ning

[jira] Commented: (HIVE-1553) NPE when using complex string UDF

[ https://issues.apache.org/jira/browse/HIVE-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920590#action_12920590 ] Sameer Kalburgi commented on HIVE-1553: --- Is there a workaround for this in 0.5.0? > N

Build failed in Hudson: Hive-trunk-h0.18 #568

See Changes: [nzhang] HIVE-1701. drop support for pre-0.20 Hadoop versions (jvs via Ning Zhang) [nzhang] HIVE-1658. Fix describe [extended] column formatting (Thiruvel Thirumoolan via Ning Zhang) -

Build failed in Hudson: Hive-trunk-h0.17 #567

See Changes: [nzhang] HIVE-1701. drop support for pre-0.20 Hadoop versions (jvs via Ning Zhang) [nzhang] HIVE-1658. Fix describe [extended] column formatting (Thiruvel Thirumoolan via Ning Zhang) -

[jira] Updated: (HIVE-1701) drop support for pre-0.20 Hadoop versions

[ https://issues.apache.org/jira/browse/HIVE-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1701: - Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thanks John! > drop support

[jira] Commented: (HIVE-1611) Add alternative search-provider to Hive site

[ https://issues.apache.org/jira/browse/HIVE-1611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12920526#action_12920526 ] Otis Gospodnetic commented on HIVE-1611: For what it's worth, Pig is now TLP, too, a