Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Shreepadma Venugopalan
Nov 22, 2013 at 2:36 PM, Shreepadma Venugopalan < > shreepa...@apache.org> wrote: > >> Apache Sentry (incubating) provides fine-grained role-based authorization >> for Hive among other components of the Hadoop ecosystem. It currently >> supports fully secure, fine-grained, ro

Re: How to prevent user drop table in Hive metadata?

2013-11-22 Thread Shreepadma Venugopalan
Apache Sentry (incubating) provides fine-grained role-based authorization for Hive among other components of the Hadoop ecosystem. It currently supports fully secure, fine-grained, role-based authorization for Hive and can be used to prevent the scenario described earlier i.e., prevent a user from

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

2013-11-21 Thread Shreepadma Venugopalan
Congrats guys! On Thu, Nov 21, 2013 at 3:37 PM, Vinod Kumar Vavilapalli wrote: > Congratulations to both! Great job and keep up the good work! > > Thanks, > +Vinod > > On Nov 21, 2013, at 3:29 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Jitendra Nath Pandey and Eric >

Re: [ANNOUNCE] New Hive PMC Member - Harish Butani

2013-11-15 Thread Shreepadma Venugopalan
Congrats Harish! On Fri, Nov 15, 2013 at 1:32 PM, Thejas Nair wrote: > Congrats Harish! > > > On Fri, Nov 15, 2013 at 1:08 AM, Gunther Hagleitner > wrote: > > Congratulations Harish! Very cool. > > > > > > On Thu, Nov 14, 2013 at 10:01 PM, Prasad Mujumdar >wrote: > > > >> Congratulations

Fwd: [ANNOUNCE]: Apache Sentry 1.2.0 released

2013-09-25 Thread Shreepadma Venugopalan
Corrected version with the necessary disclaimers. -- Forwarded message -- From: Shreepadma Venugopalan Date: Wed, Sep 25, 2013 at 2:40 PM Subject: Fwd: [ANNOUNCE]: Apache Sentry 1.2.0 released To: annou...@apache.org The Apache Sentry team is happy to announce the release of

Fwd: [ANNOUNCE]: Apache Sentry 1.2.0 released

2013-09-25 Thread Shreepadma Venugopalan
-- Forwarded message -- From: Shreepadma Venugopalan Date: Wed, Sep 25, 2013 at 1:06 PM Subject: [ANNOUNCE]: Apache Sentry 1.2.0 released To: d...@sentry.incubator.apache.org, annou...@apache.org The Apache Sentry team is happy to announce the release of Apache Sentry 1.2.0

Re: Sentry Meetup

2013-09-04 Thread Shreepadma Venugopalan
o all hiveserver2 JDBC users…this is not elegant but will keep my > production tables secure > > sanjay > > From: Shreepadma Venugopalan > Reply-To: "user@hive.apache.org" > Date: Wednesday, September 4, 2013 3:40 PM > To: "user@hive.apache.org" > Su

Sentry Meetup

2013-09-04 Thread Shreepadma Venugopalan
Sentry is a fine-grained role-based authorization system for Hive among others. We're planning to have a Sentry meetup in NYC coinciding with Hadoop World and Strata 2013. Please RSVP hereif you wish to attend the meetup and hear more abou

Re: [ANNOUNCE] New Hive Committer - Thejas Nair

2013-08-20 Thread Shreepadma Venugopalan
Congrats Tejas! On Tue, Aug 20, 2013 at 9:32 AM, Eugene Koifman wrote: > Congrats Thejas! > > > On Tue, Aug 20, 2013 at 3:31 AM, Carl Steinbach wrote: > >> The Apache Hive PMC has voted to make Thejas Nair a committer on the >> Apache >> Hive project. >> >> Please join me in congratulating Thej

Re: [ANNOUNCE] New Hive Committer - Brock Noland

2013-07-16 Thread Shreepadma Venugopalan
Many congrats, Brock! On Tue, Jul 16, 2013 at 7:33 AM, Ricky Saltzer wrote: > Congrats!! > > > On Tue, Jul 16, 2013 at 10:30 AM, Alexander Alten-Lorenz < > wget.n...@gmail.com> wrote: > >> Congratulations, Brock! >> >> On Jul 15, 2013, at 10:29 PM, Carl Steinbach wrote: >> >> > The Apache Hive

Re: IndexOutOfBoundsException with Snappy compressed SequenceFile from Flume

2013-07-15 Thread Shreepadma Venugopalan
bugs. Hopefully this will be a good lesson for > others in the future! > > Shreepadma Venugopalan wrote: > > > Hi Keith, > > Were you able to resolve this? Or, is this still an issue? > > Thanks. > Shreepadma > > > On Tue, May 28, 2013 at 6:02 AM, Keith

Re: IndexOutOfBoundsException with Snappy compressed SequenceFile from Flume

2013-07-15 Thread Shreepadma Venugopalan
Hi Keith, Were you able to resolve this? Or, is this still an issue? Thanks. Shreepadma On Tue, May 28, 2013 at 6:02 AM, Keith Wright wrote: > Hi all, > >This is my first post to the hive mailing list and I was hoping to get > some help with the exception I am getting below. I am using C

Re: [ANNOUNCE] Kevin Wilfong elected to Hive PMC

2013-03-04 Thread Shreepadma Venugopalan
Congrats Kevin! On Mon, Mar 4, 2013 at 12:43 PM, Kevin Wilfong wrote: > Thanks eveyone! > > From: Ricky Saltzer [ri...@cloudera.com] > Sent: Monday, March 04, 2013 12:13 PM > To: d...@hive.apache.org > Cc: user@hive.apache.org; Kevin Wilfong > Subject: Re: [ANNO

Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-29 Thread Shreepadma Venugopalan
Measure 1: +1 Measure 2: +1 Thanks. Shreepadma On Tue, Jan 29, 2013 at 1:50 PM, Arvind Prabhakar wrote: > Measure 1: +1 > Measure 2: +1 > > Regards, > Arvind Prabhakar > > On Mon, Jan 28, 2013 at 11:47 AM, Carl Steinbach wrote: > > > I am calling a vote on the following two measures. > > >

Re: Index rebuild fails

2013-01-08 Thread Shreepadma Venugopalan
Hi Santosh, The execution log will contain the stack trace of the exception that caused the task to fail. It would help to look into the execution log and attach it to the email. Thanks. Shreepadma On Tue, Jan 8, 2013 at 7:40 AM, Santosh Achhra wrote: > Hello Hive Users, > > After I execute be

Re: Hive Thrift upgrade to 0.9.0

2012-12-12 Thread Shreepadma Venugopalan
On Tue, Dec 11, 2012 at 12:07 PM, Shangzhong zhu wrote: > We are using Hive 0.9.0, and we have seen frequent Thrift Metastore > timeout issues probably due to the Thrift memory leak reported in > THRIFT-1468. > > The current solution is to upgrade Thrift to 0.9.0 > > I am trying to use the patch (

Re: FROM INSERT after ADD COLUMN

2012-12-10 Thread Shreepadma Venugopalan
ed to enhance Hive to add new column data when the data is stored in a column major format. Thanks. Shreepadma On Mon, Dec 10, 2012 at 10:32 AM, Shreepadma Venugopalan < shreepa...@cloudera.com> wrote: > > > > On Sun, Dec 9, 2012 at 10:32 PM, Bertrand Dechoux wrote: > >>

Re: FROM INSERT after ADD COLUMN

2012-12-10 Thread Shreepadma Venugopalan
case, >> but I was thinking that maybe there's a way to do it using a merge task. I >> will change my data structure to make it a bit like HBase, and I hope Hive >> would still be the right choice for me.. it can be backed by HBase anyway >> :). Thank you very mu

Re: FROM INSERT after ADD COLUMN

2012-12-09 Thread Shreepadma Venugopalan
Hi Younos, Since HiveQL doesn't support an insert..value statement, you can't insert values into a specific column. Let's assume your table had the following structure before the alter table..add columns statement was executed, tab (a string, b bigint, c double) Furthermore, let's assume that it

Re: hive-site.xml not found on classpath

2012-11-29 Thread Shreepadma Venugopalan
Are you seeing this message when your bring up the standalone hive cli by running 'hive'? On Thu, Nov 29, 2012 at 12:56 AM, Stephen Boesch wrote: > i am running under user steve. the latest log (where this shows up ) is > /tmp/steve/hive.log > > > 2012/11/29 Viral Bajaria > >> You are seeing

Re: Custom hive-site.xml is ignored, how to find out why

2012-11-26 Thread Shreepadma Venugopalan
Hi Stephen, If you wish to setup a mysql metastore, you need to have the following in your hive-site.xml, javax.jdo.option.ConnectionURL jdbc:mysql://MYHOST/metastore javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver javax.jdo.option.ConnectionUserName hiveuser j

Re: Setting auxpath in Hue/Beeswax

2012-11-26 Thread Shreepadma Venugopalan
Hi Sadu, Can you please post this on the CDH forum? Thanks. Shreepadma On Mon, Nov 26, 2012 at 10:51 AM, Sadananda Hegde wrote: > Hello, > > > > I have copied jar file into /usr/lib/hive/lib folder on all the nodes. I > am able to use it on Hive CLI with the command > > > > hive --auxpath /usr

Re: Multiuser setup on Hive

2012-11-21 Thread Shreepadma Venugopalan
Hi Austin, Hive authorization in its current form has a number of bugs and it is not recommended that you use it. We are planning to work on supporting authorization in a subsequent version of Hive. Thanks. Shreepadma On Wed, Nov 21, 2012 at 11:12 PM, Austin Chungath wrote: > Hi Bejoy, > > Tha

Re:

2012-11-20 Thread Shreepadma Venugopalan
The following papers provide an overview of Hive. These papers also explain the query rewrite i.e., translation from HiveQL to MR. http://www.vldb.org/pvldb/2/vldb09-938.pdf http://i.stanford.edu/~ragho/hive-icde2010.pdf If you want to look at the code, you should probably start with SemanticAnal

Re: Creating Indexes

2012-11-02 Thread Shreepadma Venugopalan
Hi Peter, While it looks like the map-red task may have succeeded it looks like the alter index actually failed. You should look into the execution log to see what the exception is. Without knowing why the DDLtask failed its hard to pinpoint the problem. As for the original problem with the jar a

Re: Creating Indexes

2012-10-31 Thread Shreepadma Venugopalan
ile that you might want to > see. > > ** ** > > Thanks for your efforts. > > ** ** > > Peter Marron > > ** ** > > *From:* Shreepadma Venugopalan [mailto:shreepa...@cloudera.com] > *Sent:* 31 October 2012 18:38 > *To:* user@hive.apache.org > *Subject:*

Re: Creating Indexes

2012-10-31 Thread Shreepadma Venugopalan
** > > Peter Marron > > ** ** > > *From:* Peter Marron [mailto:peter.mar...@trilliumsoftware.com] > *Sent:* 24 October 2012 13:27 > *To:* user@hive.apache.org > *Subject:* RE: Indexes > > ** ** > > Hi Shreepadma, > > ** ** >

Re: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

2012-10-29 Thread Shreepadma Venugopalan
Hi Robin, Can you attach the execution logs? The logs contain the exception stack. Thanks, Shreepadma On Mon, Oct 29, 2012 at 10:19 AM, Chen Song wrote: > Is there anything interesting on hive.log? > > If you are running Hive shell with root user, by default, the hive.log > should be in /tmp/h

Re: How to load phpmyadmin dump .sql file into hive ?

2012-10-28 Thread Shreepadma Venugopalan
Hi Sagar, Is your data in a flat file or is it in a relational database? If your data is in a relational database, you can use sqoop to import the data into a Hive warehouse. You can find step by step tutorial on sqoop here: http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_connecting_

Re: Indexes

2012-10-23 Thread Shreepadma Venugopalan
Forgot to add to the previous email, HIVE-1644 added support to have filters use indexes. Thanks, Shreepadma On Tue, Oct 23, 2012 at 11:48 AM, Shreepadma Venugopalan < shreepa...@cloudera.com> wrote: > Hi Peter, > > Indexing support was added to Hive in 0.7 and in 0.8 the query

Re: Indexes

2012-10-23 Thread Shreepadma Venugopalan
Hi Peter, Indexing support was added to Hive in 0.7 and in 0.8 the query compiler was enhanced to optimized some class of queries (certain group bys and joins) using indexes. Assuming you are using the built in index handler you need to do the following _after_ you have created and rebuilt the ind

Re: Implementing a star schema (facts & dimension model)

2012-10-22 Thread Shreepadma Venugopalan
Hi Austin, Bejoy summarized it well. Even though Hive doesn't have referencial integrity constraints, if you are loading data from MySQL that has referencial integrity constraint, Hive preserves that property of the data. Another thing to note is you can't update the data that is loaded into a Hiv