Hive in EC2

Hi, Can somebody point me to production level setup of Hive in EC2. The intent is to know the setup best practices being employed. Thanks.

Re: One Schema Per Partition? (Multiple schemas per table?)

Hi Tim, I figured that both reading the code and manual. I don't think its explicitly documented anywhere, so it will be great if you document this. This page looks right place where this place of information can live. Thanks for the help in making Hive better. Ashutosh On Mon, Aug 29, 2011 at

Re: Hive 0.7 thrift server thread safety

Thanks, Youngwoo. So hive-80 is not resolved, and the latest comments suggest that it is not thread safe. I think this is pretty much the consent for now. -tommy On Aug 29, 2011, at 6:17 PM, 김영우 wrote: > Tommy, > > I found a link for that. See > http://oobaloo.co.uk/multiple-connections

Re: Hive 0.7 thrift server thread safety

Tommy, I found a link for that. See http://oobaloo.co.uk/multiple-connections-with-hive HTH, - Youngwoo On Tue, Aug 30, 2011 at 4:12 AM, Tommy Li wrote: > Hi all, > > Is the thrift server thread safe? Will a single instance be able to serve > multiple client side JDBC connection. > > Any bes

Re: HIVE_AUX_JARS_PATH

Please ignore my mail. Seems like the site specific hive-env.sh was overriding the env variable ..Its working now . Thanks, Sam On Aug 29, 2011, at 4:28 PM, Aggarwal, Vaibhav wrote: > You need to point to the exact jar file location and not just the directory > location. > > Vaibhav > > ---

RE: HIVE_AUX_JARS_PATH

You need to point to the exact jar file location and not just the directory location. Vaibhav -Original Message- From: Sam William [mailto:sa...@stumbleupon.com] Sent: Monday, August 29, 2011 3:56 PM To: user@hive.apache.org Subject: HIVE_AUX_JARS_PATH I assume you need to set HIVE_AU

HIVE_AUX_JARS_PATH

I assume you need to set HIVE_AUX_JARS_PATH to the jars that contain custom Input/OutputFormats/Serdes.. I did export HIVE_AUX_JARS_PATH to point to the correct dir containing the jars and then ran hive .My custom class doesnt seem to be available when I create a table using these cl

Re: Bizarro Hive (Hadoop?) Error

We ran into this YET AGAIN today, leading one of us to start checking configuration settings. We determined our TaskTracker JVM was configured with not too much memory (200MB?). We increased that (512MB?) and now the error is gone. So it appears it's a TaskTracker getting OOM killed. On Tue, Jun

Re: One Schema Per Partition? (Multiple schemas per table?)

Hello, Ashutosh, I did nothing like that... :) It seems the problem here is I didn't RTFM. Perchance, could you say where you figured this out? I am going from the Hive DDL page on confluence[1], and although it mentions partitions and it mentions the "replace columns" you've mentioned here, it d

Re: Ignore subdirectories when querying external table

Dave, Where do you specify the classpath before starting the Hive shell , when you introduce a custom class like this ? Sam On Aug 19, 2011, at 1:22 PM, Dave wrote: > I solved my own problem. For anyone who's curious: > > It turns out that subclassing an InputFormat allows one to override

Re: Organizing a Hive Meetup for Hadoop World NYC

Hi Ed, This is a one-time event targeted at Hadoop World attendees, though others are welcome to attend as well. Thanks. Carl On Mon, Aug 29, 2011 at 12:09 PM, Edward Capriolo wrote: > Carl, > > Do you mean a one time Hive meetup or do you mean a recurring one? > > I ask because the hadoop-nyc

Recommendations on moving to Hadoop/Hive with Cassandra + RDBMS

Hi, I have an already running system where I define a simple data flow (using a simple custom data flow language) and configure jobs to run against stored data. I use quartz to schedule and run these jobs and the data exists on various data stores (mainly Cassandra but some data exists in RDBMS li

Hive 0.7 thrift server thread safety

Hi all, Is the thrift server thread safe? Will a single instance be able to serve multiple client side JDBC connection. Any best practice to follow? Thanks -Tommy

Re: Organizing a Hive Meetup for Hadoop World NYC

Carl, Do you mean a one time Hive meetup or do you mean a recurring one? I ask because the hadoop-nyc meetup is slowing down alot. http://www.meetup.com/Hadoop-NYC/. So supporting a hadoop and specific hive meetup seem difficult. Edward On Mon, Aug 29, 2011 at 2:36 PM, Carl Steinbach wrote: >

Organizing a Hive Meetup for Hadoop World NYC

Dear Hive users, Hadoop World 2011 (http://hadoopworld.com/) will be held November 8th and 9th in NYC. This year we're also planning to organize a Hive Meetup. These events are a good place for users to interact with each other and with the Hive development team. In order to help with organizatio