Re: Building out Hive in EC2/S3 versus dedicated servers

2011-11-22 Thread Guy Bayes
uster. > > > Our app is already built, serving our customers and making us money. > > > YMMV. > > > > > > On Nov 22, 2011, at 3:15 PM, Loren Siebert wrote: > > > > > My colleague has a Heroku-based startup and they are just getting started > wi

Re: Building out Hive in EC2/S3 versus dedicated servers

2011-11-22 Thread Mark Grover
: Building out Hive in EC2/S3 versus dedicated servers We recently adopted Hadoop and Hive for doing some significant data processing. We went the Amazon route. My own $.02 is as follows: If you are already incredibly experienced with Hadoop and Hive and have someone on staff who has previous

Re: Building out Hive in EC2/S3 versus dedicated servers

2011-11-22 Thread Sam Wilson
already built, serving our customers and making us money. YMMV. On Nov 22, 2011, at 3:15 PM, Loren Siebert wrote: > My colleague has a Heroku-based startup and they are just getting started > with Hadoop and Hive. They’re evaluating running Hive in EC2/S3 versus buying > a handful o

Building out Hive in EC2/S3 versus dedicated servers

2011-11-22 Thread Loren Siebert
My colleague has a Heroku-based startup and they are just getting started with Hadoop and Hive. They’re evaluating running Hive in EC2/S3 versus buying a handful of boxes and installing CDH. One nice (albeit dated) analysis on this question is here, but I’m curious if anyone here has a

Re: Hive in EC2

2011-09-03 Thread MIS
's master host. One does not install EMR on existing EC2 (non-EMR) > instances. > > > -Original Message- > From: MIS [mailto:misapa...@gmail.com] > Sent: Wednesday, August 31, 2011 10:38 AM > To: d...@hive.apache.org > Cc: user@hive.apache.org > Subject: Re: Hive

RE: Hive in EC2

2011-08-31 Thread Steven Wong
pa...@gmail.com] Sent: Wednesday, August 31, 2011 10:38 AM To: d...@hive.apache.org Cc: user@hive.apache.org Subject: Re: Hive in EC2 But my concern is that I cannot run the Elastic Mapreduce on specific instances which we already own and have elastic IPs. If it is possible to do so, then using Hiv

RE: Hive in EC2

2011-08-31 Thread Steven Wong
EMR Hive and Apache Hive are versioned the same. From: Igor Tatarinov [mailto:i...@decide.com] Sent: Tuesday, August 30, 2011 8:27 PM To: user@hive.apache.org; jiang licht Subject: Re: Hive in EC2 The only caveat is that you are at Amazon's mercy in terms of the latest version of Hive.

Re: Hive in EC2

2011-08-31 Thread jiang licht
ask about it @ amazon forum?   Michael From: MIS To: d...@hive.apache.org Cc: "user@hive.apache.org" Sent: Wednesday, August 31, 2011 10:37 AM Subject: Re: Hive in EC2 But my concern is that I cannot run the Elastic Mapreduce on specific instances

Re: Hive in EC2

2011-08-31 Thread MIS
: MIS [mailto:misapa...@gmail.com] > Sent: Monday, August 29, 2011 11:03 PM > To: user@hive.apache.org; hive > Subject: Hive in EC2 > > Hi, > > Can somebody point me to production level setup of Hive in EC2. The intent > is to know the setup best practices being employed. > > Thanks. >

Re: Hive in EC2

2011-08-30 Thread Guy Bayes
che.org; jiang licht > *Sent:* Tuesday, August 30, 2011 8:26 PM > *Subject:* Re: Hive in EC2 > > The only caveat is that you are at Amazon's mercy in terms of the latest > version of Hive. Also, they have their own versioning so EMR Hive's latest > version 0.7.1 could be

Re: Hive in EC2

2011-08-30 Thread jiang licht
2011 8:26 PM Subject: Re: Hive in EC2 The only caveat is that you are at Amazon's mercy in terms of the latest version of Hive. Also, they have their own versioning so EMR Hive's latest version 0.7.1 could be Apache Hive's 0.6.5 - I am not even sure. Basically, don't expect

Re: Hive in EC2

2011-08-30 Thread Igor Tatarinov
eatures in Hive specific to Amazon Elastic MapReduce?" > > http://aws.amazon.com/elasticmapreduce/faqs/ > > Michael > -- > *From:* "Aggarwal, Vaibhav" > *To:* "d...@hive.apache.org" ; "user@hive.apache.org" > > *Sent:

Re: Hive in EC2

2011-08-30 Thread jiang licht
aqs/   Michael From: "Aggarwal, Vaibhav" To: "d...@hive.apache.org" ; "user@hive.apache.org" Sent: Tuesday, August 30, 2011 11:51 AM Subject: RE: Hive in EC2 You could also choose to look at Amazon ElasticMapReduce. It allows you to provision an EC2 clust

RE: Hive in EC2

2011-08-30 Thread Aggarwal, Vaibhav
...@gmail.com] Sent: Monday, August 29, 2011 11:03 PM To: user@hive.apache.org; hive Subject: Hive in EC2 Hi, Can somebody point me to production level setup of Hive in EC2. The intent is to know the setup best practices being employed. Thanks.

Re: Hive in EC2

2011-08-30 Thread Miguel Cabero
=cloudera/cdh/post-configure Cloudera default settings are currently fine for me. I recommend using MySql as metastore instead of Derby. I use Amazon RDS for its simplicity. Regards, Lemig Le 30 août 2011 à 08:02, MIS a écrit : > Hi, > > Can somebody point me to production level setup of Hi

Hive in EC2

2011-08-29 Thread MIS
Hi, Can somebody point me to production level setup of Hive in EC2. The intent is to know the setup best practices being employed. Thanks.