Re: What's official site for howl ?

Official site is pretty lean. Is the idea to do away with that MySQL metastore? On Wed, May 4, 2011 at 7:18 PM, Jeff Zhang wrote: > Thanks for your guys' quick reply, really appreciate that > > > > > On Thu, May 5, 2011 at 10:13 AM, Alan Gates wrote: > >> http://incubator.apache.org/hcatalog/ >

Re: What's official site for howl ?

Thanks for your guys' quick reply, really appreciate that On Thu, May 5, 2011 at 10:13 AM, Alan Gates wrote: > http://incubator.apache.org/hcatalog/ > > Howl has been renamed to HCatalog (due to naming conflicts with an existing > ow2 project called Howl). > > Alan. > > > On May 4, 2011, at 7

Re: What's official site for howl ?

http://incubator.apache.org/hcatalog/ Howl has been renamed to HCatalog (due to naming conflicts with an existing ow2 project called Howl). Alan. On May 4, 2011, at 7:04 PM, Jeff Zhang wrote: Hi all, Sorry for bothering this mail list. But I only this mail list may relate with howl. Ju

Re: What's official site for howl ?

The project has been renamed HCatalog and is now an official apache incubator project here: http://incubator.apache.org/hcatalog/ On Wed, May 4, 2011 at 8:04 PM, Jeff Zhang wrote: > > Hi all, > Sorry for bothering this mail list. But I only this mail list may relate > with howl. Just wonder what

Re: What's official site for howl ?

Hey Jeff, official landing page is: https://cwiki.apache.org/confluence/display/HCATALOG/Index https://cwiki.apache.org/confluence/display/HCATALOG/HCatalogJournal has real useful content. Thanks, Ashutosh On Wed, May 4, 2011 at 19:04, Jeff Zhang wrote: > > Hi all, > Sorry for bothering this mail

What's official site for howl ?

Hi all, Sorry for bothering this mail list. But I only this mail list may relate with howl. Just wonder what's official site or mail list for howl. I'd like to get more information about howl -- Best Regards Jeff Zhang

Re: HiveQL scripts and input arguments

Thanks everybody. More reader friendly version of that SVN doc: http://archive.cloudera.com/cdh/3/hive/language_manual/var_substitution.html On Wed, May 4, 2011 at 3:15 PM, Time Less wrote: > > Just wondering if there is native support for input arguments on Hive >> scripts. >> eg. $ bin/hive

Re: HiveQL scripts and input arguments

> Just wondering if there is native support for input arguments on Hive > scripts. > eg. $ bin/hive -f script.q > Any documentation I could reference to look into this further? > A workaround: cat script.q | sed -e 's/arg1/arg1val/' | bin/hive -- Tim Ellis Riot Games

Re: HiveQL scripts and input arguments

Hive 0.7.X and up supports using variables in queries. This is documented in the SVN tree. http://svn.apache.org/repos/asf/hive/trunk/docs/xdocs/language_manual/var_substitution.xml You still might need some scripting outside of hive still but in many cases this can get the job done. On Wed, Ma

Re: Planning a migration from PostgreSQL to Hadoop/Hive

I write a shell script to do that 2011/5/4 Marcos Ortiz > On 05/04/2011 04:14 PM, Alexandre "TAZ" dos Santos Andrade wrote: > > Hi Marcos, > > I'm doing exactally the same migration, first of all you have to remember > that hive is gonna make mapreduce for each query you dont write the result >

Re: Planning a migration from PostgreSQL to Hadoop/Hive

On 05/04/2011 04:14 PM, Alexandre "TAZ" dos Santos Andrade wrote: Hi Marcos, I'm doing exactally the same migration, first of all you have to remember that hive is gonna make mapreduce for each query you dont write the result on a table, second is a litle bit anoing to migrate the data, there

Re: HiveQL scripts and input arguments

I'm wondering the same. I didn't notice it in the documentation for 0.7. My (possibly silly) way of dealing with it is to write ruby scripts to concatenate commands like > bin/hive -e "some statement" to a shell script, then execute the shell script. Parameterized scripting would be so welcome

HiveQL scripts and input arguments

Hey all, Just wondering if there is native support for input arguments on Hive scripts. eg. $ bin/hive -f script.q Any documentation I could reference to look into this further? Cheers, Jon

Re: Planning a migration from PostgreSQL to Hadoop/Hive

Hi Marcos, I'm doing exactally the same migration, first of all you have to remember that hive is gonna make mapreduce for each query you dont write the result on a table, second is a litle bit anoing to migrate the data, there's no direct connector so I user a simple dump, extracted the header an

Planning a migration from PostgreSQL to Hadoop/Hive

We are planning a migration from a large PostgreSQL-based DWH to Hadoop/Hive. The principal reason for this migration is the massive growth of the data to analyze (5.6 TB and growing) where PostgreSQL like a MVCC-based RDBMS has its pitfalls with heavy updates and query execution with great qua

RE: Question about Pig UDF and sqoop export

Finally figured it out. Flatten did the trick. Had to call flatten on the tuple returned by the UDF as shown below. B = FOREACH A GENERATE FLATTEN(PackageName.MyMethod()); Hope someone out there can make use of this behavior. Thanks -Akash -Original Message- From: Sharma, Akash [mailt

Re: HIVE Server multiple instances

This is great info. Thanks a lot for sharing :) From: Paul Ingles To: user@hive.apache.org Sent: Wed, May 4, 2011 4:48:20 AM Subject: Re: HIVE Server multiple instances For future reference I've posted a little more about our setup here: http://oobaloo.co.uk

Re: Maximum Number of Hive Partitions = 256?

> This is definitely a curious problem. > It's data corruption. The file is tab-separated, so I created a quick Perl pipe to print out the number of tabs on a given line: -bash-3.2$ hadoop fs -cat /user/hive/warehouse/ushb/2010-10-25/data-2010-10-25 | perl -pe 's/[^\t\n]//g' | perl -pe 's/\t/-/g'

Re: Maximum Number of Hive Partitions = 256?

> It turns out that 2010-10-24 is 257 days from the very first partition in > my dataset (2010-01-09): > > | date_sub('2010-10-24',interval 257 day) | > +-+ > | 2010-02-09 | > I just noticed 257 days is FEBRUARY 9th, not JANUARY

Re: Maximum Number of Hive Partitions = 256?

> I am sure the issue has something to do with an empty string passed to the > substr function. We can rule out the substr() function. I get the same stack trace with any query like: hive> select from ushb where dtpartition='2010-10-25' limit 10; But this query succeeds: hive> select * from u

Re: HIVE Server multiple instances

El 5/4/2011 7:48 AM, Paul Ingles escribió: For future reference I've posted a little more about our setup here: http://oobaloo.co.uk/multiple-connections-with-hive On Tue, May 3, 2011 at 8:01 PM, Paul Ingles > wrote: Nothing specifically about our Hive setup al

Re: HIVE Server multiple instances

For future reference I've posted a little more about our setup here: http://oobaloo.co.uk/multiple-connections-with-hive On Tue, May 3, 2011 at 8:01 PM, Paul Ingles wrote: > Nothing specifically about our Hive setup although some of us at Forward > have blogged bits and pieces about Hive + Hado