Getting a weird error when using the ngrams function

2011-06-20 Thread Matthew Rathbone
va:470) at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:247) What does 'mismatch in value for n' mean? My query is super simple: select ngrams(sentences(text), 1, 50) from messages -- Matthew Rathbone Foursquare | Software Engineer | Server Engineering Team matt...@foursquare.com (mailto:matt...@foursquare.com) | @rathboma (http://twitter.com/rathboma) | 4sq (http://foursquare.com/rathboma)

Re: HIVE Server multiple instances

2011-05-03 Thread Matthew Rathbone
Hey Paul, I'd be very interested in reading about your hadoop/hive setup, do you have a blog post or anything describing this setup, or some of the issues you've have with hive? -- Matthew Rathbone Foursquare | Software Engineer | Server Engineering Team matt...@foursquare.com |

Re: HIVE Server multiple instances

2011-05-03 Thread Matthew Rathbone
cklog. So, I was that's why I was > wondering > whether I can run two or more instances to avoid having a big backlog in > queue. > > > > - Original Message > From: Matthew Rathbone > To: user@hive.apache.org > Sent: Tue, May 3, 2011 7:46:49 AM > Su

Re: HIVE Server multiple instances

2011-05-03 Thread Matthew Rathbone
Why would you want to run two? I think it is multithreaded, so you can query it from two different connections -- Matthew Rathbone Foursquare | Software Engineer | Server Engineering Team matt...@foursquare.com | @rathboma | 4sq On Monday, May 2, 2011 at 6:41 PM, V.Senthil Kumar wrote: Hello

Re: Export data with column names

2011-05-03 Thread Matthew Rathbone
If you use the thrift client you can call connection.getSchema() -- Matthew Rathbone Foursquare | Software Engineer | Server Engineering Team matt...@foursquare.com | @rathboma | 4sq On Monday, May 2, 2011 at 11:12 PM, Raghunath, Ranjith wrote: Does anyone know how to export data out with

Re: Adding a temporary function for thirft queries

2011-03-28 Thread Matthew Rathbone
tate gets reset between executes? On Mon, Mar 28, 2011 at 10:57 AM, Edward Capriolo wrote: > On Mon, Mar 28, 2011 at 10:53 AM, Matthew Rathbone > wrote: > > Hey guys, > > I could really do with some expert-hive help on my issue, my > hive-expertise > > are not all that grea

Re: Adding a temporary function for thirft queries

2011-03-28 Thread Matthew Rathbone
n calls. > > So I tried prepending the query with the function creation calls, but then > I don't get any data back from hive (simply an empty array). > > Could someone direct me to the best way to add functions for thrift > queries? Honestly I'd rather add them permane

Adding a temporary function for thirft queries

2011-03-24 Thread Matthew Rathbone
Hey all, We use Amazon's elastic mapreduce and Hive 0.7 to run analytics queries, and I'm having problems dynamically adding functions for use in the thrift server. I want to add a jar, add a function, then execute a query. Using ruby as the example, I've tried: Hive.connect(@url, @port)