Re: how to make async call to hive

2013-09-29 Thread Vaibhav Gumashta
Hi Gary, HiveServer2 has recently added an API to support asynchronous execution: https://github.com/apache/hive/blob/trunk/service/if/TCLIService.thrift#L604 You will have to create an instance of Thrift HiveServer2 client and while creating the request object for ExecuteStatement, set runAsync

Re: how to make async call to hive

2013-09-29 Thread Gary Zhao
I'm using node.js which is async. On Sun, Sep 29, 2013 at 5:32 PM, Brad Ruderman wrote: > Typically it be your application that opens the process off the main > thread. Hue (Beeswax specifically) does this and you can see the code here: > https://github.com/cloudera/hue/tree/master/apps/beeswax

Re: how to treat an existing partition data file as a table?

2013-09-29 Thread York Yao
Bucket the table and use TABLESAMPLE clause? york From: Yang mailto:tedd...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Sunday, September 29, 2013 3:39 PM To: "hive-u...@hadoop.apache.org"

Re: how to make async call to hive

2013-09-29 Thread Brad Ruderman
Typically it be your application that opens the process off the main thread. Hue (Beeswax specifically) does this and you can see the code here: https://github.com/cloudera/hue/tree/master/apps/beeswax Thx On Sun, Sep 29, 2013 at 5:15 PM, kentkong_work wrote: > ** > hi all, > just wonder if th

how to make async call to hive

2013-09-29 Thread kentkong_work
hi all, just wonder if there is offical solution for async call to hive? hive query runs so long time, my application can't block until it returns. Kent

Re: how to treat an existing partition data file as a table?

2013-09-29 Thread Sonal Goyal
Is your table partitioned ? Sent from my iPad On Sep 30, 2013, at 2:09 AM, Yang wrote: > we have a huge table, including browsing data for the past 5 years, let's > say. > > now I want to take a few samples to play around with it. so I did > select * from mytable limit 10; > but it actually

how to treat an existing partition data file as a table?

2013-09-29 Thread Yang
we have a huge table, including browsing data for the past 5 years, let's say. now I want to take a few samples to play around with it. so I did select * from mytable limit 10; but it actually went full out and tried to scan the entire table. is there a way to kind of create a "view" pointing to o

Converting from textfile to sequencefile using Hive

2013-09-29 Thread Saurabh Bhatnagar (Business Intelligence)
Hi, I have a lot of tweets saved as text. I created an external table on top of it to access it as textfile. I need to convert these to sequencefiles with each tweet as its own record. To do this, I created another table as a sequencefile table like so - CREATE EXTERNAL TABLE tweetseq( tweet ST