Re: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Ranjith
thanks guys for the clarification. What about multiple queries run through a single session? Do they get queued and executed one after the other? Thanks, Ranjith On Aug 27, 2012, at 5:27 PM, Bertrand Dechoux wrote: > Thanks a lot. > > > It's possible to live with this limitation if you're ok

Re: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Bertrand Dechoux
Thanks a lot. > It's possible to live with this limitation if you're ok with sometimes fetching other people's result sets instead of your own. I hadn't thought about that, only about the states of variables. That consequence isn't nice. It won't be a security issue really in my context but that

Re: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Carl Steinbach
Hi Bertrand, According to the proposal for HiveServer2, the current hive server provides > no insurance about "session state in between calls". > If that was all, it is something that can be lived with. It only means > that for a JDBC client, all requests should be conceived as isolated. > In the

Re: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Bertrand Dechoux
Thanks for the answers. I had already read it but both pages (and the jira) are not very explicit about the problem. According to the proposal for HiveServer2, the current hive server provides no insurance about "session state in between calls". If that was all, it is something that can be lived

Re: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Carl Steinbach
HiveServer is multi-threaded, but there is a defect in the current HiveServer Thrift API that prevents it from robustly handling concurrent connections. This problem is described in more detail here: https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Thrift+API Thanks. Carl On Mon, Au

Re: Insert Overwrite Directory fails for multiple nested directory

2012-08-27 Thread Himanish Kushary
I found out that Hive can write into multi-level directory based on the property hive.insert.into.multilevel.dirs Using set hive.insert.into.multilevel.dirs=true; and then running the query allowed me to create multi-level directory This is available since 0.8.0 . Refer to https://issues.apache.o

File permissions when creating external table

2012-08-27 Thread Zoltán Tóth-Czifra
Hi, I understand that, to create a new table in Hive with an external data source, you don't need to have write permissions to the files themselves (only the metastore). However, I receive the following error when I try to create the table with only read rights to the files. DROP TABLE IF EXIS

RE: HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Raghunath, Ranjith
Bertrand, The Hive Server is a thrift service that provides an interface for Hive. You can connect to it using JDBC. It is not sure (out of box) as there is no userid and password restrictions. On the concurrency part, it is single threaded...one query gets executed after the other. Thanks

HiveServer can not handle concurrent requests from more than one client?

2012-08-27 Thread Bertrand Dechoux
Hi, I would like to have more information about this specific sentence from the documentation. "HiveServer can not handle concurrent requests from more than one client." https://cwiki.apache.org/Hive/hiveserver.html Does it mean it is not possible with this server to provide a JDBC access to an '

RE: Hive on EMR on S3 : Beginner

2012-08-27 Thread richin.jain
Hi Ravi, The idea of using EMR is that you don't have to have a Hadoop cluster running all the time. So put all your data in S3, spin up an EMR cluster, do computation and store your data back in S3. In an ideal case data in S3 should not be moved around and Hive will always read from S3 if you

Re: Hive on EMR on S3 : Beginner

2012-08-27 Thread Ravi Shetye
Thanks to all your help I have moved ahead with my project. So I create table as CREATE TABLE test (...) PARTITIONED BY (adid STRING, dt STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION 's3://logs/' Do a *ALTER TABLE results RECOVER PARTITIONS;* and then start querying. Now the i