HBaseBulkLoad from Hive question.

2013-01-08 Thread Benyi Wang
I encountered a problem when I follow this page: https://cwiki.apache.org/Hive/hbasebulkload.html. Our hbase need ints and doubles in binary format. And HBaseIntegration can do this mapping. How can I do the bulk load with binary data? Does this line in the hbasebulkload page means, no binary dat

Re: Bad performance of Hive meta store for tables with large number of partitions

2012-11-30 Thread Benyi Wang
Does JDO support the features in EclipseLink in this article? http://java-persistence-performance.blogspot.com/2010/08/batch-fetching-optimizing-object-graph.html On Fri, Nov 30, 2012 at 11:36 AM, Benyi Wang wrote: > We have some tables with 15K ~ 20K partitions. If I run a query scannin

hive.merge properties with RCFile

2012-06-18 Thread Benyi Wang
I try to use Hive merge options to merge the smallfiles into a large files using the following query. It is working well except that I cannot control the output file size. I cannot explain why the output files are always 256MB using the following hive.merge.size.per.task and hive.merge.smallfiles.a

Re: Hive server concurrent connection

2012-05-01 Thread Benyi Wang
client connection. > > I hope this clarifies the limitations of the current HiveServer > implementation as well as the motivations for implementing HiveServer2. > Please let me know if you have any more questions. > > Thanks. > > Carl > > On Thu, Apr 26, 2012 at 11:55 AM

Hive server concurrent connection

2012-04-26 Thread Benyi Wang
I'm a little confused with "In fact, it's impossible for HiveServer to support concurrent connections using the current Thrift API" in hive wiki page https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Thrift+API. I started a hive server on hostA using cdh3u3 hadoop-hive.noarch

[jira] [Created] (HIVE-2818) Create table checks the current database privilege

2012-02-23 Thread Benyi Wang (Created) (JIRA)
Reporter: Benyi Wang Hive seems check the current database to determine the privilege of a statement when you use fully qualified name like 'database.table' {code} hive> set hive.security.authorization.enabled=true; hive> create database test_db; hive> grant all on datab

[jira] [Created] (HIVE-2817) Drop any table even without privilege

2012-02-23 Thread Benyi Wang (Created) (JIRA)
Drop any table even without privilege - Key: HIVE-2817 URL: https://issues.apache.org/jira/browse/HIVE-2817 Project: Hive Issue Type: Bug Affects Versions: 0.7.1 Reporter: Benyi Wang You

Re: [jira] [Updated] (HIVE-842) Authentication Infrastructure for Hive

2012-02-06 Thread Benyi Wang
Hi, I'm wondering if Hive Server supports Kerberos authentication or not. Look like it doesn't support yet as said in Hive-2743. Which does HIVE-842 resolve? HiveMetaStore Kerberos Authentication? Thanks. On Thu, Feb 2, 2012 at 2:22 PM, Carl Steinbach (Updated) (JIRA) < j...@apache.org> wrote: