Re: Managed vs external tables in hive

2012-05-12 Thread Raja Thiruvathuru
No indexing in hive. On Sunday, May 13, 2012, Ranjith wrote: > Indexes can be built on tables managed by hive. For external tables I do > not believe that to be true. Please feel to correct if I am wrong. > > Thanks, > Ranjith > > On May 12, 2012, at 9:24 PM, Nanda Vijaydev > 'nanda.vijay...@g

Re: Managed vs external tables in hive

2012-05-12 Thread Ranjith
Indexes can be built on tables managed by hive. For external tables I do not believe that to be true. Please feel to correct if I am wrong. Thanks, Ranjith On May 12, 2012, at 9:24 PM, Nanda Vijaydev wrote: > In hive, the raw data is in HDFS and there is a metadata layer that defines > the st

Re: Re: Is there a metastore schema script for postgresql for Hive version 0.9.0

2012-05-12 Thread Xiaobo Gu
Thanks, I will try that. Xiaobo Gu From: Carl Steinbach Date: 2012-05-13 10:30 To: user CC: guxiaobo1982 Subject: Re: Is there a metastore schema script for postgresql for Hive version 0.9.0 Hi Xiabo, Upgrade/schema scripts for Postgres were committed to trunk last week in HIVE-2529 (http

Re: Is there a metastore schema script for postgresql for Hive version 0.9.0

2012-05-12 Thread Carl Steinbach
Hi Xiabo, Upgrade/schema scripts for Postgres were committed to trunk last week in HIVE-2529 (https://issues.apache.org/jira/browse/HIVE-2529). This patch includes schema DDL for Hive 0.8.0 and 0.9.0, as well as an 0.7.0->0.8.0 upgrade script. Right now these scripts are only available in the sour

Re: Managed vs external tables in hive

2012-05-12 Thread Nanda Vijaydev
In hive, the raw data is in HDFS and there is a metadata layer that defines the structure of the raw data. Table is usually a reference to metadata, probably in a mySQL server and it contains a reference to the location of the data in HDFS, type of delimiter or serde to use and so on. 1. With hive

Re: Looking for a working mysql import sqoop command line

2012-05-12 Thread Arvind Prabhakar
Hi David, A typical MySQL import will look like: $ sqoop import --connect jdbc:mysql://localhost/mydb --username user --password pswd --table mytable Depending upon what you are trying to do and the datatypes that you have in your MySQL table, you may have to provide different options. If you ne

Looking for a working mysql import sqoop command line

2012-05-12 Thread David Morel
Hi everyone, I must say I'm only starting, and this is on cdh3u3. I'm struggling with the sqoop options ATM, trying to import mysql tables to hive, containing tabs, newlines, and all sorts of things. I cannot figure out a proper combination of options on the sqoop command line to turn these

Re: Is there a metastore schema script for postgresql for Hive version 0.9.0

2012-05-12 Thread Ashutosh Chauhan
Hi Xiaobo, It depends on what your current setup is: a) If you are trying Hive for the first time, then you don't necessarily need to create schema in postgres upfront. As wd suggested, datanucleus (ORM used by Hive) can autocreate the schema if it doesn't exist. b) If you are already using Hive 0

Re: Is there a metastore schema script for postgresql for Hive version 0.9.0

2012-05-12 Thread wd
Hive can auto create metadata tables, maybe you can try it out. On Sat, May 12, 2012 at 2:28 PM, Xiaobo Gu wrote: > I can't find it in the release package. > > > Xiaobo Gu

How to create index on HBase?

2012-05-12 Thread ransom.hezhiqiang
Hi all I create index on hbase faild . This is my sql. How to create index on HBase? create index i_hhive on hhive(c1,c2) as "compact" with deferred rebuild STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:val,cf1:val2,cf1:va

Re: RE: Where should I put JDBC drivers for metastore service

2012-05-12 Thread Xiaobo Gu
I am sorry, I forget starting hadoop first, but the error messages are confusing too :) Xiaobo Gu From: ransom.hezhiqiang Date: 2012-05-12 15:46 To: user@hive.apache.org; 'guxiaobo1982' Subject: RE: Where should I put JDBC drivers for metastore service javax.jdo.option.Connection

RE: Where should I put JDBC drivers for metastore service

2012-05-12 Thread ransom.hezhiqiang
javax.jdo.option.ConnectionURL jdbc:mysql:// 192.168.72.1:3306/hive?createDatabaseIfNotExist=true JDBC connect string for a JDBC metastore If it doen't work, show the log in /tmp/{user.name}/hive.log Best regards Ransom. -Original Message- Fr

Where should I put JDBC drivers for metastore service

2012-05-12 Thread Xiaobo Gu
Hi, I put mysql-connector-java-5.1.20-bin.jar into $HIVE_HOME/lib, and configurations in hive-site.xml are javax.jdo.option.ConnectionURL jdbc:mysql://192.168.72.1:3306/hive JDBC connect string for a JDBC metastore javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver Drive