Re: hbase importtsv

2014-02-14 Thread Matouk IFTISSEN
hello, You can use bulkload in to pahses, in MapR distribution we use this: 1. first phase : map metadata to table hbase hadoop jar /opt/mapr/hbase/hbase-0.94.5/hbase-0.94.5-mapr.jar importtsv -Dimporttsv.separator=';' -Dimporttsv.bulk.output=folder_bulk_local -Dimporttsv.columns=HBASE_ROW_KEY

hive13 release date

2014-02-14 Thread Suhas Satish
Is there a ball park for planned release date of hive 0.13 ? Thanks, Suhas.

Hive & HDFS Network Encryption

2014-02-14 Thread Bryan Jeffrey
Hello. I'm running Hadoop 2.2.0 and Hive 0.12.0. Hadoop supports encryption of client writes to the data node, as described under 'Data Transfer Protocol' here: http://hortonworks.com/blog/wire-encryption-hadoop/. The encryption appears to work for simple hadoop commands (copyFromLocal, load dat

Julian Date Conversion?

2014-02-14 Thread Martin, Nick
Have a Julian date I need to convert... is there a date func for that in Hive 12?

hbase importtsv

2014-02-14 Thread Kennedy, Sean C.
I am trying to load 1.4M records in a 7 column CSV file into hbase. Question 1: Is this feasible? Question 2: What type of tuning on hbase and or hdfs would be needed? I am using apache hbase 0.94.15 and apache hadoop 1.2.1 Here is my command string: /hd/hadoop/bin/hadoop jar /hbase/hbase

Re: Mapping HBase column qualifier with a ':' in it

2014-02-14 Thread kulkarni.swar...@gmail.com
Hi Den, Have you tried escaping the additional colon in the qualifier name? On Fri, Feb 14, 2014 at 9:47 AM, Den wrote: > I'm working with an HBase database with a column of the form 'cf:q1:q2' > where 'cf' is the column family 'q1:q2' is the column qualifier. When > trying to map this in Hive

Mapping HBase column qualifier with a ':' in it

2014-02-14 Thread Den
I'm working with an HBase database with a column of the form 'cf:q1:q2' where 'cf' is the column family 'q1:q2' is the column qualifier. When trying to map this in Hive I'm using a statement like the following: CREATE EXTERNAL TABLE t ( id string q1_q2 string ) WITH SERDEPROPERTIES ("hbase.col

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Sreenath
sure that will do what is required thanks nitin On Fri, Feb 14, 2014 at 4:38 PM, Nitin Pawar wrote: > hive -e " select * from table limit 3" > localfile > > will above do for what you want to do? > > > On Fri, Feb 14, 2014 at 4:36 PM, Sreenath wrote: > >> meaning i want the output in a local di

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Nitin Pawar
hive -e " select * from table limit 3" > localfile will above do for what you want to do? On Fri, Feb 14, 2014 at 4:36 PM, Sreenath wrote: > meaning i want the output in a local directory without it scanning through > the whole table > > > On Fri, Feb 14, 2014 at 4:27 PM, Nitin Pawar wrote: >

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Sreenath
meaning i want the output in a local directory without it scanning through the whole table On Fri, Feb 14, 2014 at 4:27 PM, Nitin Pawar wrote: > what do you mean workaround for this ? its not a problem > > > On Fri, Feb 14, 2014 at 4:26 PM, Sreenath wrote: > >> hi all, >> really appreciate the

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Nitin Pawar
what do you mean workaround for this ? its not a problem On Fri, Feb 14, 2014 at 4:26 PM, Sreenath wrote: > hi all, > really appreciate the responses do you have any means as a work around for > this ? > > > On Fri, Feb 14, 2014 at 4:22 PM, shashwat shriparv < > dwivedishash...@gmail.com> wrote

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Sreenath
hi all, really appreciate the responses do you have any means as a work around for this ? On Fri, Feb 14, 2014 at 4:22 PM, shashwat shriparv < dwivedishash...@gmail.com> wrote: > Because when you do select * the query just has to read and return the > resultl but when you give query under query

Re: Sampling from a single column

2014-02-14 Thread Lefty Leverenz
> > ... saw a simple sample() function while browsing the documentation ... I grepped an export of the Hive wiki for 'sample(' and 'sample (' but only found tablesample in these three docs: - https://cwiki.apache.org/confluence/display/Hive/Tutorial#Tutorial-Sampling - https://cwiki.

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread shashwat shriparv
Because when you do select * the query just has to read and return the resultl but when you give query under query suffle sort and comparison happens thats why mapreduce... *Warm Regards_**∞_* * Shashwat Shriparv* [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9]

Re: INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Nitin Pawar
when you are writing a file, it will need an application to create and write the file. Thats why the mapreduce job to create the file. Where as for other way when its displayed on console, its just hdfs cat operation On Fri, Feb 14, 2014 at 4:13 PM, Sreenath wrote: > i have two queries > 1. se

INSERT OVERWRITE LOCAL DIRECTORY

2014-02-14 Thread Sreenath
i have two queries 1. select * from tab1 limit 3; this returns the 3 rows quickly withoput launcing any map reduce jobs; 2. INSERT OVERWRITE LOCAL DIRECTORY "/tmp/query1/" select * from tab1 limit 3; but the same above query to write to a local directory launches a map reduce job and scans throug

Re: Configuring Apache Hive using Kerberos Authentication

2014-02-14 Thread Lefty Leverenz
If the Hive wikidocs need improvement, please let me know what to change (or do it yourself if you have edit access). Thanks. -- Lefty On Thu, Feb 13, 2014 at 9:52 AM, Prasad Mujumdar wrote: > > On the client side, you need to run kinit manually. Beeline doesn't > support getting TGT program