Re: Error in Hive on Spark

2016-03-20 Thread Stana
Does anyone have suggestions in setting property of hive-exec-2.0.0.jar path in application? Something like 'hiveConf.set("hive.remote.driver.jar","hdfs://storm0:9000/tmp/spark-assembly-1.4.1-hadoop2.6.0.jar")'. 2016-03-11 10:53 GMT+08:00 Stana : > Thanks for reply > > I have set the property s

Column type conversion in Hive

2016-03-20 Thread Mich Talebzadeh
As a matter of interest how does how cast columns from say String to Integer implicitly? For example the following shows this create table s(col1 String); insert into s values("1"); insert into s values("2"); Now create a target table with col1 being integer create table o (col1 Int); insert i

Re: How to append one column to an existing array column in Hive?

2016-03-20 Thread dhruv kapatel
You can try this select concat("A",concat_ws("",array('B','C'))); Please set separator according to your requirement. For , separator select concat_ws(",","A",concat_ws(",",array('B','C'))); On 20 March 2016 at 01:17, Rex X wrote: > For example, to append columnA to an existing array-type colu

Re: De-identification_in Hive

2016-03-20 Thread Ajay Chander
Thanks for your time Mich! I will try this one out. On Thursday, March 17, 2016, Mich Talebzadeh wrote: > Then probably the easiest option would be in INSERT/SELECT from external > table to target table and make that column NULL > > Check the VAT column here that I made it NULL > > DROP TABLE IF

Re: Re: The build-in indexes in ORC file does not work.

2016-03-20 Thread Joseph
terminal_type =0, 260,000,000 rows, almost cover half of the whole data.terminal_type =25066, just 3800 rows. orc tblproperties("orc.compress"="SNAPPY","orc.compress.size"="262141","orc.stripe.size"="268435456","orc.row.index.stride"="10","orc.create.index"="true","orc.bloom.filter.columns"

Re: Hiding staging directory data on HDFS

2016-03-20 Thread Mich Talebzadeh
Thanks. I will delve into that link. Regards, Mich Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 1

Re: hive need access the hdfs of hbase?

2016-03-20 Thread songj songj
zookeeper.znode.parent /hbase and I found it that ,bind any ip which the hive can access to 'hbase-cluster' ,they are all ok! 2016-03-17 16:46 GMT+08:00 Divya Gehlot : > Hi, > Please check your zookeeper.znode.parent property > where is it pointing to ? > > On 17 March 2016 at 15:21, s