Hive Avro union data access

2014-05-29 Thread Valluri, Sathish
Hi, I have an Hive table created with 3 different union data types for alias_host column name as shown. (array,string, null). CREATE EXTERNAL TABLE array_tests ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{"name":"sessions",

Re: Control_A_Error

2014-05-29 Thread Rishabh Bhardwaj
Try putting the ^A character using vim editor via pressing ctrl+V then 1 then spacebar. Regards,Rishabh. On , Rishabh Bhardwaj wrote: Try putting the ^A character using vim editor via pressing ctrl+V then 1 then spacebar. Regards, Rishabh. On Friday, 30 May 2014 7:51 AM, Ashish G

Re: Control_A_Error

2014-05-29 Thread Rishabh Bhardwaj
Try putting the ^A character using vim editor via pressing ctrl+V then 1 then spacebar. Regards, Rishabh. On Friday, 30 May 2014 7:51 AM, Ashish Garg wrote: But, default is ^A, right? My question is why it is not taking? Is it an issue with hive version? Thanks and Regards, Ashish Garg

Re: Control_A_Error

2014-05-29 Thread Ashish Garg
But, default is ^A, right? My question is why it is not taking? Is it an issue with hive version? Thanks and Regards, Ashish Garg On Thu, May 29, 2014 at 9:11 PM, Siddharth Tiwari wrote: > > You can write a SerDe to handle the control character. > > **** > *Cheers !!!* >

RE: Control_A_Error

2014-05-29 Thread Siddharth Tiwari
You can write a SerDe to handle the control character. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself" Date:

Help with query

2014-05-29 Thread Software Dev
We have a table with user entered queries, their IP. How could we write a query that will count and order queries by their count having a unique IP count > X. For example if we had the same IP enter the same query Y times we wouldnlt want to include this in the final result unless there have been X

Re: problem with delimiters (control A)

2014-05-29 Thread Sanjay Subramanian
Hi Jack  Since u already have your data with columns separated by CtrlA then u need to define the HIVE table as follows  (by default Hive will assume CtrlA as column delimiter) create table if not exists my_test(     userid  BIGINT,     movieId BIGINT,     comment STRING

Help with query

2014-05-29 Thread Software Dev
We have a table with user entered queries, their IP. How could we write a query that will count and order queries by their count having a unique IP count > X. For example if we had the same IP enter the same query Y times we wouldnlt want to include this in the final result unless there have been X

Control_A_Error

2014-05-29 Thread Ashish Garg
Can you try to fix this problem? I have a local file called mytest.txt (restored in hdfs already). The content is like this: $ cat -A HDFSLOAD_DIR/mytest.txt 49139801^A25752451^Aunknown$ 49139801^A24751754^Aunknown$ 49139801^A2161696^Anice$ To load this raw data above, I then defined the t

Hive unit tests cannot load Mysql driver

2014-05-29 Thread Pavel Chadnov
Hello, I'm trying to run Hive unit tests on my local machine. At first Hive could not load Mysql driver (some tests for ql are failing). I put the mysql connector jar to the conf dir. It didn't help (tests failing) but when I choose some of the tests and run it individually (just one test class),

RE: ObjectInspectors

2014-05-29 Thread Doug Christie
I need to access the actual values sent in on the HIVEQL line for the argument list for a HIVE UDTF. Is there any way to access the those values via the ObjectInspector Array passed in to the initialize function? Thank you. Doug

Fwd: Hive unit testing and MySQL driver

2014-05-29 Thread Pavel Chadnov
Hello, I'm trying to make sure that unit tests are passed on my local machine for Hive 0.13 but for ql module I get a java.lang.ClassNotFoundException: com.mysql.jdbc.Driver. I'm running the tests using line: "mvn test -Phadoop-2" How can I have the tests passed? Thank you -- Regards, Pavel Chadn

Hive unit testing and MySQL driver

2014-05-29 Thread Pavel Chadnov
Hello, I'm trying to make sure that unit tests are passed on my local machine for Hive 0.13 but for ql module I get a java.lang.ClassNotFoundException: com.mysql.jdbc.Driver. I'm running the tests using line: "mvn test -Phadoop-2" How can I have the tests passed? Thank you -- Regards, Pavel Chad

Hive Avro union data access

2014-05-29 Thread Valluri, Sathish
Hi, I have an Hive table created with 3 different union data types for alias_host column name as shown. (array,string, null). CREATE EXTERNAL TABLE array_tests ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{"name":"session

Hive Avro union data access

2014-05-29 Thread Valluri, Sathish
Hi, I have an Hive table created with 3 different union data types for alias_host column name as shown. (array,string, null). CREATE EXTERNAL TABLE array_tests ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{"name":"sessions",

Hive Avro union data access

2014-05-29 Thread Valluri, Sathish
Hi, I have an Hive table created with 3 different union data types for alias_host column name as shown. (array,string, null). CREATE EXTERNAL TABLE array_tests ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES ('avro.schema.literal'='{"name":"sessions","t

Re: Hive can I contribute to Hive confluence wiki documents?

2014-05-29 Thread Lefty Leverenz
Thank you for pointing this out. The 'hive.cache.expr.evaluation' parameter was added by HIVE-4209 and it needs to be included in the wiki. Its description is in hive-default.xml.template: If true, evaluation result of deterministic expression ref