How to "create table as " in HIVE using avro format?

I met some problems in using HIVE to process avro formatted files. Could anyone help me? Basically, I have an avro-formatted HIVE table defined as follows: create external table if not exists AvroTestTable row format serde 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' stored as inputf

RE: ERROR 1115: Unsupported type: 5 in Pig's schema

I have Pig and Hive v0.12 . From: D K [mailto:deepe...@gmail.com] Sent: Monday, July 07, 2014 7:35 PM To: user@hive.apache.org Subject: Re: ERROR 1115: Unsupported type: 5 in Pig's schema What version of Pig and Hive you are using? Boolean support was added in Pig v0.10 and in the HCatStorer in

Re: Hive User Group Meeting

I am staying in New Jersey, would be able to help over weekend and during event days Please consider me in host committee On Monday, July 7, 2014, Xuefu Zhang wrote: > Dear Hive users, > > Hive community is considering a user group meeting during Hadoop World > that will be held in New York Oc

Hive User Group Meeting

Dear Hive users, Hive community is considering a user group meeting during Hadoop World that will be held in New York October 15-17th. To make this happen, your support is essential. First, I'm wondering if any user, especially those in New York area would be willing to host the meetup. Secondly,

Issues configuring LDAP on Hive server 2

Hi Users/Developers/Committers We use Amazons EMR for our Hadoop needs. We needed to configure LDAP for HiveServer2 so that only a specific set of users in LDAP say like Groups=HiveUser. We are unable to configure this. Our LDAP URL definition is ignored by the hive server and allows any valid LD

Re: beeline remote client not connecting to hiveserver2

How about try this? hive --service beeline -u jdbc:hive2://hiveservice:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice In your previous response I see that you have "hive.server2.thrift.http.port=10001" On Thu, Jul 3, 2014 at 5:15 AM, Hang Chan wrote: >

Re: ERROR 1115: Unsupported type: 5 in Pig's schema

What version of Pig and Hive you are using? Boolean support was added in Pig v0.10 and in the HCatStorer in Hive v0.12. On Wed, Jul 2, 2014 at 7:07 AM, Carlotta Hicks wrote: > Yes. Here is a row of data: > > > > > cust_1,M,56,D,Hopatcong,NJ,7843,15-May-74,15-May-77,88.00,43,688.00,458.00,N >

RE: Querying a time stamp

Try WHERE dataofbirth=unix_timestamp("2011-10-08 00:00:00"); From: Bhuvana Bellala [mailto:bhuvana.bell...@cormac-corp.com] Sent: Monday, July 07, 2014 9:01 PM To: user@hive.apache.org Subject: Querying a time stamp Hi, I have a column called dateofbirth in my hive table and the date of birth is

Querying a time stamp

Hi, I have a column called dateofbirth in my hive table and the date of birth is stored as a BigInt (Unix_timestamp). Now I want to query this table using this query SELECT * FROM mytable WHERE dataofbirth=unix_timestamp('2011-10-08'); However, this query is returning 0 results but I know ther

Hive date datatype serialization

Hi, Currently I am importing data from a MySQL table using sqoop as avrodata. Then I am using the schema to generate a hive table structure. However, hive does not preserve the date datatype, rather it just stores the date as BigInt. Is there any way I can store the date as an actual date in

Re: Possible memory leak with 0.13 and JDBC

Hi Benjamin, Unfortunately this was a really critical issue for us and I didn’t think we would find a fix in time so we switched  to generating a hive scripts programmatically then running that via an Oozie action which uses the Hive CLI.  This seems to create a stable solution although is a lot

Re: Possible memory leak with 0.13 and JDBC

I believe I am having the same issue. Hive 0.13 and Hadoop 2.4. We had to increase the Hive heap to 4 GB which allows Hive to function for about 2-3 days. After that point it has consumed the entire heap and becomes unresponsive and/or throws OOM exceptions. We are using Beeline and HiveServer