Re: Hive - Issue Converting Text to Orc

Bryan In either cases (source download or binary download) you do not need to compile orc protobuf component. The java source from .proto files should be already available when you download hive 0.12 release. I would recommend re-downloading hive 0.12 binary release from http://mirror.symnds.c

Re: Hive - Issue Converting Text to Orc

Prasanth, I simply compiled the protobuf library, and then compiled the orc protobuf component. I did not recompile either Hive or custom UDFs/etc. Is a protobuf recompile the solution for this issue, or a dead end? Has this been seen before? I looked for more feedback, but most of the Orc iss

Re: Hive - Issue Converting Text to Orc

Also what are you doing with steps 2 through 5? Compiling hive or your custom code? Thanks Prasanth Jayachandran On Dec 16, 2013, at 4:55 PM, Bryan Jeffrey wrote: > Prasanth, > > I am running Hive 0.12.0 downloaded from the Apache Hive site. I did not > compile it. I downloaded protobuf 2.

Re: Hive - Issue Converting Text to Orc

AFAIK, hive 0.12 uses protobuf 2.4 version to compile orcproto.proto. Since you are using protobuf 2.5 there might be incompatibility of protobuf versions. Can you try downloading protobuf 2.4.1 from https://code.google.com/p/protobuf/downloads/list and repeating your steps again? Thanks Prasa

Re: Hive - Issue Converting Text to Orc

Prasanth, I am running Hive 0.12.0 downloaded from the Apache Hive site. I did not compile it. I downloaded protobuf 2.5.0 earlier today from the Google Code site. I compiled it via the following steps: (1) ./configure && make (to compile the C code) (2) protoc --java_out=src/main/java -I../src

Re: Hive - Issue Converting Text to Orc

What version of protobuf are you using? Are you compiling hive from source? Thanks Prasanth Jayachandran On Dec 16, 2013, at 4:30 PM, Bryan Jeffrey wrote: > Hello. > > Running the following version of Hadoop: hadoop-2.2.0 > Running the following version of Hive: hive-0.12.0 > > I have a simpl

Hive - Issue Converting Text to Orc

Hello. Running the following version of Hadoop: hadoop-2.2.0 Running the following version of Hive: hive-0.12.0 I have a simple test system setup with (2) datanodes/node manager and (1) namenode/resource manager. Hive is running on the namenode, and contacting a MySQL database for metastore. I

Bucketing issues with Hive table

Hi Guys, We have an avro backed production table bucketed by a column and it works fine with the old Hive = 0.7 on chd3u2. Now we have moved to Hive 0.12 on HDP 2.0 and are getting bucketing issues with this table. Below is the create table statement CREATE TABLE test_bucketing PARTITIONED BY

Hive over Hbase and slow query of sample data

Hello, I have a HIVE over HBASE setup using two decent sized machines. I put 1 row of sample data and a count(1) query takes roughly 10 minutes. A select * of that 1 row runs in 0.2 seconds I am using latest production cloudera dist (CDH4) and followed along https://cwiki.apache.org/confluence/di

Re: Question about running Hive on Tez

Closing the loop. We identified the issue with help from the Tez team. It was mis-configured mapreduce.reduce.cpu.vcores that caused problems. If anyone who tries Hive on Tez with EMR Hadoop and sees that reducers are stuck, this