Re: Logging MySQL queries

MySQL has query logging, also mysql-proxy exists. Edward On Tue, May 24, 2011 at 8:01 PM, Steven Wong wrote: > I am using Amazon EMR. I have discovered that setting those log4j > categories has the desired effect in EMR Hive 0.5, but has no effect in EMR > Hive 0.7 beta version. > > > > Setting

Re: elephant-bird with Hive

I generated data with com.twitter.elephantbird.mapreduce.output.LzoProtobufBlockOutputFormat, but Hive doesn't allow me to use com.twitter.elephantbird.mapreduce.input.LzoProtobufBlockInputFormat in create table statement. Does anyone have an example how to make Lzo format work with binary data in

RE: Logging MySQL queries

I am using Amazon EMR. I have discovered that setting those log4j categories has the desired effect in EMR Hive 0.5, but has no effect in EMR Hive 0.7 beta version. Setting them in Apache Hive 0.7 release version (on my computer, with Derby instead of MySQL) has the desired effect also. From:

RE: hive storing a byte array

I claim no experience in storing blobs in Hive, but it sounds to me that using array/list will be quite inefficient, in terms of both size and run time. -Original Message- From: Luke Forehand [mailto:luke.foreh...@networkedinsights.com] Sent: Tuesday, May 24, 2011 7:31 AM To: user@hive.

elephant-bird with Hive

Can someone share Hive queries used to create the table with Elephant-bird (ProtoBuf) SerDe? Sorry, if it was covered, I am new to the list. Thx. -- valentina kroshilina

Re: hive storing a byte array

Steven, Thanks for your reply! I have written it the way you mentioned, based on an earlier post in this mailing list. I'm concerned about having to encode/decode the string in base64, I'm wondering how much this will impact my job run time. I have also written a UDF that emits a byte array, st

Re: EOFException

Check out the xcievers http://tech.backtype.com/the-dark-side-of-hadoop Tom On Sun, May 22, 2011 at 9:38 AM, Guy Doulberg wrote: > Hey, > > > > I am dealing with  a problem I just don't understand, maybe you could help > me… > > > > I have an external table, that is partitioned by date (for exam

Re: An issue with Hive on hadoop cluster -- Resolved

Finally Got It ! Here's the full story I started with running hive on a single node hadoop cluster. And our metastore was on a mysql instance. At that time, namenode uri was localhost:54310 Then it was decided to add more nodes to the cluster. And modified all the *-site.xml files where ever rele

Re: An issue with Hive on hadoop cluster

Thanks for the suggestions. I had tried out by specifying only the ips instead of hostnames, but now I modified the /etc/hosts file as suggested below, appropriately. Still no success. If I use IPs instead of hostnames I get the below error in the hive cli. *2011-05-24 14:42:53,485 ERROR ql.Drive

Re: An issue with Hive on hadoop cluster

Hi, I had similar problems when I was setting up my hadoop cluster. The Datanodes where trying to access localhost instead of my namenode. To fix this issue I modified my /etc/hosts file on all my nodes (namenode + datanodes) in such a way that the first line corresponds to the binding hostname>.