Re: serde jar causing problems in loading other jars.

2013-01-23 Thread Ehsan Haq
Thanks Dean, i will try to remove unnesessary jars and come back with the outcome. On Jan 23, 2013 7:11 PM, "Dean Wampler" wrote: > I see from your listing that your jar contains the contents of many, if > not all, of the Apache and logging jars that are also in the hadoop/lib and > hive/lib dire

Re: serde jar causing problems in loading other jars.

2013-01-23 Thread Dean Wampler
I see from your listing that your jar contains the contents of many, if not all, of the Apache and logging jars that are also in the hadoop/lib and hive/lib directories, including the core hadoop and hive jars themselves. plus some Google, JSON, and other libraries. Most likely, this is causing iss

Re: Problem with using Postgres as hive meta store DB.

2013-01-23 Thread Ehsan Haq
Well I have tested with version 0.8.1 as well and the same postgresql schema that is working with 0.9.0 is also working with 0.8.1. /Ehsan On Wed, Jan 23, 2013 at 3:09 PM, Ehsan Haq wrote: > Hmm. I have ran it on 0.9.0, will try it on 0.8.1. However i also found an > upgrade script for mysql fr

Re: Problem with using Postgres as hive meta store DB.

2013-01-23 Thread Ehsan Haq
Hmm. I have ran it on 0.9.0, will try it on 0.8.1. However i also found an upgrade script for mysql from 0.8.0 to 0.9.0, and it didn't had anything just two select static text lines. So I thought it would be same for postgres, also the postgres schema that I am using was for version 0.7.0 which I f

Re: serde jar causing problems in loading other jars.

2013-01-23 Thread Ehsan Haq
Thanks dean, I knew about the .hiverc script, will try the other alternative of renaming jar and get back. Thanks /Ehsan On Wed, Jan 23, 2013 at 2:57 PM, Dean Wampler < dean.wamp...@thinkbiganalytics.com> wrote: > Is there anything in the logs about problems loading the jar, etc.? > > The jar fi

Re: Problem with using Postgres as hive meta store DB.

2013-01-23 Thread Dean Wampler
Are you able to use Hive v0.8.1 and v0.9.0 interchangeably? Since the metadata schema changed between versions, I wouldn't expect 0.8.1 to work if you're schema is set up for 0.9.0. dean On Wed, Jan 23, 2013 at 6:35 AM, Ehsan Haq wrote: > Thanks, that solved the problem :-) > > /Ehsan > > > On

Re: serde jar causing problems in loading other jars.

2013-01-23 Thread Dean Wampler
Is there anything in the logs about problems loading the jar, etc.? The jar files in $HVE_HOME are added to the CLASSPATH in alphabetical order. As an experiment, rename your jar with a name that will go last, something like zzz.jar, and see what happens when you start Hive. If it seems to be work

serde jar causing problems in loading other jars.

2013-01-23 Thread Ehsan Haq
Hi, I have writen a custom serde and bundle it in a jar file, which is working fine, when I add the jar using the CLI command add jar. However when I put the jar in the hive/lib folder so that I dont have to explicitly add the jar, it looks like other jars were failed to load. The outcome is tha

Re: Problem with using Postgres as hive meta store DB.

2013-01-23 Thread Ehsan Haq
Thanks, that solved the problem :-) /Ehsan On Wed, Jan 23, 2013 at 10:00 AM, wd wrote: > > On Wed, Jan 23, 2013 at 4:46 PM, Ehsan Haq wrote: > >> ERROR: invalid escape string >> Hint: Escape string must be empty or one character..) >> > > > You can set standard_conforming_strings = off in po

Re: Problem with using Postgres as hive meta store DB.

2013-01-23 Thread wd
On Wed, Jan 23, 2013 at 4:46 PM, Ehsan Haq wrote: > ERROR: invalid escape string > Hint: Escape string must be empty or one character..) > You can set standard_conforming_strings = off in postgresql.conf to avoid this.

Problem with using Postgres as hive meta store DB.

2013-01-23 Thread Ehsan Haq
Hi, I am new to hive, and I am trying to use postgresql9.1 as a meta data store for hive. I read and followed the tutorial posted by cloudera " https://ccp.cloudera.com/display/CDH4DOC/Hive+Installation#HiveInstallation-InstallingHive";. However I am unable to use it. Below are further details.

Re: Configure Hive in Cluster

2013-01-23 Thread Nitin Pawar
this is the error on hadoop job 2013-01-23 12:15:44,884 INFO org.apache.hadoop.mapred.ReduceTask: Failed to fetch map-output from attempt_201301231151_0002_m_01_0 even after MAX_FETCH_RETRIES_PER_MAP retries... or it is a read error, reporting to the JobTracker 2013-01-23 12:15:44,885 FATAL