Re: column selection for insert

2015-02-26 Thread Siddharth Tiwari
Not yet ! Sent from my iPhone > On Feb 26, 2015, at 8:23 PM, Srinivas Thunga > wrote: > > Hi, > > Thanks for the prompt response. > > Cann't i insert specific columns which i want? > > Like we do in oracle. > > Thanks & Regards, > > Srinivas T > >> On Thu, Feb 26, 2015 at 8:55 PM, Ala

Re: hadoop command

2015-02-18 Thread Siddharth Tiwari
Compile native libraries and put them in path. Sent from my iPhone > On Feb 17, 2015, at 11:24 PM, Baveja, Ankush wrote: > > Hi, > > Newbie and trying to do some custom script. Not exactly hive related, so > kindly bear > > When I run hadoop fs –ls, I get below output > > [root@node3 co

Re: Which [open-souce] SQL engine atop Hadoop?

2015-01-30 Thread Siddharth Tiwari
Have you looked at HAWQ from Pivotal ? Sent from my iPhone > On Jan 30, 2015, at 4:27 AM, Samuel Marks wrote: > > Since Hadoop came out, there have been various commercial and/or open-source > attempts to expose some compatibility with SQL. Obviously by posting here I > am not expecting an un

Re: Yarn Containers using all the space

2014-08-16 Thread Siddharth Tiwari
Whats the value set in yarn-site ? Can you paste here ? Sent from my iPhone > On Aug 16, 2014, at 8:19 PM, "karthik Srivasthava" > wrote: > > So i tried using these > > set yarn.nodemanager.resource.memory-mb ; > set yarn.scheduler.maximum-allocation-mb; > > Even though, one yarn_tez

Re: Yarn Containers using all the space

2014-08-16 Thread Siddharth Tiwari
Limit the maximum usable memory by Yarn Sent from my iPhone > On Aug 16, 2014, at 12:16 PM, "karthik Srivasthava" > wrote: > > I am using TEZ as Hive Execution Engine. When i run a query , Yarn Containers > are using all the space available in node. This doesnt allow another query to > run.

Re: HDFS Overwriting undo

2014-06-02 Thread Siddharth Tiwari
Sorry Amzad, I am afraid u can't Sent from my iPhone > On May 30, 2014, at 3:12 AM, "Amjad ALSHABANI" wrote: > > Hello Everybody, > > I know that this question may concern Hadoop list but i ve made this mistake > when using Hive. > I created new database giving the location on HDFS but i fo

RE: Control_A_Error

2014-05-29 Thread Siddharth Tiwari
You can write a SerDe to handle the control character. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit

Re: READING FILE FROM MONGO DB

2014-03-26 Thread Siddharth Tiwari
> } > This is just a very simple eg fr reference but we have a complex Json format > with huge amount of data. > > So, in this case how can we load it into hive tables and hdfs? >> On Mar 26, 2014 10:59 PM, wrote: >> Are you swagatika mohanty? >> >>

Re: READING FILE FROM MONGO DB

2014-03-26 Thread Siddharth Tiwari
Hi Swagatika You can create external tables to Mongo and can process it using hive. New mongo connectors have added support for hive. Did you try that? Sent from my iPhone > On Mar 26, 2014, at 9:59 AM, "Swagatika Tripathy" > wrote: > > Hi, > We have some files stored in MongoDB , mostly in k

RE: Query hangs at 99.97 % for one reducer in Hive

2014-03-02 Thread Siddharth Tiwari
on: Hive Runtime Error while processing row (tag=1) {"key":{"joinkey0":""},"value":{"_col2":"92","_col11":"-60-01-21,00","_col12":"-03-07-04,00"},"alias":1} at org.apache.hadoop.hiv

Row exception inhive

2014-03-02 Thread Siddharth Tiwari
.doAs(UserGroupInformation.java:1408) at org.apache.hadoop.mapred.Child.main(Child.java:262) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=1) {"key":{"joinkey0":""},"value":{"_col2":"

Query hangs at 99.97 % for one reducer in Hive

2014-03-02 Thread Siddharth Tiwari
node cluster running cdh 4.3. Please try to locate what can be teh issue. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself"

Seeing strange error in Hive

2014-03-01 Thread Siddharth Tiwari
-36_812 I am using hive-10.x , hadoop-2.0.0,. Appreciate any help in understanding the issue. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people w

Re: Unable to delete partitions

2014-01-23 Thread Siddharth Tiwari
You are welcome !!! Sent from my iPhone > On Jan 23, 2014, at 8:59 PM, "prashant gokhale" > wrote: > > Perfect! I was able to drop partition using IGNORE PROTECTION. Thanks > Siddharth. > > -Prashant > > >> On Thu, Jan 23, 2014 at 5:37 PM,

Re: Unable to delete partitions

2014-01-23 Thread Siddharth Tiwari
Try IGNORE PROTECTION clause. I gues you had used NO DROP CASCADE clause when you created the same. Sent from my iPhone > On Jan 23, 2014, at 4:28 PM, "prashant gokhale" > wrote: > > Hello all, > > I am working with some existing hive tables and I am having trouble deleting > partitions. I

Hive throwing strange error

2013-09-11 Thread Siddharth Tiwari
Hi Team I am getting following error when I am trying to load csv file in my hive table:- FAILED: Parse Error: line 1:71 character '' not supported here Can you please explain whats this error and its resolution ? ** Cheers !!! Siddharth Tiwari Have a refr

Strange hive error

2013-09-11 Thread Siddharth Tiwari
Hi TeamI am getting following error when I am trying to load csv file in my hive table:-FAILED: Parse Error: line 1:71 character '' not supported here Can you please explain whats this error and its resolution ? ** Cheers !!! Siddharth Tiwari Have a refr

Removing queues

2013-08-25 Thread Siddharth Tiwari
Whats the easiest way to remove queues from hadoop without restarting services ? Why cant we just refreshqueues ? Sent from my iPhone

Re: Export to RDBMS directly

2013-07-17 Thread Siddharth Tiwari
Why dont you try implementing that and contributing it to community ? Sent from my iPhone On Jul 17, 2013, at 10:18 PM, "Omkar Joshi" wrote: > I read of the term ‘JDBC Storage Handler’ at > https://issues.apache.org/jira/browse/HIVE-1555 > > The issues seems open but I just want to confirm

RE:

2013-07-02 Thread Siddharth Tiwari
Please stop spamming the list. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself" > D

Fwd: Hive accessing metastore

2013-03-21 Thread Siddharth Tiwari
Sent from my iPhone Begin forwarded message: > From: Siddharth Tiwari > Date: 21 March 2013 7:43:41 AM MST > To: hive user list > Subject: Hive accessing metastore > > Hi team, > > What we have observed is, hive creates so many connections to metastore > (mysql

Hive accessing metastore

2013-03-21 Thread Siddharth Tiwari
possible to limit the number of maximum connections hive could make to mysql metastore ? Or is it possible to limit number of maximum jobs than can be submitted to hive at anytime ? Please help Thanks in advance. ** Cheers !!! Siddharth Tiwari Have a refreshing day

Important information required about Hive metastore connections

2013-03-18 Thread Siddharth Tiwari
. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself"

Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Siddharth Tiwari
Hey Team, We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table. Please help ** Cheers !!! Siddharth Tiwari Have a

RE: namenode starting error

2012-07-07 Thread Siddharth Tiwari
Can you paste your namenode log here ? ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” "Maybe other people will try to limit me but I don't limit myself&

RE: Compressed data storage in HDFS - Error

2012-06-06 Thread Siddharth Tiwari
There is something you gain and something you loose. Compression would reduce IO through increased cpu work . Also you would receive different experience for different tasks ie HDFS read , HDFS write , shuffle and sort . So to go for compression or not depends on your usages . Sent from my N8

RE: HADOOP_HOME

2012-06-02 Thread Siddharth Tiwari
DO this:- nano ~/.bashrc add following lines:- export HADOOP_HOME= (path to your hadoop bin directory) #done ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! "Every duty is holy, and devotion to duty is the highest form of worship of God.” Date: S

DDL execution error

2011-10-05 Thread Siddharth tiwari
please help me out in following error, I encounter it on cygwin hive> show tables > ; FAILED: Hive Internal Error: java.lang.IllegalArgumentException(java.net.URISyntaxException: Relative path in absolute URI: file 03-11-05_208_1818592223695168110) java.lang.IllegalArgumentException: java.ne

RE: Decommission of datanode(Urgent)

2011-09-19 Thread Siddharth Tiwari
and port and then refreshnode. It should work. ** Cheers !!! Siddharth Tiwari TCS world wide Data warehouse and Analytic Team - Americas Have a refreshing day !!! Date: Mon, 19 Sep 2011 18:51:28 +0530 Subject: Re: Decommission of datanode(Urgent) From: vikas.srivast

RE: Decommission of datanode(Urgent)

2011-09-19 Thread Siddharth Tiwari
rminated at any time by editing the configuration or the exclude files and repeating the -refreshNodes command. hope it helps. *----* Cheers !!! Siddharth Tiwari TCS world wide Data warehouse and Analytic Team - Americas Have a refreshing day !!! Date: Mon, 19 Sep

RE: Configuring Hive to automatically create _SUCCESS files

2011-09-15 Thread Siddharth Tiwari
Dear Mike Did u try the same using hive-0.7.1 and hadoop-0.20.2 ? try it out once ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Date: Thu, 15 Sep 2011 15:59:00 +0200 Subject: Configuring Hive to automatically create _SUCCESS files From: michael.g.n

RE: Pentaho issue with hive

2011-09-12 Thread Siddharth Tiwari
Hi Jasper I am on Pentaho BI suite 4.0 and Hive 0.7.1 ... please help ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Date: Mon, 12 Sep 2011 11:47:06 +0200 Subject: Re: Pentaho issue with hive From: jasper.knu...@vlc.nl To: user@hive.apache.org Hi Siddharth

RE: problem in reading data fro table (fields terminated by '||')

2011-08-19 Thread Siddharth Tiwari
You can write a map/reduce job to do it for you accordingly, leveraging its power of parallel processing. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Date: Fri, 19 Aug 2011 18:46:22 +0530 Subject: Re: problem in reading data fro table (fields terminated

RE: problem in reading data fro table (fields terminated by '||')

2011-08-19 Thread Siddharth Tiwari
You will have to parse this data accordingly ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! Date: Fri, 19 Aug 2011 16:05:21 +0530 Subject: problem in reading data fro table (fields terminated by '||') From: vikas.srivast...@one97.ne

RE: Hive DDL issue

2011-08-18 Thread Siddharth Tiwari
okay Ed and Carl, I get the point, the only thing which bothered me was, would it be able to run on cygwin ? what actually was wrong. ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! From: c...@cloudera.com Date: Thu, 18 Aug 2011 13:13:37 -0700 Subject: Re

RE: Hive DDL issue

2011-08-18 Thread Siddharth Tiwari
hey carl, Isint there any way to enable it, if not, what is this error about ? what is the problem ? ** Cheers !!! Siddharth Tiwari Have a refreshing day !!! From: c...@cloudera.com Date: Thu, 18 Aug 2011 11:34:03 -0700 Subject: Re: Hive DDL issue To: user