USE CASE:: Hierarchical Structure in Hive and Java

2014-10-21 Thread yogesh dhari
Hello All, We are having a use case where we need to create the hierarchical structure using Hive and Java For example Lets say in an organisation we need to create Org chart i.e. Senior director -> director -> associate director -> senior manager -> manager -> senior associate -> associate -> De

HIVE::START WITH and CONNECT BY implementation in Hive

2014-10-20 Thread yogesh dhari
Hello All How can we achive *start with .. connect by* clause can be used to select data that has a hierarchical relationship (usually some sort of parent->child (boss->employee or thing->parts). into Hive, or what would be the other work around to implement this. Please suggest Thanks in a

Re: PLEASE HELP :: HOW TO DO INNER JOIN IN HIVE

2014-10-15 Thread yogesh dhari
; Dev > > > On Oct 15, 2014, at 1:18 PM, yogesh dhari wrote: > > > > Hello all, > > > > I have a use case where I need to do inner join.. > > > > Like > > > > select A.iteam , B.Decsription, > > from iteam_table A INNER JOI

PLEASE HELP :: HOW TO DO INNER JOIN IN HIVE

2014-10-15 Thread yogesh dhari
Hello all, I have a use case where I need to do inner join.. Like select A.iteam , B.Decsription, from iteam_table A INNER JOIN iteam_desc B on A.id = B.id As hive does not support Inner Join, Please suggest how to do it Thanks in Advance

HIVE QUERY HELP:: HOW TO IMPLEMENT THIS CASE

2014-03-03 Thread yogesh dhari
Hello All, I have a use case in RDBMS query which I have implemented in HIVE as.. *1.1) Update statement* *in RDBMS* update TABLE1 set Age= case when isnull(age,'') ='' then 'A= Current' else '240+ Days' end, Prev_Age=case when isnull(prev_age,'') ='' then 'A= Current' else '240+ Days' end; *

Re: Hive Query :: Implementing case statement

2014-02-19 Thread yogesh dhari
n > (a.key=b.key) where b.NEW_BALANCE is null > > > This takes care of the rows where code != 1 and code != 2. > > > But you knew that! > > > > > On Wed, Feb 19, 2014 at 8:33 PM, yogesh dhari wrote: > >> Thanks a lot Stephen Sprague :) :) >> >&

Re: Hive Query :: Implementing case statement

2014-02-19 Thread yogesh dhari
non-intersected rows >select a.* from TABLE_SQL a join NEW_BALS b on (a.key=b.key) where > b.NEW_BALANCE is null > >) z > ; > > there's probably some typos in there but hopefully you get the idea and > can take it from here. > > > > > > On Tue,

Re: Hive Query :: Implementing case statement

2014-02-18 Thread yogesh dhari
g]<http://www.trilliumsoftware.com/> > > trilliumsoftware.com <http://www.trilliumsoftware.com/> / > linkedin<http://www.linkedin.com/company/17710> > / twitter <https://twitter.com/trilliumsw> / > facebook<http://www.facebook.com/HarteHanks> > > >

Hive Query :: Implementing case statement

2014-02-18 Thread yogesh dhari
Hello All, I have a use case where a table say TABLE_SQL is geting updated like. 1st Update Command update TABLE_SQL a set BALANCE = b.prev from TABLE_SQL_2 b where a.key = b.key and a.code = "1" 2nd Update Command update TABLE_SQL a set BALANCE = b.prev from TABLE_SQL_3 b where a.key = b.ke

HIVE SUB QUERY:: How to implement this case

2014-01-22 Thread yogesh dhari
Hello all, I have a case statement where I need to work like this logic. select as_of_dt as as_of_dt, max_feed_key as max_feed_key, min_feed_key as min_feed_key from table feed_key_temp where max_fed_key > ( select max(feed_key) from summ_table ) group by as_of_dt ; Here, max_feed_key and min_f

Re: working with HIVE VARIALBE: Pls suggest

2014-01-06 Thread yogesh dhari
can see: > > > https://cwiki.apache.org/confluence/plugins/viewsource/viewpagesrc.action?pageId=30754722 > > > -- Original -- > *From: * "yogesh dhari";; > *Date: * Fri, Jan 3, 2014 01:13 AM > *To: * "user"; > *Subject: * work

working with HIVE VARIALBE: Pls suggest

2014-01-02 Thread yogesh dhari
Hello Hive Champs, I have a case statement, where I need to check the date passed through parameter, If date is 1st date of the month then keep it as it as else set the parameter date to 1st date of the month. and then later opretation are being performed on that date into hive quries, I have

Setting value into hive varialble

2014-01-02 Thread yogesh dhari
Hello All, I have a case statement, where I need to check the date passed through parameter, If date is 1st date of the month then keep it as it as else set the parameter date to 1st date of the month. and then later opretation are being performed on that date into hive quries, I have wrote t

CASE Statement not working in hive

2013-12-24 Thread yogesh dhari
Hello all, I have wrote this query . *" select* *case when as_date rlike '2013-05-01' then as_date else '2013-07-04' end as as_date from table AA ; " * as the value of as_date i.e 2013-05-01 exists in table AA it *should return the value 2013-05-01 *(Which is true in case statement) but

Re: to find the 1st day of the month in hive

2013-12-24 Thread yogesh dhari
Hi, Can i use this. select date_sub('2013-12-08', (day('2013-12-08')) -1) from table. just want to cross chk On Tue, Dec 24, 2013 at 3:48 PM, yogesh dhari wrote: > Hello, > > I have a use case where I need to find the 1st day of the month of > entered d

to find the 1st day of the month in hive

2013-12-24 Thread yogesh dhari
Hello, I have a use case where I need to find the 1st day of the month of entered date. like if the date is 2013-12-05 i need to get 2013-12-01. how to do it in Hive. (wont preffer to use UDF, like by doing some date_sub kind of or other function) Pls suggest Thanks Yogesh

Re: Date format in Hive

2013-12-24 Thread yogesh dhari
string, create a new string combining them > 3. convert it to numeric and multiply 100.. > 4. return this value from udf. > > Thanks, > Ashok > ____ > From: yogesh dhari [yogeshh...@gmail.com] > Sent: Tuesday, December 24, 2013 12:24

Date format in Hive

2013-12-23 Thread yogesh dhari
Hello All, I have a hive table in which dates are stored in string format. like 2013-01-01 2013-02-01 2013-03-01 I have a use case where I need this date like 20130101 20130201 20130301 and want to multiply each with 100 like 2013010100 2013020100 2013030100 How can I do it into Hive pls

JOIN comparasion PIG V/S HIVE

2012-10-22 Thread yogesh dhari
Hi All, Is it true that Pig's JOIN operation is not so efficient as of HIVE. I have just tried over and found differences over JOIN query. Hive resulted the same as My Sql but Pig resulted some counts lesser then Hive Join. Please put some light over JOINS in Pig and Hive. Regards Yogesh Ku

PIG vs HIVE

2012-10-17 Thread yogesh dhari
Hi All, I want to understand about the exceptional cases where Hive takes over Pig and Pig takes over Hive. leaving the Fact Pig is best as an ETL Tool and Hive is best Data Warehouse. Please suggest me me the real use cases for both. Thanks &Regards Yogesh Kumar

RE: NEED HELP in Hive Query

2012-10-14 Thread yogesh dhari
swer. Not sure the PIG answer. On Sun, Oct 14, 2012 at 9:54 AM, yogesh dhari wrote: Hi all, I have this file. I want this operation to perform in HIVE & PIG NAME DATE URL

NEED HELP in Hive Query

2012-10-14 Thread yogesh dhari
Hi all, I have this file. I want this operation to perform in HIVE & PIG NAME DATE URL HITCOUNT timesascent.in2008-08-27 http://timesascent.in/index.aspx?page=tparchives

RE: Need Help in Hive storage format

2012-10-12 Thread yogesh dhari
ry this PigStorage(' \u0001'); > > Thanks > Abhi > > > Sent from my iPhone > > On Oct 12, 2012, at 5:50 AM, MiaoMiao wrote: > > > Hi Yogesh: > > > > I think this may help. > > > > https://pig.apache.org/docs/r0.10.0/api/org/apache/pi

RE: Need Help in Hive storage format

2012-10-12 Thread yogesh dhari
with ^A character as the field delimiter. Regards Bejoy KS Sent from handheld, please excuse typos.From: yogesh dhari Date: Thu, 11 Oct 2012 23:18:35 +0530To: hive requestReplyTo: user@hive.apache.org Subject: Need Help in Hive storage format Hi all, If we run this query insert overwrit

Need Help in Hive storage format

2012-10-11 Thread yogesh dhari
Hi all, If we run this query insert overwrite local directory '/home/yogesh/Downloads/demoyy' select * from NYSE_LOCAL; { ( describe NYSE_LOCAL ; exchangestring symbolstring ddatestring openfloat highfloat lowfloat ) } ls /home/yogesh/Downloa

RE: hive query fails

2012-10-01 Thread yogesh dhari
Hi Ajit, Select * command doesn't invoke reducer, its just dump the data. check out your network proxy settings. Regards Yogesh Kumar Dhari From: ajit.shreevast...@hcl.com To: user@hive.apache.org Date: Mon, 1 Oct 2012 16:29:27 +0530 Subject: hive query fails Dear all, I am running following

Report tool ISSUE.

2012-09-30 Thread yogesh dhari
Hi all, I am trying to install iReport on Ubuntu. I am not able to install it. Its doesn't have start.sh file in /iReport-4.7.1/bin/ it has /iReport-4.7.1/bin/ireport.exe Please suggest me how to get it install over ubuntu. Please suggest me for the linux version Thanks & Regards Yogesh Kuma

RE: how to perform GROUP BY:: in pig for this

2012-09-30 Thread yogesh dhari
Thanks Bejoy :-) Regards Yogesh Kumar From: bejo...@outlook.com To: user@hive.apache.org Subject: RE: how to perform GROUP BY:: in pig for this Date: Sun, 30 Sep 2012 18:57:55 +0530 Hi Yogesh If you are looking for the solution in hive, then the following query will get you the required re

RE: ERROR: Hive subquery showing

2012-09-27 Thread yogesh dhari
; On Thu, Sep 27, 2012 at 3:29 PM, yogesh dhari wrote: Hi all, I have a table called ABC, like namegrp A 1 B 2 C 4 D 8 I want the output like the name having greatest grp i.e D; I wrote a query: select name from ( select MAX(grp) from ABC

RE: ERROR: Hive subquery showing

2012-09-27 Thread yogesh dhari
this? select name from ( select MAX(grp) as name from ABC ) gy ; On Thu, Sep 27, 2012 at 3:29 PM, yogesh dhari wrote: Hi all, I have a table called ABC, like name 牋 grp A牋牋 1 B牋牋 2 C牋牋 4 D牋牋 8 I want the output like the name having greatest grp i.e D; I wrote a query

ERROR: Hive subquery showing

2012-09-27 Thread yogesh dhari
Hi all, I have a table called ABC, like namegrp A 1 B 2 C 4 D 8 I want the output like the name having greatest grp i.e D; I wrote a query: select name from ( select MAX(grp) from ABC ) gy ; but it gives error FAILED: Error in semantic ana

RE: how to load TAB_SEPRATED file in hive table

2012-09-26 Thread yogesh dhari
ble > Date: Thu, 27 Sep 2012 05:20:11 + > > '\t' > > From: yogesh dhari [yogeshdh...@live.com] > Sent: Thursday, September 27, 2012 10:42 AM > To: hive request > Subject: how to load TAB_SEPRATED file in hive table > > Hi all, > > I have a file in wh

how to load TAB_SEPRATED file in hive table

2012-09-26 Thread yogesh dhari
Hi all, I have a file in which records are Tab-Seprated, Please suggest me how to upload such file in Hive table. Like how to specify Create table XYZ (name STRING, roll INT) ROW FORMAT DELIMITED FIELDS TERMINATED BY Please suggest for "" over here. Thanks & Regards Yogesh Kumar

RE: ERROR :regarding Hive WI, hwi service is not running

2012-09-19 Thread yogesh dhari
previous versions of hive.I had the same issue but can't remember the exact details (maybe it was due to relative path vs absolute). Try1) rename the war2) put the absolute path in your conf3) run it Regards Bertrand On Thu, Sep 20, 2012 at 12:02 AM, yogesh dhari wrote: Swarnim, &quo

RE: ERROR :regarding Hive WI, hwi service is not running

2012-09-19 Thread yogesh dhari
-0500 Subject: Re: ERROR :regarding Hive WI, hwi service is not running To: user@hive.apache.org No. I meant create "/opt/hive-0.8.1/lib/" in HDFS and place the "hive-hwi-0.8.1.war" there. On Wed, Sep 19, 2012 at 4:55 PM, yogesh dhari wrote: Hello Swarnim, Are you

RE: ERROR :regarding Hive WI, hwi service is not running

2012-09-19 Thread yogesh dhari
ning To: user@hive.apache.org It's probably looking for that file on HDFS. Try placing it there under the given location and see if you get the same error. On Wed, Sep 19, 2012 at 4:45 PM, yogesh dhari wrote: Hi all, I am trying to run hive wi but its showing FATAL, I have used thi

ERROR :regarding Hive WI, hwi service is not running

2012-09-19 Thread yogesh dhari
Hi all, I am trying to run hive wi but its showing FATAL, I have used this command hive --service hwi but it shows.. yogesh@yogesh-Aspire-5738:/opt/hive-0.8.1/lib$ hive --service hwi 12/09/20 03:12:03 INFO hwi.HWIServer: HWI is starting up 12/09/20 03:12:04 FATAL hwi.HWIServer: HWI WAR fil

RE: FAILED: Error in metadata

2012-09-11 Thread yogesh dhari
tables like "TBLS","COLUMNS", the mysql should work fine. otherwise you should check your configuration about the hive-site.xml 2012/9/10 yogesh dhari Helli Bejoy, I have restarted the hive and all cluster again but still the same issue. Please help me out Thanks & re

RE: FAILED: Error in metadata

2012-09-09 Thread yogesh dhari
hive is still on the derby db . Can you restart your hive instances after updating the hive-site.xml. Also please make sure that you are modifying the right copy of the file. Regards,Bejoy KS From: yogesh dhari To: hive request Sent: Sunday, September 9, 2012 2:21 PM Subject: FA

FAILED: Error in metadata

2012-09-09 Thread yogesh dhari
Hi all, my hive-site.xml is javax.jdo.option.ConnectionURL jdbc:mysql://127.0.0.1:3306/try?createDatabaseIfNotExist=true javax.jdo.option.ConnectionDriverName com.mysql.jdbc.Driver javax.jdo.option.ConnectionUserName

issue regarding importing hive tables from one cluster to another.

2012-09-08 Thread yogesh dhari
Hi all, I have switched to new hdfs cluster from old cluster ( all machines from old cluster are not connected to new cluster in any manner) I brought edit and fsimage including ( dfs.name.dir and dfs.data.dir )from old cluster and put it over new cluster and every files and data are showing

RE: namenode starting error

2012-07-08 Thread yogesh dhari
Hi, have you formated your name node by using hadoop namenode -format Regards Yogesh Kumar > From: are9...@nyp.org > To: user@hive.apache.org; common-u...@hadoop.apache.org > Date: Sat, 7 Jul 2012 21:37:16 -0400 > Subject: Re: namenode starting error > > Check your firewall settings, specif

RE: Hive upload

2012-07-04 Thread yogesh dhari
her it has the correct data format. You can get the location of your table from the following command describe formatted NewTable; Regards Bejoy KS Sent from handheld, please excuse typos.From: yogesh dhari Date: Wed, 4 Jul 2012 11:09:02 +0530To: hive requestReplyTo: user@hive.apache.org Subj

Hive upload

2012-07-03 Thread yogesh dhari
Hi all, I am trying to upload the tables from RDBMS to hive through sqoop, hive imports successfully. but i didn't find any table in hive that imported table gets uploaded into hdfs idr /user/hive/warehouseI want it to be present into hive, I used this command sqoop import --connect jdbc:mysql: