Re: Report tool ISSUE.

2012-09-30 Thread Harsh J
Yogesh, Please ask at iReport's own community lists: http://community.jaspersoft.com/project/ireport-designer/answers On Mon, Oct 1, 2012 at 9:21 AM, yogesh dhari wrote: > Hi all, > > I am trying to install iReport on Ubuntu. I am not able to install it. Its > doesn't have start.sh file in /iRep

Fw: Cartesian Product in HIVE

2012-09-30 Thread Bejoy KS
Hi Abshiek Both your tables are ideal candidates for map join. Can you try a plain join statement without setting any properties other than num reducers and a map join as the next step. hive> set mapred.reduce.tasks=5; hive>SELECT t2.col1,t3.col1FROM table2 t2JOIN table3 t3; Once this goes wel

Re: Cartesian Product in HIVE

2012-09-30 Thread Abhishek
Thanks for the reply Bejoy. I did not any order by in the query. Here are the properities I have used and query, table sizes - set mapred.reduce.tasks=17; set mapred.child.java.opts=xmx2073741824; set io.sort.mb=512; set io.sort.factor=250; set mapred.reduce.parallel.copies=true; set mapred

Report tool ISSUE.

2012-09-30 Thread yogesh dhari
Hi all, I am trying to install iReport on Ubuntu. I am not able to install it. Its doesn't have start.sh file in /iReport-4.7.1/bin/ it has /iReport-4.7.1/bin/ireport.exe Please suggest me how to get it install over ubuntu. Please suggest me for the linux version Thanks & Regards Yogesh Kuma

RE: zip file or tar file cosumption

2012-09-30 Thread Bejoy KS
Definitely Raja, but looks like the one for zip is blocked for some time now https://issues.apache.org/jira/browse/MAPREDUCE-210 Regards Bejoy KS > Date: Sun, 30 Sep 2012 12:41:29 -0700 > Subject: Re: zip file or tar file cosumption > From: thiruvath...@gmail.com > To: user@hive.apache.org > >

Re: zip file or tar file cosumption

2012-09-30 Thread Raja Thiruvathuru
we can write custom codecs On Sun, Sep 30, 2012 at 11:47 AM, Bejoy KS wrote: > Yes Manish, Zip is not supported in hadoop. You may have to use gzip > instead. > > Regards > Bejoy KS > > > > Subject: RE: zip file or tar file cosumption > From: manishbh...@rocketmai

Re: Book 'Programming Hive' from O'Reilly now available!

2012-09-30 Thread Aniket Mokashi
+1. Great work guys. Congrats! I just placed an order. ~Aniket On Sun, Sep 30, 2012 at 11:37 AM, varun kumar wrote: > Hi Edward, > > May i know the password to open the pdf file. > > Regards, > Varun > > On Sun, Sep 30, 2012 at 5:21 AM, Edward Capriolo wrote: > >> Hello all, >> >> I wanted to l

RE: zip file or tar file cosumption

2012-09-30 Thread Bejoy KS
Yes Manish, Zip is not supported in hadoop. You may have to use gzip instead.Regards Bejoy KS Subject: RE: zip file or tar file cosumption From: manishbh...@rocketmail.com To: user@hive.apache.org CC: chuck.conn...@nuance.com Date: Sun, 30 Sep 2012 20:35:35 +0530 Thanks Bejoy. I have

Re: Embedded mode for jdbc client inside a multi-threaded (web) application

2012-09-30 Thread Dilip Joseph
The data store does is not embedded. I have described how I accessed hive from jython at http://csgrad.blogspot.in/2010/04/to-use-language-other-than-java-say.html. The example there may be relevant for your use case. Dilip On Sun, Sep 30, 2012 at 8:05 AM, Bertrand Dechoux wrote: > Hi, > > As

Re: Cartesian Product in HIVE

2012-09-30 Thread abhishek dodda
Thanks for the reply Bejoy. On Sun, Sep 30, 2012 at 6:35 AM, Bejoy KS wrote: > Hi Abshiek > > > No need of any similar columns for map join to work. It is just taking the > join process to mapper rather then doing the same in a reducer. > > The actual bottle neck is the single reducer. Need to f

Re: Book 'Programming Hive' from O'Reilly now available!

2012-09-30 Thread Anurag Phadke
Congratulations Ed and co. Great stuff. -anurag On Sep 30, 2012, at 8:16 AM, "Mattmann, Chris A (388J)" wrote: > Awesome work guys! > > Cheers, > Chris > > On Sep 30, 2012, at 12:51 AM, Edward Capriolo wrote: > >> Hello all, >> >> I wanted to let you know that "Programming Hive" from O'Re

Re: Book 'Programming Hive' from O'Reilly now available!

2012-09-30 Thread Mattmann, Chris A (388J)
Awesome work guys! Cheers, Chris On Sep 30, 2012, at 12:51 AM, Edward Capriolo wrote: > Hello all, > > I wanted to let you know that "Programming Hive" from O'Reilly is now > available! > > http://shop.oreilly.com/product/0636920023555.do > > I could not have said enough in the dedication ab

RE: zip file or tar file cosumption

2012-09-30 Thread Manish
Thanks Bejoy. I have zip file there is sense to convert into gzip again. Chuck, I got what you are trying to say. So I need to process it outside HDFS and bring the text file into HDFS. On Sun, 2012-09-30 at 18:21 +0530, Bejoy KS wrote: > Hi Manish > > Gzip works well if you have the compressi

Embedded mode for jdbc client inside a multi-threaded (web) application

2012-09-30 Thread Bertrand Dechoux
Hi, As the thrift sever has concurrency issue, I need to find an alternative. I found out about the embedded mode for the jdbc client. https://cwiki.apache.org/Hive/hiveclient.html However, I am not sure to understand everything. * Does that mean the datastore should be embedded too? I don't thin

RE: how to perform GROUP BY:: in pig for this

2012-09-30 Thread yogesh dhari
Thanks Bejoy :-) Regards Yogesh Kumar From: bejo...@outlook.com To: user@hive.apache.org Subject: RE: how to perform GROUP BY:: in pig for this Date: Sun, 30 Sep 2012 18:57:55 +0530 Hi Yogesh If you are looking for the solution in hive, then the following query will get you the required re

RE: Cartesian Product in HIVE

2012-09-30 Thread Bejoy KS
Hi Abshiek No need of any similar columns for map join to work. It is just taking the join process to mapper rather then doing the same in a reducer. The actual bottle neck is the single reducer. Need to figure out why only one reducer is fired rather than the set value of 17. Are you using O

RE: how to perform GROUP BY:: in pig for this

2012-09-30 Thread Bejoy KS
Hi Yogesh If you are looking for the solution in hive, then the following query will get you the required result Select month(Date), max(rate) from date_sample Group BY month(Date); Regards Bejoy KS > From: yogesh.kuma...@wipro.com > To: user@hive.apache.org > CC: yogeshdh...@live.com > Sub

RE: zip file or tar file cosumption

2012-09-30 Thread Bejoy KS
Hi ManishGzip works well if you have the compression codec available in 'io.compression.codes' . Gzip codec is present in default.I don't think untar ing world be done by map reduce jobs. So tar files may not work with hive, you need to untar the files out of hadoop hive as a prerequisite. Regar

Re: Book 'Programming Hive' from O'Reilly now available!

2012-09-30 Thread Bejoy KS
Hi Ed Great job, I just read the preview, its too good. This would definitely be a great guide for all hive users. Salute you and others for the efforts taken in bringing up a wonderful book like this on hive. Much appreciated :) Expecting more and more informative books like this from you gu

Re: zip file or tar file cosumption

2012-09-30 Thread Manish Bhoge
What about .gz OR tar file. Does this unzip require at HDFS and load into hive? How you resolve it. Sent from my BlackBerry, pls excuse typo -Original Message- From: "Connell, Chuck" Date: Sun, 30 Sep 2012 12:24:37 To: user@hive.apache.org; Savant, Keshav Reply-To: user@hive.apache.o

RE: zip file or tar file cosumption

2012-09-30 Thread Connell, Chuck
I have seen that error when I try to overwrite an existing file. But, more importantly, Hive cannot understand ZIP files. There was a long thread about this just a few days ago. Your table def says "stored as textfile" but you are not giving it a text file. Chuck _

RE: zip file or tar file cosumption

2012-09-30 Thread Manish
> I am getting below error when loading zip file > > > Driver returned: 9. Errors: Hive history > file=/tmp/hue/hive_job_log_hue_201209300434_1768401171.txt > Loading data to table default.pageview_zip > Failed with exception Error moving: > hdfs://localhost:54310/user/manish/input/zip/11sep1

RE: zip file or tar file cosumption

2012-09-30 Thread Manish
I am getting below error when loading zip file Driver returned: 9. Errors: Hive history file=/tmp/hue/hive_job_log_hue_201209300434_1768401171.txt Loading data to table default.pageview_zip Failed with exception Error moving: hdfs://localhost:54310/user/manish/input/zip/11sep12.zip into: /u