Re: counting number of pageviews and unique pageviews

2012-06-11 Thread Nitin Pawar
why not write big joins and generate a single query which will get the expected results you want. Or you can write queries and insert the intermediate data in temp tables and clean them up once your execution is over On Mon, Jun 11, 2012 at 6:23 PM, Cam Bazz wrote: > Hello Nitin, > > yes, i wan

Re: counting number of pageviews and unique pageviews

2012-06-11 Thread Cam Bazz
Hello Nitin, yes, i want to write these results back to some rdbms, postgres, and i had written some sort of merge program to handle text data into postgres, but I will look at sqoop. Currently there is no program, but I will either write a script, or one in java. I will be making number of quer

Re: counting number of pageviews and unique pageviews

2012-06-11 Thread Nitin Pawar
If you want to write back these results to some rdbms then you can use sqoop if you want to save the results to some file, then just redirect the output of query to somefile can you tell how are you executing the hive query from your code? that will be helpful to answer your question On Mon, Jun

counting number of pageviews and unique pageviews

2012-06-11 Thread Cam Bazz
Hello, I have finally wrote a program to upload my data to amazon s3, start a cluster on amazon emr, and recover my partitions, and can issue simple queries on hive. now I would like to: select count(*),itemSid from items group by itemSid <- gives me how many times an item as viewed and another