Re: Is the Hive PreCommit Build broken?

2014-04-15 Thread Szehon Ho
Yea the bigtop dev box hosting our jenkins job is out of space, I just bumped a mail on the hive-dev list with more details. Thanks Szehon On Tue, Apr 15, 2014 at 4:33 PM, Anthony Hsu wrote: > Hi, > > Yesterday, I uploaded a new patch to > HIVE-6835

question regarding the DAG scheduler

2014-04-15 Thread Grandl Robert
Hi, Can someone give me some details(or some pointers) on how the DAG scheduling happens in Hive ? Like: in what order are the tasks(w/o dependencies) chosen for scheduling; how the assignment between tasks and nodes happens, etc ... Thanks, robert

Is the Hive PreCommit Build broken?

2014-04-15 Thread Anthony Hsu
Hi, Yesterday, I uploaded a new patch to HIVE-6835, and it's been over 24 hours and I haven't gotten the pre-commit build results. Looking at http://bigtop01.cloudera.org:8080/view/All/job/PreCommit-HIVE-Build/lastBuild/?, it seems like the las

Re: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Jeremy
we will have more then Petabytes of data over time. This is to be used for reports that span more then 10years worth of data. At the moment we are using Mysql because that is all there was when they started. Now we are switching to hive so I need to get it to work. We are using sqoop to take the da

Re: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Mohit Durgapal
Hive isn't really a replacement for mysql. Please read about hive and big data. The use cases for hive are quite different as compared to the use cass for mysql. Mysql is for real time ad-hoc queries, like showing some information on a webpage or search results. MySQL is a relational database, supp

Re: HDFS file system size issue

2014-04-15 Thread Abdelrahman Shettia
Hi Saumitra, It looks like the over replicated blocks root cause is not the issue that the cluster is experiencing. I can only think of miss configuring the dfs.data.dir parameter. Can you ensure that each one of the data directories is using only one partition(mount) and there is no other data

Re: Beeline questions

2014-04-15 Thread Szehon Ho
Hi I tried to answer the best I could, I think beeline logging still can have some improvements. On Tue, Apr 15, 2014 at 7:48 AM, Uber Slacker wrote: > Hi folks. I've been trying out Beeline and have a couple questions. I > haven't seen a ton of documentation or examples of people using Beeline

Re: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Jeremy
Thanks for the feed back. I will spend time looking in it. Thanks again On 04/15/2014 12:03 PM, Prasan Samtani wrote: > Hi Jeremy, > > The suggestions given are for precisely the use case you described. A > warning: It's not going to be a matter of simple substitution. > > --Prasan > _

RE: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Prasan Samtani
Hi Jeremy, The suggestions given are for precisely the use case you described. A warning: It's not going to be a matter of simple substitution. --Prasan From: Jeremy [jk...@kickbackpoints.com] Sent: Tuesday, April 15, 2014 10:58 AM To: user@hive.apache.or

Re: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Jeremy
Just in case there is confusion I have an API that needs to talk to hive. At the moment it is using mysql Thanks for the reply’s On 04/15/2014 11:41 AM, Ravi Mummulla (BIG DATA) wrote: > Use Templeton rest API to hive server 2. > > Thanks. > > -Original Message- > From: "Jeremy" > Sen

Re: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Jyotirmoy Sundi
https://cwiki.apache.org/confluence/display/Hive/WebHCat+UsingWebHCat http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.1/ds_HCatalog/rest.html On Tue, Apr 15, 2014 at 10:38 AM, Jeremy wrote: > What do I need to do to send a php command from a php api to query the > hive server? I am just

RE: In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Ravi Mummulla (BIG DATA)
Use Templeton rest API to hive server 2. Thanks. -Original Message- From: "Jeremy" Sent: ‎4/‎15/‎2014 10:39 AM To: "user@hive.apache.org" Subject: In need of desperate help and willing to pay for consulting work What do I need to do to send a php command from a php api to query the hiv

In need of desperate help and willing to pay for consulting work

2014-04-15 Thread Jeremy
What do I need to do to send a php command from a php api to query the hive server? I am just trying to replace mysql with hive. This should be as simple as 1 2 3 But for months I have not been able to find this answer. It has to be out there because many people are still using PHP. Why would

Writing with OrcOutputFormat

2014-04-15 Thread Brock Bose
Hello, I recently noticed that the OrcInputFormat/OutputFormat's have been exposed to be usable outside of hive ( https://issues.apache.org/jira/browse/HIVE-5728). Does anyone know of any documentation, or have any information, as to how one uses these with a mapReduce application to write orc

Beeline questions

2014-04-15 Thread Uber Slacker
Hi folks. I've been trying out Beeline and have a couple questions. I haven't seen a ton of documentation or examples of people using Beeline, so I wanted to bounce these off you... - When I use Beeline in embedded mode - connecting with jdbc:hive2:// (I'm running on the Big Insights distribution

Re: HDFS file system size issue

2014-04-15 Thread Saumitra Shahapure
Hi Rahman, These are few lines from hadoop fsck / -blocks -files -locations /mnt/hadoop/hive/warehouse/user.db/table1/000255_0 44323326 bytes, 1 block(s): OK 0. blk_-7919979022650423857_446500 len=44323326 repl=3 [ip1:50010, ip2:50010, ip3:50010] /mnt/hadoop/hive/warehouse/user.db/table1/000256