Re: Reflect MySQL updates into Hive

2012-12-25 Thread Ibrahim Yakti
Mohammad, I am not sure if the answers & the link were to me or to Kshiva's question. if I have partitioned my data based on status for example, when I run the update query it will add the updated data on a new partition (success or shipped for example) and it will keep the old data (confirmed or

Re: Reg:

2012-12-25 Thread Manish Malhotra
Hi, As mentioned by Nitin and other fellows. There are few points you need to consider. 1. Hive is currently and build for OLAP apps and not for OLTP ( Realtime like RDBMS like MySQL, Oracle) 2. Though you can connect to Hive Thrift using JDBC implementation, but its still not a production grade

Re: Reg:

2012-12-25 Thread Mohammad Tariq
Hello Kshiva, Hive is batch a processing system and not meant for real time stuff as said by Nitin. Hive queries actually get converted into MapReduce jobs under the hood and then give you the result. If you want to query your data in real time, then give "Impala" a shot. It does the sa

Re: Reg:

2012-12-25 Thread Nitin Pawar
Hive is not like mysql where u just query and get the results. It will take time based on data size and query. You may look at oozie if you want to build an application or look at penatho with hive integration Hive cli is not only for testing. You can build application using hive cli and scripting

Re: Reg:

2012-12-25 Thread Kshiva Kps
Many Thanks, for your replay. But in real time if you want to develop application (jobs) in this case CLI won't help us, CLI is for testing pls current if i'm worng, thanks. Many Thanks Kshiva@ +91 9940163885 On Tue, Dec 25, 2012 at 2:09 PM, Nitin Pawar wrote: > hive comes with a thrift server

Re: Reg:

2012-12-25 Thread Nitin Pawar
hive comes with a thrift server so you can connect via jdbc. you just want to execute queries, why dont u use hive cli ? On Tue, Dec 25, 2012 at 1:01 PM, Kshiva Kps wrote: > Thnaks... sorry to ask you if possible could you pls advice on below > points > >> >> In general in Real time how we w