Re: Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Mapred Learn
Sqoop is a nice tool to get dAta to/from DB2 to hive and then you can run hive queries on top of it. Lot of people are using this for traditional DBs and hadoop connectivity. Sent from my iPhone On Jul 26, 2012, at 11:32 AM, Siddharth Tiwari wrote: > Hey Team, > > We have huge tables in Mai

RE: Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Connell, Chuck
able by pulling data from mainFrames Hey Team, We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table. Please help ** Ch

Re: Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Debarshi Basak
YesWe have implemented a solution where we pulled data from DB2 using sqoop. There is certain problem we faced while doing this exercise which we overcame. I think the solution was a specific DB2 jdbc jar and creating a connection pool or something i can't recollect.Debarshi BasakTata Consultancy

Re: Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Nitin Pawar
try looking out at sqoop .. meant to transfer data from rdbms systems to hive not sure it works with DB2 or not On Fri, Jul 27, 2012 at 12:02 AM, Siddharth Tiwari wrote: > Hey Team, > > We have huge tables in Mainframe DB2. Can some one tell if its possible to > pull data from DB2 in Mainframe t

Creating Hive table by pulling data from mainFrames

2012-07-26 Thread Siddharth Tiwari
Hey Team, We have huge tables in Mainframe DB2. Can some one tell if its possible to pull data from DB2 in Mainframe to hive and then use MapReduce to sort the data in hive and push it back to Mainframe table. Please help ** Cheers !!! Siddharth Tiwari Have a refresh