Re: Hive + mongoDB

2013-09-13 Thread Sandeep Nemuri
Hi nithin Thanks for your help I have used this query in hive to retrieve the data from mongodb add jar /usr/lib/hadoop/lib/mongo-2.8.0.jar; add jar /usr/lib/hive/lib/hive-mongo-0.0.3-jar-with-dependencies.jar; select * from docs input format "org.yong3.hive.mongo.MongoStorageHandler" with serde

Re: Hive + mongoDB

2013-09-13 Thread Nitin Pawar
Can you share your create table ddl for table name docs? Select statement does not need all those details. Those are part of create table DDL only. On Fri, Sep 13, 2013 at 4:24 PM, Sandeep Nemuri wrote: > Hi nithin > > Thanks for your help > I have used this query in hive to retrieve the data f

Re: Hive + mongoDB

2013-09-12 Thread Nitin Pawar
try creating table with your existing mongo db and collection see the data can be read by the user or not. What you need to do is mongo collection column mapping exactly with same names into hive column definition. if you can not see mongo data from hive query, do let me know what errors do you se

Re: Hive + mongoDB

2013-09-12 Thread Sandeep Nemuri
How we will get mongo data into mongo table ? By using this we can just create table create external table mongo_users(id int, name string, age int) stored by "org.yong3.hive.mongo.MongoStorageHandler" with serdeproperties ( "mongo.column.mapping" = "_id,name,age" ) tblproperties ( "mongo.host" =

Re: Hive + mongoDB

2013-09-12 Thread Nitin Pawar
If you are importing from hive to mongo, why can't you just select from mongo table and insert into hive table? On Thu, Sep 12, 2013 at 4:24 PM, Sandeep Nemuri wrote: > Hi Nitin Pawar, > I have checked That link .There data is importing > from Hive-mongo. > But my requirm

Re: Hive + mongoDB

2013-09-12 Thread Sandeep Nemuri
Hi Nitin Pawar, I have checked That link .There data is importing from Hive-mongo. But my requirment is to import data from mongo-hive. On Thu, Sep 12, 2013 at 3:49 PM, Nitin Pawar wrote: > Sandip, > > Did you try using hive-mongo (https://github.com/yc-huang/Hive-mongo).

Re: Hive + mongoDB

2013-09-12 Thread Nitin Pawar
Sandip, Did you try using hive-mongo (https://github.com/yc-huang/Hive-mongo). Its pretty easy to use as well. If you want to start with analytics directly. On Thu, Sep 12, 2013 at 2:02 PM, Sandeep Nemuri wrote: > Thanks all > i am trying to import data with this program > but when i compied t

Re: Hive + mongoDB

2013-09-12 Thread Sandeep Nemuri
Thanks all i am trying to import data with this program but when i compied this code i got errors Here is the code import java.io.*; import org.apache.commons.logging.*; import org.apache.hadoop.conf.*; import org.apache.hadoop.fs.Path; import org.apache.hadoop.io.*; import org.apache.hadoop.mapr

Re: Hive + mongoDB

2013-09-11 Thread Jérôme Verdier
Hi, You can use Talend to import data from mongodb to hive More informations here : http://www.talend.com/products/big-data 2013/9/11 Sandeep Nemuri > Hi every one , >I am trying to import data from mongodb to hive . i > got some jar files to connect mongo and hive . >

Re: Hive + mongoDB

2013-09-11 Thread Jitendra Yadav
Hi, 1. you may use Hadoop-mongodb connector, create a map reduce program to process your data from mongodb to hive. https://github.com/mongodb/mongo-hadoop 2. As an alternative you can also use pig mongodb combination to get the data from mongodb through pig, then after you can create a table i

Re: Hive + mongoDB

2013-09-11 Thread Russell Jurney
The docs are at https://github.com/mongodb/mongo-hadoop/tree/master/hive You need to build mongo-hadoop, and then use the documented syntax to create BSON tables in Hive. On Wed, Sep 11, 2013 at 11:11 AM, Jitendra Yadav wrote: > Hi, > > 1. you may use Hadoop-mongodb connector, create a map red

Hive + mongoDB

2013-09-11 Thread Sandeep Nemuri
Hi every one , I am trying to import data from mongodb to hive . i got some jar files to connect mongo and hive . now how to import the data from mongodb to hive ? Thanks in advance. -- --Regards Sandeep Nemuri