Hi Nitin Pawar,
I have checked That link .There data is importing
from Hive-mongo.
But my requirment is to import data from mongo-hive.
On Thu, Sep 12, 2013 at 3:49 PM, Nitin Pawar <nitinpawar...@gmail.com>wrote:
> Sandip,
>
> Did you try using hive-mongo (https://github.com/yc-huang/Hive-mongo).
>
> Its pretty easy to use as well. If you want to start with analytics
> directly.
>
>
> On Thu, Sep 12, 2013 at 2:02 PM, Sandeep Nemuri <nhsande...@gmail.com>wrote:
>
>> Thanks all
>> i am trying to import data with this program
>> but when i compied this code i got errors
>>
>> Here is the code
>>
>> import java.io.*;
>> import org.apache.commons.logging.*;
>> import org.apache.hadoop.conf.*;
>> import org.apache.hadoop.fs.Path;
>> import org.apache.hadoop.io.*;
>> import org.apache.hadoop.mapreduce.lib.output.*;
>> import org.apache.hadoop.mapreduce.*;
>> import org.bson.*;
>> import com.mongodb.hadoop.*;
>> import com.mongodb.hadoop.util.*;
>>
>> public class ImportWeblogsFromMongo {
>>
>> private static final Log log = LogFactory.
>> getLog(ImportWeblogsFromMongo.class);
>>
>> public static class ReadWeblogsFromMongo extends Mapper<Object,
>> BSONObject, Text, Text>{
>>
>> public void map(Object key, BSONObject value, Context context) throws
>> IOException, InterruptedException{
>>
>> System.out.println("Key: " + key);
>> System.out.println("Value: " + value);
>>
>> String md5 = value.get("md5").toString();
>> String url = value.get("url").toString();
>> String date = value.get("date").toString();
>> String time = value.get("time").toString();
>> String ip = value.get("ip").toString();
>> String output = "\t" + url + "\t" + date + "\t" + time + "\t" + ip;
>>
>> context.write( new Text(md5), new Text(output));
>> }
>> }
>>
>> public static void main(String[] args) throws Exception{
>>
>> final Configuration conf = new Configuration();
>>
>> MongoConfigUtil.setInputURI(conf,"mongodb://localhost:27017/mongo_hadoop.example");
>>
>> MongoConfigUtil.setCreateInputSplits(conf, false);
>> System.out.println("Configuration: " + conf);
>>
>> final Job job = new Job(conf, "Mongo Import");
>> Path out = new Path("/user/mongo_data");
>> FileOutputFormat.setOutputPath(job, out);
>> job.setJarByClass(ImportWeblogsFromMongo.class);
>> job.setMapperClass(ReadWeblogsFromMongo.class);
>> job.setOutputKeyClass(Text.class);
>> job.setOutputValueClass(Text.class);
>> job.setInputFormatClass(MongoInputFormat.class);
>> job.setOutputFormatClass(TextOutputFormat.class);
>> job.setNumReduceTasks(0);
>> System.exit(job.waitForCompletion(true) ? 0 : 1 );
>> }
>> }
>>
>>
>>
>> On Wed, Sep 11, 2013 at 11:50 PM, Russell Jurney <
>> russell.jur...@gmail.com> wrote:
>>
>>> The docs are at https://github.com/mongodb/mongo-hadoop/tree/master/hive
>>>
>>> You need to build mongo-hadoop, and then use the documented syntax to
>>> create BSON tables in Hive.
>>>
>>>
>>> On Wed, Sep 11, 2013 at 11:11 AM, Jitendra Yadav <
>>> jeetuyadav200...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> 1. you may use Hadoop-mongodb connector, create a map reduce program
>>>> to process your data from mongodb to hive.
>>>>
>>>> https://github.com/mongodb/mongo-hadoop
>>>>
>>>>
>>>> 2. As an alternative you can also use pig mongodb combination to get
>>>> the data from mongodb through pig, then after you can create a table
>>>> in hive that will points to the pig output file on hdfs.
>>>>
>>>> https://github.com/mongodb/mongo-hadoop/blob/master/pig/README.md
>>>>
>>>> Regards
>>>> Jitendra
>>>> On 9/11/13, Jérôme Verdier <verdier.jerom...@gmail.com> wrote:
>>>> > Hi,
>>>> >
>>>> > You can use Talend to import data from mongodb to hive
>>>> >
>>>> > More informations here : http://www.talend.com/products/big-data
>>>> >
>>>> >
>>>> > 2013/9/11 Sandeep Nemuri <nhsande...@gmail.com>
>>>> >
>>>> >> Hi every one ,
>>>> >> I am trying to import data from mongodb to
>>>> hive .
>>>> >> i
>>>> >> got some jar files to connect mongo and hive .
>>>> >> now how to import the data from mongodb to hive ?
>>>> >>
>>>> >> Thanks in advance.
>>>> >>
>>>> >> --
>>>> >> --Regards
>>>> >> Sandeep Nemuri
>>>> >>
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *Jérôme VERDIER*
>>>> > 06.72.19.17.31
>>>> > verdier.jerom...@gmail.com
>>>> >
>>>>
>>>
>>>
>>>
>>> --
>>> Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome
>>> .com
>>>
>>
>>
>>
>> --
>> --Regards
>> Sandeep Nemuri
>>
>
>
>
> --
> Nitin Pawar
>
--
--Regards
Sandeep Nemuri
