RE: how to pass a hdfs file to a c++ process

2011-08-23 Thread Zhixuan Zhu
-- From: Arun Murthy [mailto:a...@hortonworks.com] Sent: Tuesday, August 23, 2011 10:36 AM To: common-dev@hadoop.apache.org Subject: Re: how to pass a hdfs file to a c++ process That is a normal use case. I'd encourage you to use Java MR (even pig/hive). If you really want to use your legacy ap

Re: how to pass a hdfs file to a c++ process

2011-08-23 Thread Arun Murthy
> the process and pass the input files. > > Thanks, > Grace > > -Original Message- > From: Arun C Murthy [mailto:a...@hortonworks.com] > Sent: Tuesday, August 23, 2011 9:51 AM > To: common-dev@hadoop.apache.org > Subject: Re: how to pass a hdfs file to a c++ process

RE: how to pass a hdfs file to a c++ process

2011-08-23 Thread Zhixuan Zhu
ocess and pass the input files. Thanks, Grace -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Tuesday, August 23, 2011 9:51 AM To: common-dev@hadoop.apache.org Subject: Re: how to pass a hdfs file to a c++ process On Aug 22, 2011, at 12:57 PM, Zhixuan Zhu

Re: how to pass a hdfs file to a c++ process

2011-08-23 Thread Arun C Murthy
On Aug 22, 2011, at 12:57 PM, Zhixuan Zhu wrote: > Hi All, > > I'm using hadoop-0.20.2 to try out some simple tasks. I asked a question > about FileInputFormat a few days ago and get some prompt replys from > this forum and it helped a lot. Thanks again! Now I have another > question. I'm trying

Re: how to pass a hdfs file to a c++ process

2011-08-23 Thread Robert Evans
Hadoop streaming is the simplest way to do this, if you program is set up to take stdin as its input, write to stdout for the output, and each record "file" in your case is a single line of text. You need to be able to have it work with the following shell script Hadoop fs -cat | head -1 | ./m