Re: [VOTE] Should we release 0.20.204.0rc2?

2011-08-18 Thread Owen O'Malley
On Aug 9, 2011, at 8:55 AM, Owen O'Malley wrote: > All, > Matt rolled a 0.20.204.0rc1, but I think it got lost in the previous vote > thread. Unfortunately, it had the version as 0.20.204 and didn't update the > release notes. I've updated it, run the regression tests and I think we > should

Build failed in Jenkins: Hadoop-Common-trunk #130

2011-08-18 Thread Apache Jenkins Server
See Changes: [todd] HDFS-2260. Refactor BlockReader into an interface and implementation. Contributed by Todd Lipcon. [szetszwo] DFS-1257. Fix a race condition on BlockManager.recentInvalidateSets. Contributed by Eric Payne [sze

RE: question about file input format

2011-08-18 Thread Zhixuan Zhu
Thanks so much for your help! I'll study the sample code and see what I should do. My mapper will actually invoke another shell process to read in the file and do its job. I just need to get the input file names and pass it to the separate process from my mapper. That case I don't need to read the

Re: question about file input format

2011-08-18 Thread Harsh J
Grace, In that case you may simply set the key/value with dummy or nulls and return true just once (same unread/read logic applies as in the example). Then, using the input file name (via map.input.file or the inputsplit), pass it to your spawned process and have it do the work. You'll just be omi

RE: question about file input format

2011-08-18 Thread Zhixuan Zhu
Thanks very much for the prompt reply! It makes perfect sense. I'll give it a try. Grace -Original Message- From: Harsh J [mailto:ha...@cloudera.com] Sent: Thursday, August 18, 2011 10:03 AM To: common-dev@hadoop.apache.org Subject: Re: question about file input format Grace, In that

Re: [VOTE] Should we release 0.20.204.0rc2?

2011-08-18 Thread Allen Wittenauer
On Aug 18, 2011, at 12:28 AM, Owen O'Malley wrote: > > This vote is still running with no votes other than mine. > > I've tested with and without security on a 60 node cluster and I'm seeing > some failures, but not that many. On a terasort with 15,000 maps and 200 > reduces, I ran the follow

[jira] [Created] (HADOOP-7555) Add a eclipse-generated files to .gitignore

2011-08-18 Thread Aaron T. Myers (JIRA)
Add a eclipse-generated files to .gitignore --- Key: HADOOP-7555 URL: https://issues.apache.org/jira/browse/HADOOP-7555 Project: Hadoop Common Issue Type: Improvement Components: build Af

Re: [VOTE] Should we release 0.20.204.0rc2?

2011-08-18 Thread Jakob Homan
>> This vote is still running with no votes other than mine. The vote was started 9 days ago and, if it kept running after Allen's vote, it would have ended three days ago with the result of 1-0 to release. As such, let's call this release 2Owen3.

Re: [VOTE] Should we release 0.20.204.0rc2?

2011-08-18 Thread Mahadev Konar
Jokes aside, I intend to try it out on a set of 10 nodes or so and see if it works or not. If it works fine (barring a few task failures), I dont see any reason why this cannot be released. thanks mahadev On Aug 18, 2011, at 11:35 AM, Jakob Homan wrote: >>> This vote is still running with n

[jira] [Created] (HADOOP-7556) TaskLogAppender does not check if closed before flushing

2011-08-18 Thread Aaron Morton (JIRA)
TaskLogAppender does not check if closed before flushing Key: HADOOP-7556 URL: https://issues.apache.org/jira/browse/HADOOP-7556 Project: Hadoop Common Issue Type: Bug Affects Vers