Re: 0.20.205.0 Release Candidate 1 Testing

2011-10-06 Thread Suresh Srinivas
This change has been already committed to 205 and 20-security (thanks Aaron). On Wed, Oct 5, 2011 at 11:09 PM, Stack wrote: > I found what I think a critical issue w/ RC1. May we get > https://issues.apache.org/jira/browse/HDFS-2408 into RC2? > > Thanks, > St.Ack > > > > On Tue, Oct 4, 2011 at

Build failed in Jenkins: Hadoop-Common-trunk #189

2011-10-06 Thread Apache Jenkins Server
See Changes: [atm] HADOOP-7695. RPC.stopProxy can throw unintended exception while logging error (atm) [atm] HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm) [vinodkv] MAPREDUCE-2913. Fix

Re: 0.20.205.0 Release Candidate 1 Testing

2011-10-06 Thread Stack
Thanks lads, St.Ack On Thu, Oct 6, 2011 at 12:50 AM, Suresh Srinivas wrote: > This change has been already committed to 205 and 20-security (thanks > Aaron). > > On Wed, Oct 5, 2011 at 11:09 PM, Stack wrote: > >> I found what I think a critical issue w/ RC1.  May we get >> https://issues.apache.

Re: 0.20.205.0 Release Candidate 1 Testing

2011-10-06 Thread Matt Foley
Thanks for the good catch! On Thu, Oct 6, 2011 at 8:05 AM, Stack wrote: > Thanks lads, > St.Ack > > On Thu, Oct 6, 2011 at 12:50 AM, Suresh Srinivas > wrote: > > This change has been already committed to 205 and 20-security (thanks > > Aaron). > > > > On Wed, Oct 5, 2011 at 11:09 PM, Stack wro

Re: Hadoop on Eclipse

2011-10-06 Thread Prasanth J
Am also facing the exact issue. I think the documentation for setting up hadoop on eclipse is for older versions of hadoop. Now i am using hadoop 0.24.0 snapshot and with reference to that the documentation seems outdated. Any help on this regard will be very useful. On Wed, Oct 5, 2011 at 10:34 P

Viewing hadoop mapper output

2011-10-06 Thread Aishwarya Venkataraman
Hello, I want to view the mapper output for a given hadoop streaming jobs (that runs a shell script). However I am not able to find this in any log files. Where should I look for this ? Thanks, Aishwarya

Re: Viewing hadoop mapper output

2011-10-06 Thread Robert Evans
A streaming jobs stderr is logged for the task, but its stdout is what is sent to the reducer. The simplest way to get it is to turn off the reducers, and then look at the output in HDFS. --Bobby Evans On 10/6/11 1:16 PM, "Aishwarya Venkataraman" wrote: Hello, I want to view the mapper outp

Re: Viewing hadoop mapper output

2011-10-06 Thread Aishwarya Venkataraman
I ran the following (I am using IdentityReducer) : ./hadoop jar ../contrib/streaming/hadoop-0.20.2-streaming.jar -file ~/mapper.sh -mapper ~/mapper.sh -input ../foo.txt -output output When I do ./hadoop dfs -cat output/* I do not see any output on screen. Is this how I view the output of mapper ?

Re: Viewing hadoop mapper output

2011-10-06 Thread Robert Evans
Alshwarya, Are you running in local mode? If not you probably want to run hadoop jar ../contrib/streaming/hadoop-0.20.2-streaming.jar -file ~/mapper.sh -mapper ./mapper.sh -input ../foo.txt -output output You may also want to run hadoop fs -ls output/* to see what files were produced. If you

svn commit fails

2011-10-06 Thread Alejandro Abdelnur
Newbie committer here, I may be missing something but I'm unable to do a commit due to the following error. Any idea? Thanks. Alejandro SVN commit error: - dontknow:svn tucu$ svn commit -m "HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)" Authentication realm:

Re: svn commit fails

2011-10-06 Thread Konstantin Boudnik
You don't have commit permissions. Ian should be able to help. Cos On Thu, Oct 06, 2011 at 03:33PM, Alejandro Abdelnur wrote: > Newbie committer here, > > I may be missing something but I'm unable to do a commit due to the > following error. > > Any idea? > > Thanks. > > Alejandro > > SVN co

Hadoop for unstructured data storage

2011-10-06 Thread Hemant kulkarni
Hi all, We are a small software development firm working on data backup software. We have a backup product which copies data from client machine to data store. Currently we provide a specialized hardware to store data(1-3TB disks and servers). We want to provide solution to some customers(mining co

Re: Hadoop for unstructured data storage

2011-10-06 Thread Ted Dunning
HDFS does not really meet your needs. I think that MapR's solution would. I will contact off-line to give details. On Thu, Oct 6, 2011 at 3:35 PM, Hemant kulkarni wrote: > Hi all, > We are a small software development firm working on data backup > software. We have a backup product which copies

[jira] [Created] (HADOOP-7724) proxy user info should go to the core-site.xml

2011-10-06 Thread Giridharan Kesavan (Created) (JIRA)
proxy user info should go to the core-site.xml --- Key: HADOOP-7724 URL: https://issues.apache.org/jira/browse/HADOOP-7724 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.20.205.0

[jira] [Created] (HADOOP-7725) fix test-patch so that Jenkins can accept patches to the hadoop-tools module.

2011-10-06 Thread Alejandro Abdelnur (Created) (JIRA)
fix test-patch so that Jenkins can accept patches to the hadoop-tools module. - Key: HADOOP-7725 URL: https://issues.apache.org/jira/browse/HADOOP-7725 Project: Hadoop Common

[jira] [Created] (HADOOP-7726) eclipse plugin does not build with 0.20.205

2011-10-06 Thread Tim Broberg (Created) (JIRA)
eclipse plugin does not build with 0.20.205 --- Key: HADOOP-7726 URL: https://issues.apache.org/jira/browse/HADOOP-7726 Project: Hadoop Common Issue Type: Bug Components: contrib/eclipse-plug

Re: Hadoop on Eclipse

2011-10-06 Thread Tim Broberg
After still more puttering, I gave up and just logged this in jira. https://issues.apache.org/jira/browse/HADOOP-7726     - Tim. From: Prasanth J To: common-dev@hadoop.apache.org; Tim Broberg Sent: Thursday, October 6, 2011 11:02 AM Subject: Re: Hadoop on Ec

[jira] [Resolved] (HADOOP-7613) invalid common pom breaking HDFS build

2011-10-06 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HADOOP-7613. - Resolution: Cannot Reproduce seems this is fixed now > invalid common pom break

Re: Viewing hadoop mapper output

2011-10-06 Thread Aishwarya Venkataraman
Robert, My mapper job fails. I am basically trying to run a crawler on hadoop and hadoop kills the crawler (mapper) if it has not heard from it for a certain timeout period. But I already have a timeout set in my mapper(500 seconds) which is lesser than hadoop's timeout(900 seconds). The mapper ju