Re: last map task taking too long

2009-09-30 Thread achilles852
Yes, I did everything I could think of, but nothing has worked so far. I even set the number of reducers to zero, just to be sure. What I don't understand is, if all of the map tasks are using the same code, then why do the first few tasks complete normally while the last one takes ages. Do you th

[jira] Created: (HADOOP-6293) FsShell -text should work on filesystems other than the default

2009-09-30 Thread Chris Douglas (JIRA)
FsShell -text should work on filesystems other than the default --- Key: HADOOP-6293 URL: https://issues.apache.org/jira/browse/HADOOP-6293 Project: Hadoop Common Issue Type: Bug

[jira] Created: (HADOOP-6292) Native Libraries Guide - Update

2009-09-30 Thread Corinne Chandel (JIRA)
Native Libraries Guide - Update Key: HADOOP-6292 URL: https://issues.apache.org/jira/browse/HADOOP-6292 Project: Hadoop Common Issue Type: Task Components: documentation Affects Versions: 0.21.

Re: last map task taking too long

2009-09-30 Thread Thushara Wijeratna
did you look for network-related errors in the logs. i've found instances when a VPN connection confused networking in hadoop. (could be a JVM issue, didn't spend the time to know for sure) thanks, thushara On Wed, Sep 30, 2009 at 1:46 AM, achilles852 wrote: > > Running Hadoop on EC2 using 32 b

RE: last map task taking too long

2009-09-30 Thread achilles852
Running Hadoop on EC2 using 32 bit small instances with 5 slaves. The job has 5 map tasks and 1 reduce task. Each map task is 5 minutes long. After 5 minutes and 14 seconds, 4 map tasks completed but the last one is now stalling the entire process. Here are the logs for JobTracker: --

[jira] Resolved: (HADOOP-3197) Deadlock in DFCClient

2009-09-30 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur resolved HADOOP-3197. -- Resolution: Cannot Reproduce I am closing this because this is on a very old release a