RE: Jobtrackers scalability

2010-03-03 Thread kartik
hai geeks, The functionality of the job tracker is to divide the job among the tasktrackers and monitor the progress of the task, and even the job also... Do we address a situation where we have similar commodity hardware deployed suppose of 2GB RAM and there are some 1 nodes and

[jira] Created: (HADOOP-6610) Hadoop conf/ servlet improvements

2010-03-03 Thread Steve Loughran (JIRA)
Hadoop conf/ servlet improvements - Key: HADOOP-6610 URL: https://issues.apache.org/jira/browse/HADOOP-6610 Project: Hadoop Common Issue Type: Improvement Components: conf Affects Versions: 0.22.

RE: Jobtrackers scalability

2010-03-03 Thread Segel, Mike
Hi, What exactly do you mean by 'commodity' hardware? I mean if you have the budget to build out a 10,000 node cloud, don't you think you'd have the money to beef up your job tracker? With respect to the job tracker, its more memory intensive than disk, right? So how many nodes can you run in a

profiling

2010-03-03 Thread KARASZI Istvan
hello! is there a way to profile a map/reduce algorithm with the new API? I could not find any way to do this. I set the "mapred.task.profile" with the Configuration.setBoolean() but it does nothing. -- KARASZI Istvan

[jira] Created: (HADOOP-6611) Fix javac warnings introduced by HADOOP-6584

2010-03-03 Thread Jakob Homan (JIRA)
Fix javac warnings introduced by HADOOP-6584 Key: HADOOP-6611 URL: https://issues.apache.org/jira/browse/HADOOP-6611 Project: Hadoop Common Issue Type: Bug Components: security

[jira] Resolved: (HADOOP-6611) Fix javac warnings introduced by HADOOP-6584

2010-03-03 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan resolved HADOOP-6611. - Resolution: Invalid This patch should be attached to 6584, since the trunk patch won't have thes

[jira] Created: (HADOOP-6612) Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled

2010-03-03 Thread Boris Shkolnik (JIRA)
Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled --- Key: HADOOP-6612 URL: https://i

[jira] Created: (HADOOP-6613) RPC server should check for version mismatch first

2010-03-03 Thread Kan Zhang (JIRA)
RPC server should check for version mismatch first -- Key: HADOOP-6613 URL: https://issues.apache.org/jira/browse/HADOOP-6613 Project: Hadoop Common Issue Type: Bug Components: ipc, s