Re: Remote access to cluster with superuser privileges from untrusted IPs

A lot of security related JIRAs are linked to http://issues.apache.org/jira/browse/HADOOP-4487 thanks, dhruba On Sun, Aug 2, 2009 at 10:36 PM, Palleti, Pallavi < pallavi.pall...@corp.aol.com> wrote: > Thanks Dhruba. I will do that. Also, could you refer me to any > documentation/link regarding

RE: Remote access to cluster with superuser privileges from untrusted IPs

Thanks Dhruba. I will do that. Also, could you refer me to any documentation/link regarding any work happening in this regard. I would be interested in participating/contributing in it. Thanks Pallavi -Original Message- From: Dhruba Borthakur [mailto:dhr...@gmail.com] Sent: Monday, Augus

Re: Remote access to cluster with superuser privileges from untrusted IPs

Hi Pallavi, You are always welcome to post you code as a patch to a JIRA. Even if it does not get committed to the Hadoop code base, you can always refer people to your patch in the JIRA and ask them to use it. thanks, dhruba On Sun, Aug 2, 2009 at 8:54 PM, Palleti, Pallavi < pallavi.pall...@cor

RE: why reduce task can be scheduled before map tasks are 100% completed?

And the combiner runs while fetching the outputs right? -Original Message- From: Arun C Murthy [mailto:a...@yahoo-inc.com] Sent: Monday, August 03, 2009 9:27 AM To: mapreduce-...@hadoop.apache.org Cc: common-dev@hadoop.apache.org Subject: Re: why reduce task can be scheduled before map ta

Re: why reduce task can be scheduled before map tasks are 100% completed?

That check ensures sufficient #maps are completed before any of the reduces for the job are started. The reduces 'shuffle' map outputs from completed maps, but don't get into the 'reduce' phase until all map-outputs are copied over. Arun PS: Moving this to mapreduce-dev@ On Aug 2, 2009, a

RE: Remote access to cluster with superuser privileges from untrusted IPs

Can someone kindly let me know whether any work is happening in this regard. If not, I would like to add a patch which might be useful for many. Thanks Pallavi -Original Message- From: Palleti, Pallavi [mailto:pallavi.pall...@corp.aol.com] Sent: Friday, July 31, 2009 12:20 PM To: common-

Re: why reduce task can be scheduled before map tasks are 100% completed?

Even though reduces are scheduled, they just transfer data from maps before all maps are completed.The reduce only begins its processing when all maps are completed. Please correct me if I'm wrong. regards, 2009/8/2 我的Gmail邮箱 > Hi, everyone. > In class org.apache.hadoop.mapred.JobInProgress,

why reduce task can be scheduled before map tasks are 100% completed?

Hi, everyone. In class org.apache.hadoop.mapred.JobInProgress, there is a public method: scheduleReduces(), it will return true if "finishedMapTasks >= completedMapsForReduceSlowstart" and then the scheduler can schedule a new reduce task for a given taskTracker. but as I konw, reduce can not be s