That is correct. Seems like something else is happening.
One thing to see if all your users or more importantly their group is added to
the cluster-admin acl (mapreduce.cluster.administrators)
You should look at mapreduce audit logs (which by default go into JobTracker
logs, search for Audit).
Hi Mikhail,
Could you please explain how we can track all the kill requests for a job?
Is there any feature available in hadoop stack for this? Or do we need to
track this in OS layer by capturing the signals?
Thanks,
Pandeesh
On Jul 31, 2013 12:03 AM, "Mikhail Antonov" wrote:
> In addition to
In addition to using job's ACLs you could have more brutal schema. Track
all requests to kill the jobs, and if any request is coming from the user
who should't be trying to kill this particular job, then ssh from the
script to his client machine and forcibly reboot it :)
2013/7/30 Edward Capriolo
I'm not sure how I should do that.
The documentation says "A job submitter can specify access control
lists for viewing or modifying a job via the configuration properties
mapreduce.job.acl-view-job and mapreduce.job.acl-modify-job
respectively. By default, nobody is given access in these properti
Honestly tell your users to stop being jerks. People know if they kill my
query there is going to be hell to pay :)
On Tue, Jul 30, 2013 at 2:25 PM, Vinod Kumar Vavilapalli wrote:
>
> You need to set up Job ACLs. See
> http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Job+Authorization
You need to set up Job ACLs. See
http://hadoop.apache.org/docs/stable/mapred_tutorial.html#Job+Authorization.
It is a per job configuration, you can provide with defaults. If the job owner
wishes to give others access, he/she can do so.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://
Hi there,
I am trying to introduce some sort of security to prevent different
people using the cluster from interfering with each other's jobs.
Following the instructions at
http://hadoop.apache.org/docs/stable/cluster_setup.html and
https://www.inkling.com/read/hadoop-definitive-guide-tom-white-
