[
https://issues.apache.org/jira/browse/HIVE-13696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reuben Kuhnert updated HIVE-13696:
----------------------------------
Description:
Ensure that jobs are placed into the correct queue according to
{{fair-scheduler.xml}}. Jobs should be placed into the correct queue, and users
should not be able to submit jobs to queues they do not have access to.
This patch builds on the existing functionality in {{FairSchedulerShim}} to
route jobs to user-specific queue based on {{fair-scheduler.xml}} configuration
(leveraging the Yarn {{QueuePlacementPolicy}} class). In addition to
configuring job routing at session connect (current behavior), the routing is
validated per submission to yarn (when impersonation is off). A
{{FileSystemWatcher}} class is included to monitor changes in the
{{fair-scheduler.xml}} file (so updates are automatically reloaded when the
file pointed to by {{yarn.scheduler.fair.allocation.file}} is changed).
was:Ensure that jobs are placed into the correct queue according to
{{fair-scheduler.xml}}. Jobs should be placed into the correct queue, and users
should not be able to submit jobs to queues they do not have access to.
> Validate jobs submitted to fair-scheduler
> -----------------------------------------
>
> Key: HIVE-13696
> URL: https://issues.apache.org/jira/browse/HIVE-13696
> Project: Hive
> Issue Type: Improvement
> Reporter: Reuben Kuhnert
> Assignee: Reuben Kuhnert
> Attachments: HIVE-13696.01.patch
>
>
> Ensure that jobs are placed into the correct queue according to
> {{fair-scheduler.xml}}. Jobs should be placed into the correct queue, and
> users should not be able to submit jobs to queues they do not have access to.
> This patch builds on the existing functionality in {{FairSchedulerShim}} to
> route jobs to user-specific queue based on {{fair-scheduler.xml}}
> configuration (leveraging the Yarn {{QueuePlacementPolicy}} class). In
> addition to configuring job routing at session connect (current behavior),
> the routing is validated per submission to yarn (when impersonation is off).
> A {{FileSystemWatcher}} class is included to monitor changes in the
> {{fair-scheduler.xml}} file (so updates are automatically reloaded when the
> file pointed to by {{yarn.scheduler.fair.allocation.file}} is changed).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
