On 19/08/16 19:47, Gokcehan Kara wrote: > So the problem is that she says after a while (~3000 jobs) jobs start to > take some time before scheduled. We thought it might be related to some > slurm settings about fairness or such but couldn't find anything about > it. Is there a way to disable this waiting time?
What we do (as a general policy rather than for this issue) is to ensure that all submitted jobs go straight into the backfill scheduler and don't trigger an immediate scheduling attempt. That's done with the defer option: SchedulerParameters=bf_window=43200,bf_resolution=600,bf_max_job_user=5,bf_max_job_start=10000,bf_continue,defer,kill_invalid_depend # defer - Setting this option will avoid attempting to schedule # each job individually at job submit time, but defer it until # a later time when scheduling multiple jobs simultaneously may # be possible. This option may improve system responsiveness # when large numbers of jobs (many hundreds) are submitted at the # same time, but it will delay the initiation time of individual # jobs. Hope that helps! Chris -- Christopher Samuel Senior Systems Administrator VLSCI - Victorian Life Sciences Computation Initiative Email: [email protected] Phone: +61 (0)3 903 55545 http://www.vlsci.org.au/ http://twitter.com/vlsci
