Hello everyone! We are happy to announce that toolforge jobs framework now supports multiple replicas for continuous jobs!
There are times when you might need to run multiple instances of the same thing (e.g. multiple processes). This change allows you to do that using the `--replicas` option. An example command would be something like `toolforge jobs run multi-replica-con-job --command ./command.sh --image bookworm --continuous --replicas 5` The log output from each of the running instances will be aggregated and can be streamed (if you are using the --no-filelog option) or written to the log files. Note: This can only be configured for continuous jobs. Note: There is no limit to the number of replicas you can specify, but running too many replicas can exceed the resource quota assigned to each job/tool by default. If this happens the job may fail to run, with out-of-quota error message displayed. Also, a reminder that you can find this and smaller user-facing updates about the Toolforge platform features here: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Changelog Original task: https://phabricator.wikimedia.org/T341066 -- Ndibe Raymond Olisaemeka Software Engineer II - Technical Engagement Wikimedia Foundation <https://wikimediafoundation.org/> _______________________________________________ Cloud-announce mailing list -- [email protected] List information: https://lists.wikimedia.org/postorius/lists/cloud-announce.lists.wikimedia.org/
