Thanks Reuti, I need $PE_HOSTFILE when my prolog script is executed on the compute node. Ideally, the prolog script parses the $PE_HOSTFILE, get the # of slots are allocated for this job, then calculates the actual tmp storage requirement (in conjunction with user's specified per-slot consumable value).
I will experiment it a bit more. Cheers, D On Tue, Oct 4, 2016 at 5:49 PM, Reuti <re...@staff.uni-marburg.de> wrote: > > Am 04.10.2016 um 03:41 schrieb Derrick Lin: > > > Hi all again, > > > > I have had a simple implementation working. Now I need to look at a > situation when -pe is specified. It looks like the accurate way to > determine host/slot allocation is to get from $pe_hostfile. But > $pe_hostfile seems to be available only in start_proc_args. > > Where do you need it? The $PE_HOSTFILE is also available in the jobscript. > > When you access $SGE_JOB_SPOOL_DIR/pe_hostfile directly, it's even there > for serial jobs. > > -- Reuti > > > > > Does this mean in -pe situation, the quota should be created in a script > that is specified in start_proc_args instead of prolog? > > > > Thanks > > > > On Tue, Sep 13, 2016 at 5:51 PM, William Hay <w....@ucl.ac.uk> wrote: > > On Tue, Sep 13, 2016 at 03:15:19PM +1000, Derrick Lin wrote: > > > Thanks guys, > > > I am implementing the solution as outlined by William, except we > are using > > > XFS here, so we are trying to do it by using XFS's project/directory > > > quota. Will do more testing and see how it goes.. > > > Cheers, > > > Derrick > > I should probably add that one reason we're going to btrfs is that it > allows us to > > take a snapshot when checkpointing so we can have a file system image > that is > > consistent with the process image while pausing the process for the > shortest > > time possible. Snapshotting XFS is a little trickier. > > > > > > William > > > >
_______________________________________________ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
