On Jun 7, 10:21 am, Robert Bradshaw <[EMAIL PROTECTED]>
wrote:
> On Jun 7, 2008, at 1:10 AM, Dr. David Kirkby wrote:
Hi Dave,
> > A lot of Sage compilation is about compiling different .spkg files.
> > Since these are independent of each other, I suspect these could be
> > compiled in parallel on machines of those with multiple cores or
> > multiple CPUs. Where as parallel builds on software can be a bit
> > tricky unless the makefile is well written, I believe Sage's build
> > process, with very separate modules, could be done in parallel with no
> > risk.
As is if you export MAKE="make -jN" Sage will build spkgs with
parallel make unless that spkg is known broken. Two such cases are
ATLAS and Singular, so they do eat a lot of time.
The idea to actually build a number of spkgs in parallel has been
suggested, but there are a couple reasons that has not happened:
a) about a dozen spkgs have tuning code that would result in
suboptimal settings if they were build in parallel on a loaded machine
b) the logging as is just writes stdout to a file. should we build
more than one spkg in parallel we would have to deal with that or
otherwise the log would be next to useless due to interleaving log
output
c) parallel spkg build introduces a whole new class of build bugs,
which admittedly should be fixed. But with MAKE set properly I only
see limited speedup potential.
Gary has actually suggested some mechanism to use pbuild for parallel
spkgs builds, but I remain skeptical until I see the code being
written and working in even the majority of cases.
> There is interdependency between several of the .spkg files (e.g. gmp
> -> ntl -> ..., and a lot of things depend on python), but once these
> are sorted out I'm sure you're right there could probably be a lot of
> building done in parallel.
I think dependecy-wise we are pretty good, so if anybody wants to give
it a shot to see what happens please let us know and report problems.
> - Robert
Cheers,
Michael
--~--~---------~--~----~------------~-------~--~----~
To post to this group, send email to sage-devel@googlegroups.com
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at http://groups.google.com/group/sage-devel
URLs: http://www.sagemath.org
-~----------~----~----~----~------~----~------~--~---
