On Mon, Jul 25, 2022 at 06:58:54AM +0800, Qian Yun wrote:
>
>
> On 7/25/22 02:47, Waldek Hebisch wrote:
> >On Sun, Jul 24, 2022 at 09:29:24PM +0800, Qian Yun wrote:
> >>As you know, the majority time of building FriCAS is to compile
> >>over 1000 SPAD files to LSP files and then to LISP_BIN file.
> >>Luckily, this step can be paralleled.
> >>
> >>So on a multi-core machine, to reduce build time, the focus should
> >>be on the serial part of build process.
> >>
> >>The building of algebra/*daase is the most important serial part.
> >>
> >>I'm not entirely familiar with the process, but it seems there
> >>are a few stages to generate daase, and each stage requires to
> >>compile many (if not full) spad files, and the compiled result
> >>is discarded.
> >
> >More precisely, the result is replaced by result of subsequent
> >compilation. But we compile them because we need to load
> >some of them (at it is tricky to decide if we can skip some).
>
> Yes, the step "make stamp-oboo3" loads some files, but we can
> use "compile-file before load" to just compile the needed files.
>
> >> So I think in this step, it is wasteful to compile
> >>these *lsp file to *fasl file, especially for SBCL with :SB-FASTEVAL.
> >
> >Quite likely.
>
> Another motivation for this compile speed optimization is that,
> when I was compiling use ECL, the total time is over 20 minutes,
> and I guess the daase step takes around 10 minutes.
Current trunk, ECL 16.1.2 with -j 10 (on quad core machine with
hyperthreading) needs:
real 16m42.871s
user 61m26.912s
sys 2m54.504s
Of that 350 sec goes into boo_db stage.
> The following is the diff I used during experiment.
> (This is without the compile-before-load optimization.)
With that boo_db stage goes down to 118 s. However,
build fails at end of spad compile stage (before
generating HyperDoc pages) and the time is:
real 13m42.144s
user 74m20.816s
sys 2m32.908s
so real time may be lower, but there is increase in
CPU time. I do not know why, maybe loading compiled
files is cheaper than loading Lisp...
--
Waldek Hebisch
--
You received this message because you are subscribed to the Google Groups
"FriCAS - computer algebra system" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/fricas-devel/20220725150651.GA22011%40fricas.math.uni.wroc.pl.
