On Tue, Jan 3, 2023 at 3:29 PM Ferry Toth <fnt...@gmail.com> wrote: > Op 03-01-2023 om 15:18 schreef Alexander Kanavin: > > I have to note that even the most expensive 16 Gb RAM module is less > > than 100 Euro, and can be obtained for half that much. Surely you > > value your time more than that? > > Of course. And if I didn't I could reduce the number of `PARALLEL_MAKE`. > > But I have also seen bitbake attempting to build nodejs, nodejs-native > and binutils in parallel. > > I think by default there are 4 tasks, with 16 threads, each could > require 1GB RAM. Would you say, in such a case Yocto requires 64GB RAM? > > And with increasing #cores it gets worse. > > Not that it is too expensive to throw hardware at it, but it seems to be > a fundamental problem that I would like to resolve. In my spare time of > course. >
Hi Ferry, don't get discouraged from working on jobserver related issues by some remarks. Yes your HW configuration is a bit extreme, but similar issues are easily reproducible on beefier HW as well (seeing it often enough on 32c 64t AMD 3970X with 128G ram). bitbake pressure regulation helps a bit, but it's often triggered too late and also a bit too coarse grained, when single chromium do_compile task can take over an hour. I agree that make job server (or there is similar solution proposed for ninja from Andrei https://gitlab.eclipse.org/eclipse/oniro-core/oniro/-/merge_requests/196/commits ) should be more efficient solution (as it will hold off additional "shorter" jobs only during the "critical" time when some other jobs take all resources - while bitbake pressure cannot know that triggering nodejs+nodejs-native+chromium do_compile task might end badly, because the pressure was still low when these 3 were queued for execution). Also check this thread about pressure regulation in bitbake-devel: https://lists.openembedded.org/g/bitbake-devel/message/14178 Cheers,
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#58906): https://lists.yoctoproject.org/g/yocto/message/58906 Mute This Topic: https://lists.yoctoproject.org/mt/82015730/21656 Group Owner: yocto+ow...@lists.yoctoproject.org Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
