Bug 40673 - unify build parallelization and use gnu makes --load-average feature where available
Summary: unify build parallelization and use gnu makes --load-average feature where av...
Status: RESOLVED FIXED
Alias: None
Product: LibreOffice
Classification: Unclassified
Component: LibreOffice (show other bugs)
Version:
(earliest affected)
unspecified
Hardware: Other All
: medium normal
Assignee: Not Assigned
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2011-09-07 00:58 UTC by Björn Michaelsen
Modified: 2012-08-31 10:04 UTC (History)
1 user (show)

See Also:
Crash report or crash signature:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Björn Michaelsen 2011-09-07 00:58:51 UTC
The ways to specify build parallelization are way to complex and confusing.

I propose the following solution:

1) We use --with-num-cpus and --with-max-jobs and --with-sense-load
2) --with-num-cpus defaults to the number of cpus on the machine and is stored in GMAKE_PARALELLISM only
3) --with-max-jobs defaults to the number of cpus divided by two on the machine and is stored in GMAKE_MODULE_PARALELLISM only
4) --with-sense-load defaults to "T" unless using icecream or on windows (where it is "") and is stored in GMAKE_SENSE_LOAD
5) all calls to build.pl are done as:
   build.pl -P$((${GMAKE_PARALELLISM}/${GMAKE_MODULE_PARALELLISM})) -- -P${GMAKE_MODULE_PARALELLISM}
6) gbuild calls (including tail_build) are done as:
       make -srj$((${GMAKE_PARALELLISM}*4)) -l$((${GMAKE_PARALELLISM}+1))
   when GMAKE_SENSE_LOAD is not empty, or as:
       make -srj${GMAKE_MODULE_PARALELLISM}
   otherwise (exception: tail build might use GMAKE_PARALELLISM)

The variables @BUILD_NCPUS@ and @BUILD_MAX_JOBS@ will be removed.

Configure should warn, if GMAKE_MODULE_PARALELLISM is bigger than GMAKE_PARALELLISM and set it to GMAKE_PARALELLISM.
Comment 1 Björn Michaelsen 2011-12-23 12:36:34 UTC
[This is an automated message.]
This bug was filed before the changes to Bugzilla on 2011-10-16. Thus it
started right out as NEW without ever being explicitly confirmed. The bug is
changed to state NEEDINFO for this reason. To move this bug from NEEDINFO back
to NEW please check if the bug still persists with the 3.5.0 beta1 or beta2 prereleases.
Details on how to test the 3.5.0 beta1 can be found at:
http://wiki.documentfoundation.org/QA/BugHunting_Session_3.5.0.-1

more detail on this bulk operation: http://nabble.documentfoundation.org/RFC-Operation-Spamzilla-tp3607474p3607474.html
Comment 2 Florian Reisinger 2012-08-14 13:58:49 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 3 Florian Reisinger 2012-08-14 14:00:03 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 4 Florian Reisinger 2012-08-14 14:04:43 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 5 Florian Reisinger 2012-08-14 14:06:50 UTC
Dear bug submitter!

Due to the fact, that there are a lot of NEEDINFO bugs with no answer within the last six months, we close all of these bugs.

To keep this message short, more infos are available @ https://wiki.documentfoundation.org/QA/NeedinfoClosure#Statement

Thanks for understanding and hopefully updating your bug, so that everything is prepared for developers to fix your problem.

Yours!

Florian
Comment 6 Björn Michaelsen 2012-08-15 18:15:51 UTC
actually has been fixed by Norbert
Comment 7 Rainer Bielefeld Retired 2012-08-17 05:28:12 UTC
@Björn:
Can you add some rough target info in brackets?
Comment 8 Björn Michaelsen 2012-08-17 08:50:46 UTC
I think we where there by 3.5.X but Im not sure. The release is less relevant here as it is a developer task that was mostly caned about on master.