DragonFly users List (threaded) for 2011-11
Significantly faster concurrent buildworld times
I did a pass on the buildworld infrastructure and added a new
features to allow SUBDIR recursions to run concurrently. This
should improve buildworld -j 12 (or similar) significantly. I
was able to get a 28% improvement on our quad-core (8 thread) Xeons
(1075 -> 769 seconds).
This is still a bit experimental in that there may be build dependencies
that we haven't ferreted out yet. In particular, you might have to
update your 'install' program to the latest in master to avoid a race
inside its mkdir() function which could error-out the build (only if you
are doing make -j N on your buildworlds).
This work cleaned up probably 70-80% of the bottlenecks we had in the
buildworld. There are far fewer periods showing idle cpu during the
build with these changes.