Commit Graph

18797 Commits

Author SHA1 Message Date
Graham Christensen
c2b898da76 treewide: drop -l$NIX_BUILD_CORES
Passing `-l$NIX_BUILD_CORES` improperly limits the overall system load.

For a build machine which is configured to run `$B` builds where each
build gets `total cores / B` cores (`$C`), passing `-l $C` to make will
improperly limit the load to `$C` instead of `$B * $C`.

This effect becomes quite pronounced on machines with 80 cores, with
40 simultaneous builds and a cores limit of 2. On a machine with this
configuration, Nix will run 40 builds and make will limit the overall
system load to approximately 2. A build machine with this many cores
can happily run with a load approaching 80.

A non-solution is to oversubscribe the machine, by picking a larger
`$C`. However, there is no way to divide the number of cores in a way
which fairly subdivides the available cores when `$B` is greater than
1.

There has been exploration of passing a jobserver in to the sandbox,
or sharing a jobserver between all the builds. This is one option, but
relatively complicated and only supports make. Lots of other software
uses its own implementation of `-j` and doesn't support either `-l` or
the Make jobserver.

For the case of an interactive user machine, the user should limit
overall system load using `$B`, `$C`, and optionally systemd's
cpu/network/io limiting features.

Making this change should significantly improve the utilization of our
build farm, and improve the throughput of Hydra.
2022-09-22 16:01:23 -04:00
github-actions[bot]
2773f22a43
Merge staging-next into staging 2022-09-21 18:02:00 +00:00
github-actions[bot]
57e15d64c3
Merge master into staging-next 2022-09-21 18:01:25 +00:00
superherointj
fd82ce6fae
Merge pull request #192185 from NickCao/nvidia
linuxPackages.nvidia_x11: 515.65.01 -> 515.76
2022-09-21 11:00:28 -03:00
github-actions[bot]
ef4dc6ef6a
Merge staging-next into staging 2022-09-21 12:02:28 +00:00
github-actions[bot]
15bbf4d3fc
Merge master into staging-next 2022-09-21 12:01:48 +00:00
Sandro
26ce434926
Merge pull request #192060 from wegank/prl-tools-update 2022-09-21 11:33:04 +02:00
Nick Cao
60b61935ad
linuxPackages.nvidia_x11: 515.65.01 -> 515.76 2022-09-21 13:01:08 +08:00
github-actions[bot]
1b62f29126
Merge staging-next into staging 2022-09-21 00:04:25 +00:00
github-actions[bot]
7da9ac9ae6
Merge master into staging-next 2022-09-21 00:03:46 +00:00
github-actions[bot]
8f0ab599e7
Merge staging-next into staging 2022-09-20 18:02:06 +00:00
github-actions[bot]
2f49e0bb89
Merge master into staging-next 2022-09-20 18:01:23 +00:00
PedroHLC ☭
79359cc1e2
linux-zen: 5.19.9 -> 5.19.10 2022-09-20 13:46:57 -03:00
PedroHLC ☭
7c03f6b13a
linux-lqx: 5.19.9 -> 5.19.10 2022-09-20 13:45:54 -03:00
Sandro
95d3c49389
Merge pull request #175406 from SuperSandro2000/systemd-null 2022-09-20 17:09:26 +02:00
github-actions[bot]
abd82bc57d
Merge staging-next into staging 2022-09-20 12:02:05 +00:00
github-actions[bot]
1edfa00d80
Merge master into staging-next 2022-09-20 12:01:29 +00:00
Weijia Wang
e15bc1fadd prl-tools: 18.0.1-53056 -> 18.0.2-53077 2022-09-20 12:28:34 +02:00
Jonas Heinrich
77984dedc4
Merge pull request #191851 from wentasah/usbrelay-1.0.1
usbrelay: 1.0 -> 1.0.1
2022-09-20 12:23:36 +02:00
github-actions[bot]
5fa64c31c5
Merge staging-next into staging 2022-09-19 18:03:20 +00:00
Martin Weinelt
f1dcc2356b
Merge pull request #191333 from NixOS/python-updates 2022-09-19 18:23:07 +02:00
Martin Weinelt
5b5df09987
waydroid: build with format other 2022-09-19 16:06:09 +02:00
Martin Weinelt
b60e4d71d6 python3Packages.python-ldap: rename from ldap 2022-09-19 10:37:49 +02:00
github-actions[bot]
17ef793813
Merge staging-next into staging 2022-09-19 06:24:53 +00:00
Vladimír Čunát
a5dfac88d5
Merge branch 'master' into staging-next
The java conflicts weren't trivial.  Hopefully OK.
2022-09-19 07:40:23 +02:00
Michal Sojka
ec026d26d2 usbrelay: 1.0 -> 1.0.1 2022-09-18 22:54:13 +02:00
K900
ee024891bd linux-firmware: 20220815 -> 20220913, add overengineered update script 2022-09-18 19:37:06 +03:00
github-actions[bot]
d5cae016d9
Merge staging-next into staging 2022-09-18 12:02:15 +00:00
github-actions[bot]
7b5db3faac
Merge master into staging-next 2022-09-18 12:01:40 +00:00
Linus Heckemann
fb517fc0b0
Merge pull request #191672 from Ma27/rm-kernel-18
linux: remove 5.18
2022-09-18 12:09:02 +02:00
Vladimír Čunát
b7b04a1c09
Merge branch 'master' into staging-next
The point is to include the revert of `bpftools` rebuild.
2022-09-18 10:52:01 +02:00
Vladimír Čunát
192b63e225
bpftools: revert version to the one that's fully rebuilt
That's before 9f80f6bfa9 (PR #191364).
2022-09-18 08:26:51 +02:00
Vladimír Čunát
f12d2f016b
bpftools: decouple version from linux_latest
bpftools causes way too many rebuilds nowadays,
so its updates are not suitable for merging directly to nixpkgs master.
We want to update linux_latest faster than that.
2022-09-18 08:25:17 +02:00
maxine [they]
2ba9b16c37
Merge pull request #191290 from r-ryantm/auto-update/ell 2022-09-18 01:06:27 +02:00
Maxine Aubrey
68bc381eb5
iwd: 1.29 -> 1.30
https://git.kernel.org/pub/scm/network/wireless/iwd.git/tree/ChangeLog?h=1.30
2022-09-17 20:20:00 +02:00
github-actions[bot]
f2681f8bd1
Merge master into staging-next 2022-09-17 18:01:15 +00:00
Maximilian Bosch
a2969b43bb
linux: remove 5.18
This is long overdue, the last release was almost a month ago, on 21st
Aug 2022[1].

[1] https://lwn.net/Articles/905532/
2022-09-17 17:06:58 +02:00
Maximilian Bosch
b561e2cad4
Merge pull request #191364 from superherointj/kernel-upgrade-5.19.9
linux: 5.19.8 -> 5.19.9
2022-09-17 15:18:04 +02:00
github-actions[bot]
5b2ff5fc26
Merge master into staging-next 2022-09-16 18:02:08 +00:00
PedroHLC ☭
3b6bcd3c78
linux-lqx: 5.19.8 -> 5.19.9 2022-09-16 11:14:01 -03:00
PedroHLC ☭
a200b12139
linux-zen: 5.19.8 -> 5.19.9 2022-09-16 11:12:02 -03:00
github-actions[bot]
40936b496d
Merge master into staging-next 2022-09-16 00:03:19 +00:00
Yuka
1315a28f88
musl: apply patch for optional fields in fstab (#191033) 2022-09-15 20:38:48 +02:00
superherointj
558d9998a7 linux_latest-libre: 18904 -> 18911 2022-09-15 14:55:50 -03:00
superherointj
18a8634d15 linux: 5.4.212 -> 5.4.213 2022-09-15 14:55:22 -03:00
superherointj
9f80f6bfa9 linux: 5.19.8 -> 5.19.9 2022-09-15 14:55:13 -03:00
superherointj
087dde20eb linux: 5.15.67 -> 5.15.68 2022-09-15 14:55:02 -03:00
superherointj
2875584458 linux: 5.10.142 -> 5.10.143 2022-09-15 14:54:50 -03:00
superherointj
ba9e102d79 linux: 4.9.327 -> 4.9.328 2022-09-15 14:54:40 -03:00
superherointj
d233f0c847 linux: 4.19.257 -> 4.19.258 2022-09-15 14:54:32 -03:00