Commit Graph

470597 Commits

Author SHA1 Message Date
Fabian Affolter
b15e0f6c64 python310Packages.pyskyqremote: 0.3.24 -> 0.3.25
Changelog: https://github.com/RogerSelwyn/skyq_remote/releases/tag/0.3.25
2023-04-02 22:58:46 +02:00
Adam Joseph
6c209e862e emacs: path fixes resulting from libgccjit changes
The Nix-driven bootstrap of gcc resulted in some changes to the
structure of the `libgccjit` outpaths, and also added an additional
output (`libgcc`) to `gcc`.

This commit makes the corresponding changes in the `emacs`
derivation in order to not break emacs.

Emacs is the only user of `libgccjit` in nixpkgs at the moment.
2023-04-02 13:49:54 -07:00
Adam Joseph
5f57c2e0f9 pkgs/test/stdenv/default.nix: add gcc-stageCompare
This commit adds a derivation `gcc-stageCompare` to
`pkgs/test/stdenv/default.nix`.

It is important to always build this derivation whenever building
`stdenv`!  Because we are using a Nix-driven bootstrap instead of
gcc's built-in `--enable-bootstrap`, the `gcc` derivation no longer
performs the post-self-compilation sanity check.  You must build
this derivation in order to perform that sanity check.

The major benefit of this new approach is that the sanity check
(which involves a third compilation of gcc) can be performed
*concurrently* with all packages that depend on `stdenv`, rather
than serially.  Since `stdenv` has very little derivation-level
parallelism it cannot take advantage of more than one or perhaps two
builders.  If you have three or more builders this commit will
reduce the time-to-rebuild-stdenv by around 20% (one of three gcc
rebuilds is removed from the critical path, and stdenv's build time
is dominated by roughly 3*gcc + 1*binutils + 1*bison-test-suite).

Co-authored-by: Sandro <sandro.jaeckel@gmail.com>
2023-04-02 13:49:53 -07:00
Adam Joseph
96588eb3de gcc: add common/checksum.nix
This commit adds `gcc/common/checksum.nix`, which contains code
common to both gcc11 and gcc12, implementing the `enableChecksum`
feature.

When gcc's built-in bootstrap (`--enable-bootstrap`) is used, gcc
compiles itself three times and compares a hash of the unlinked `.o`
files from the second and third compilation.  The
`enableChecksum=true` parameter performs the same comparison as part
of the `postInstall` phase.

Notably, `enableChecksum=true` can be used with `enableBootstrap=false`.

Co-authored-by: Sandro <sandro.jaeckel@gmail.com>
2023-04-02 13:49:53 -07:00
Adam Joseph
fed2300bea unpack-bootstrap-tools.sh: patchelf libgcc_s.so.1 2023-04-02 13:49:53 -07:00
Adam Joseph
d7fe0a5548 make-bootstrap-tools.nix: use a patchelf built with -static-{libgcc,libstdc++}
Our bootstrap-files unpacker has always relied on a lot of unstated
assumptions, one of them being that every library has a DT_NEEDED
for librt.so, so patchelf'ing something into the RUNPATH into
librt.so means that it will be searched for every library load in
all of the bootstrap-files.

Unfortunately that assumption is not true for libgcc.

This causes problems, because patchelf links against libgcc (and
against libstdc++, which links against libgcc).  So we can't use
patchelf on libgcc, because it needs libgcc, so patchelf doesn't
work until libgcc is patchelfed.

The robust solution here is to use static linking for the copy of
patchelf that is shipped with the bootstrap-files.  We don't have to
go all the way to a statically linked libc; just -static-libgcc and
-static-libstdc++ are enough to break the circular dependency.
2023-04-02 13:49:53 -07:00
Adam Joseph
86ca0faff7 make-bootstrap-tools.nix: cp libgcc_s without -d
We do not want to preserve the symlinks from libgcc_s, since they
point to another outpath.  We want to copy from that outpath rather
than link to it.
2023-04-02 13:49:53 -07:00
Adam Joseph
c6bd37a691 make-bootstrap-tools.nix: ship libisl.so
Now that we've dropped the
gcc-links-statically-to-lib{isl,mpfr,mpc,gmp} hack, our gcc needs
libisl.so.  Let's add it to the bootstrap-files.
2023-04-02 13:49:53 -07:00
Adam Joseph
7553d0fe29 stdenv: Nix-driven bootstrap of gcc
#### Summary

By default, when you type `make`, GCC will compile itself three
times.  This PR inhibits that behavior by configuring GCC with
`--disable-bootstrap`, and reimplements the triple-rebuild using
Nix rather than `make`/`sh`.

 #### Immediate Benefits

- Allow `gcc11` and `gcc12` on `aarch64` (without needing new
  `bootstrapFiles`)
- Faster stdenv rebuilds: the third compilation of gcc
  (i.e. stageCompare) is no longer a `drvInput` of the final stdenv.
  This allows Nix to build stageCompare in parallel with the rest of
  nixpkgs instead of in series.
- No more copying `libgcc_s` out of the bootstrap-files or other
  derivations
- No more Frankenstein compiler: the final gcc and the libraries it
  links against (mpfr, mpc, isl, glibc) are all built by the same
  compiler (xgcc) instead of a mixture of the bootstrapFiles'
  compiler and xgcc.
- No more [static lib{mpfr,mpc,gmp,isl}.a hack]
- Many other small `stdenv` hacks eliminated
- `gcc` and `clang` share the same codepath for more of `cc-wrapper`.

 #### Future Benefits

- This should allow using a [foreign] `bootstrap-files` so long as
  `hostPlatform.canExecute bootstrapFiles`.
- This should allow each of the libraries that ship with `gcc`
  (lib{backtrace, atomic, cc1, decnumber, ffi, gomp, iberty,
  offloadatomic, quadmath, sanitizer, ssp, stdc++-v3, vtv}) to be
  built in separate (one-liner) derivations which `inherit src;`
  from `gcc`, much like https://github.com/NixOS/nixpkgs/pull/132343

 #### Incorporates

- https://github.com/NixOS/nixpkgs/pull/210004
- https://github.com/NixOS/nixpkgs/pull/36948 (unreverted)
- https://github.com/NixOS/nixpkgs/pull/210325
- https://github.com/NixOS/nixpkgs/pull/210118
- https://github.com/NixOS/nixpkgs/pull/210132
- https://github.com/NixOS/nixpkgs/pull/210109
- https://github.com/NixOS/nixpkgs/pull/213909
- https://github.com/NixOS/nixpkgs/pull/216136
- https://github.com/NixOS/nixpkgs/pull/216237
- https://github.com/NixOS/nixpkgs/pull/210019
- https://github.com/NixOS/nixpkgs/pull/216232
- https://github.com/NixOS/nixpkgs/pull/216016
- https://github.com/NixOS/nixpkgs/pull/217977
- https://github.com/NixOS/nixpkgs/pull/217995

 #### Closes

- Closes #108305
- Closes #108111
- Closes #201254
- Closes #208412

 #### Credits

This project was made possible by three important insights, none of
which were mine:

1. @ericson2314 was the first to advocate for this change, and
   probably the first to appreciate its advantages.  Nix-driven
   (external) bootstrap is "cross by default".

2. @trofi has figured out a lot about how to get gcc to not mix up
   the copy of `libstdc++` that it depends on with the copy that it
   builds, by moving the `bootstrapFiles`' `libstdc++` into a
   [versioned directory].  This allows a Nix-driven bootstrap of gcc
   without the final gcc would still having references to the
   `bootstrapFiles`.

3. Using the undocumented variable [`user-defined-trusted-dirs`]
   when building glibc.  When glibc `dlopen()`s `libgcc_s.so`, it
   uses a completely different and totally special set of rules for
   finding `libgcc_s.so`.  This trick is the only way we can put
   `libgcc_s.so` in its own separate outpath without creating
   circular dependencies or dependencies on the bootstrapFiles.  I
   would never have guessed to use this (or that it existed!) if it
   were not for a [comment in guix] which @Mic92 [mentioned].

My own role in this PR was basically: being available to go on a
coding binge at an opportune moment, so we wouldn't waste a
[crisis].

[aarch64-compare-ofborg]: https://github.com/NixOS/nixpkgs/pull/209870/checks?check_run_id=10662822938
[amd64-compare-ofborg]: https://github.com/NixOS/nixpkgs/pull/209870/checks?check_run_id=10662825857
[nonexistent sysroot]: https://github.com/NixOS/nixpkgs/pull/210004
[versioned directory]: https://github.com/NixOS/nixpkgs/pull/209054
[`user-defined-trusted-dirs`]: https://sourceware.org/legacy-ml/libc-help/2013-11/msg00026.html
[comment in guix]: 5e4ec82181/gnu/packages/gcc.scm (L253)
[mentioned]: https://github.com/NixOS/nixpkgs/pull/210112#issuecomment-1379608483
[crisis]: https://github.com/NixOS/nixpkgs/issues/108305
[foreign]: https://github.com/NixOS/nixpkgs/pull/170857#issuecomment-1170558348
[static lib{mpfr,mpc,gmp,isl}.a hack]: 2f1948af9c/pkgs/stdenv/linux/default.nix (L380)
2023-04-02 13:49:41 -07:00
R. Ryantm
78c42d6943 fits-cloudctl: 0.11.4 -> 0.11.5 2023-04-02 20:16:44 +00:00
Kasper Gałkowski
2b180f796a lisp-modules: add release note about the new manual and the interface 2023-04-02 21:49:37 +02:00
Weijia Wang
a5f2172959
Merge pull request #224361 from r-ryantm/auto-update/dotter
dotter: 0.12.14 -> 0.12.15
2023-04-02 22:42:23 +03:00
Thiago Kenji Okada
d3d0f5e770
Merge pull request #223930 from PedroHLC/openasar-2023-03-23
openasar: unstable-2023-01-13 -> unstable-2023-04-01
2023-04-02 20:37:10 +01:00
R. Ryantm
d104ffce41 automatic-timezoned: 1.0.78 -> 1.0.81 2023-04-02 19:36:46 +00:00
Weijia Wang
2fdee63799
Merge pull request #224346 from DarkOnion0/drawio
drawio: 20.8.16 -> 21.1.2
2023-04-02 22:31:28 +03:00
Weijia Wang
1a0ea25570
Merge pull request #224347 from r-ryantm/auto-update/python310Packages.pytest-instafail
python310Packages.pytest-instafail: 0.4.2 -> 0.5.0
2023-04-02 22:25:03 +03:00
Weijia Wang
4a60c0b58a
Merge pull request #224293 from r-ryantm/auto-update/blackfire
blackfire: 2.14.0 -> 2.14.2
2023-04-02 22:24:38 +03:00
Fabian Affolter
1111a6f001 nuclei: 2.9.0 -> 2.9.1
Diff: https://github.com/projectdiscovery/nuclei/compare/v2.9.0...v2.9.1

Changelog: https://github.com/projectdiscovery/nuclei/releases/tag/v2.9.1
2023-04-02 21:24:09 +02:00
K900
ced4882bd9
Merge pull request #224369 from K900/fix-grafana-image-renderer
nixos/grafana-image-renderer: fix setting name
2023-04-02 22:13:08 +03:00
R. Ryantm
1c0ebdf895 python310Packages.mmh3: 3.0.0 -> 3.1.0 2023-04-02 18:52:38 +00:00
PedroHLC ☭
cc0655263f
openasar: unstable-2023-01-13 -> unstable-2023-04-01 2023-04-02 15:29:10 -03:00
Weijia Wang
143b829e58
Merge pull request #224316 from kindrowboat/bump-opera
opera: 96.0.4693.31 -> 97.0.4719.43
2023-04-02 21:08:48 +03:00
github-actions[bot]
41454e267b
Merge staging-next into staging 2023-04-02 18:01:35 +00:00
github-actions[bot]
3d3697fa48
Merge master into staging-next 2023-04-02 18:01:03 +00:00
R. Ryantm
8f511d49a6 ferium: 4.3.4 -> 4.4.0 2023-04-02 17:58:54 +00:00
Martin Weinelt
4e2d950168
Merge pull request #223602 from misuzu/orjson-update
python310Packages.orjson: 3.8.6 -> 3.8.9
2023-04-02 19:52:41 +02:00
R. Ryantm
39762330f5 ddccontrol-db: 20230223 -> 20230328 2023-04-02 17:45:15 +00:00
Weijia Wang
f5c732d453
Merge pull request #224186 from r-ryantm/auto-update/python310Packages.transmission-rpc
python310Packages.transmission-rpc: 4.1.3 -> 4.1.4
2023-04-02 20:34:48 +03:00
Kasper Gałkowski
0c782640ee lisp-modules: deprecate the two current implementations in comments 2023-04-02 18:18:37 +02:00
Ulrik Strid
f0f598bee4
Merge pull request #224023 from vbgl/ocaml-posix-2.0.2
ocamlPackages.posix: 2.0.0 → 2.0.2
2023-04-02 18:18:19 +02:00
Stef Dunlap
ab6f21ad53 opera: 96.0.4693.31 -> 97.0.4719.43 2023-04-02 12:09:48 -04:00
IndeedNotJames
6ff8487dfc
podman-tui: 0.9.0 -> 0.9.1
https://github.com/containers/podman-tui/releases/tag/v0.9.1
diff: https://github.com/containers/podman-tui/compare/v0.9.0...v0.9.1
2023-04-02 18:08:49 +02:00
Maximilian Bosch
cd9eead62d
Merge pull request #223929 from Enzime/fix/1password-wayland
Fix `NIXOS_OZONE_WL` not working with 1Password
2023-04-02 17:44:56 +02:00
Fabian Affolter
6af815e798
Merge pull request #224305 from r-ryantm/auto-update/cyberchef
cyberchef: 10.2.0 -> 10.4.0
2023-04-02 16:32:45 +02:00
Fabian Affolter
cdeff0a0b4 python310Packages.pyatag: 3.5.1 -> 0.3.6.2
Changelog: https://github.com/MatsNl/pyatag/releases/tag/0.3.6.2
2023-04-02 16:26:30 +02:00
Fabian Affolter
cbae06007d
python310Packages.pytest-instafail: disable on unsupported Python releases
- add format
2023-04-02 15:58:25 +02:00
Fabian Affolter
0d327fef45
python310Packages.pytest-instafail: add missing input 2023-04-02 15:57:29 +02:00
Fabian Affolter
3ebf1a36f6
python310Packages.pytest-instafail: add changelog to meta
- use lib
2023-04-02 15:56:04 +02:00
André Silva
76e68b8a3b
Merge pull request #223719 from andresilva/andre/polkadot-0.9.40
polkadot: 0.9.39-1 -> 0.9.40
2023-04-02 14:49:51 +01:00
Ulrik Strid
572dcae7cc
Merge pull request #224168 from vbgl/ocaml-json-data-encoding-0.12.1
ocamlPackages.json-data-encoding: 0.11 → 0.12.1
2023-04-02 15:48:49 +02:00
K900
8f172ed10a nixos/grafana-image-renderer: fix setting name 2023-04-02 16:48:36 +03:00
R. Ryantm
28106320fe erigon: 2.40.1 -> 2.42.0 2023-04-02 09:44:25 -04:00
happysalada
5ba4f4293d chatgpt-retrieval-plugin: init module 2023-04-02 09:26:35 -04:00
R. Ryantm
dfbe3f7465 cyclonedds: 0.10.2 -> 0.10.3 2023-04-02 13:10:13 +00:00
Weijia Wang
2a9cc48541
Merge pull request #224158 from r-ryantm/auto-update/python310Packages.pyvesync
python310Packages.pyvesync: 2.1.1 -> 2.1.6
2023-04-02 15:59:41 +03:00
Weijia Wang
8a5f14868c
Merge pull request #224133 from r-ryantm/auto-update/droidcam
droidcam: 1.8.2 -> 1.9.0
2023-04-02 15:53:47 +03:00
Fabian Affolter
6d8dc6c61b
Merge pull request #224334 from r-ryantm/auto-update/cloudfox
cloudfox: 1.10.1 -> 1.10.2
2023-04-02 14:52:24 +02:00
Fabian Affolter
a9574ffb94
Merge pull request #224336 from r-ryantm/auto-update/chaos
chaos: 0.5.0 -> 0.5.1
2023-04-02 14:52:00 +02:00
Weijia Wang
b712b2647e
Merge pull request #224079 from r-ryantm/auto-update/ipxe
ipxe: unstable-2023-03-15 -> unstable-2023-03-30
2023-04-02 15:51:18 +03:00
Weijia Wang
f9f0dcfe49
Merge pull request #224059 from r-ryantm/auto-update/klipper
klipper: unstable-2023-03-15 -> unstable-2023-03-30
2023-04-02 15:49:44 +03:00