Commit Graph

633 Commits

Author SHA1 Message Date
Silvan Mosberger
fbbe972898 Parallel GH actions workflow for Nixpkgs eval
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: https://github.com/NixOS/nixpkgs/pull/352808
[3]: https://github.com/NixOS/nixpkgs/pull/269403

Co-Authored-By: Jörg Thalheim <joerg@thalheim.io>
Co-Authored-By: Adam Joseph <adam@westernsemico.com>
2024-11-20 10:35:56 +01:00
Silvan Mosberger
72f462bdba pkgs/top-level/release.nix: Don't include non-Hydra attributes with attrNamesOnly
The attrNamesOnly feature is used by
pkgs/top-level/release-attrpaths-superset.nix to return a superset of
all attributes that might be built by Hydra.

Before this change it would include all attribute paths to derivations that could
be found recursively, ignoring the recurseForDerivations and
recurseForRelease attributes that control Hydra's recursion.

This had the effect that it would end up with ~266000 attributes, most of which definitely won't be built by Hydra. We can remove those while staying true to the superset notion to end up with just ~97000, a reduction of ~63.6%! This also comes with an eval time reduction from 31.7s to 18.7s (-41.0%)!

As an example, all derivations in pypy310Packages don't get included
anymore, because it doesn't have a `.recurseForDerivations` set.

As a nice side effect, with `--arg enableWarnings false`, no more
warnings are printed, because things like
`checkpointBuildTools.mkCheckpointedBuild` (which is deprecated) isn't
being recursed to anymore.
2024-11-20 06:22:07 +01:00
maralorn
61f65fee89
release.nix: add haskell.packages.ghc910.haskell-language-server (#354537) 2024-11-13 12:13:37 +01:00
Michael Hoang
1fa9b80b0a release: block on aarch64 on *-darwin channels 2024-11-09 17:16:22 +11:00
Jun Matsushita
731e826560 release.nix: add haskell.packages.ghc910.haskell-language-server to release 2024-11-08 19:30:24 +01:00
rnhmjoj
12b1a23c6e
release-lib: add exception to build olm on hydra
Olm was marked as vulnerable in e4767b47.

The issue, however, is controversial and the practical ability to
exploit its vulnerabilities has not been demostrated: ultimately the
users are invited to decide for themselves.

Given that, hydra should still build and distribute the packages
depending on olm to avoid expensive builds in the event the users
decide it's acceptable to continue using these packages.
2024-10-12 16:26:56 +02:00
Tristan Ross
9f589ea3a0
arocc: init at 0-unstable-06-01 2024-07-27 19:43:41 -07:00
Tristan Ross
2d4c9e6966
pkgs/top-level/{release,stage}.nix: add zig package set 2024-07-27 19:43:41 -07:00
Philip Taron
b5dc82844f
nixpkgs-manual: init 2024-07-26 13:46:12 -07:00
Jörg Thalheim
29045617a5 fix nixpkgs's release.nix
In https://github.com/NixOS/nixpkgs/pull/328582 we broke the nixpkgs
release.nix by committing an unsound tarball. We comment out freebsd for
now until this has been replaced with a proper public one.
2024-07-25 20:51:08 +02:00
Audrey Dutcher
4ee5ad5929 [squashme] fix eval-nixpkgs-unstable-jobset 2024-07-19 22:30:25 -07:00
Audrey Dutcher
9dbd5a9a9d [squashme] do the requested changes 2024-07-19 21:32:07 -07:00
Martin Weinelt
b0b4d2d06d
pkgs/top-level: stop permitting openssl 1.1
A year has passed and a limited number of packages still rely on this, so
it is probably safe to remove these.
2024-06-24 02:25:04 +02:00
Doron Behar
7645dde059 transmission_3: rename from transmission 2024-06-21 12:33:37 +03:00
Tristan Ross
d2adfad3bd
pkgs/top-level/release{,-lib}.nix: remove hardcoded system 2024-06-06 21:16:30 -07:00
K900
513c54588f top-level/make-tarball.nix: drop unused argument 2024-04-22 22:43:53 +03:00
K900
9cdada6d5c pkgs/top-level: split release-checks into a separate job
This should improve latency on channel updates.
2024-04-17 09:53:10 +03:00
Domen Kožar
ab6229306a
Merge pull request #301728 from domenkozar/make-devenv-release-blocker
make devenv release blocker
2024-04-13 15:27:03 +07:00
Domen Kožar
9598063d68 make devenv release blocker 2024-04-05 06:08:31 +01:00
Sergei Trofimovich
178f1e1f5d pkgs/top-level/release.nix: drop unused dist targets
The PR https://github.com/NixOS/nixpkgs/pull/284090 exposed `build`
target directly on hydra. We are using it now in
https://github.com/NixOS/nixpkgs/tree/master/maintainers/scripts/bootstrap-files
to generate bootstrap tarballs on `linux` and `darwin`.

`dist` was not very useful as it was a bit hard to link back to hydra
jobs that build it. Let's just drop it.
2024-04-04 21:40:08 +01:00
maralorn
10c80b9934 haskell-language-server: Enable master build on ghc 9.8 2024-03-18 13:58:42 +01:00
Philip Taron
93710be289
Avoid top-level with ...; in pkgs/top-level/release.nix
Also, use `inherit (lib) ...;` to bring specific names in.
2024-03-08 14:55:08 -08:00
Sergei Trofimovich
318667d8d9 pkgs/top-level/release.nix: expose .build as a direct jobset for hydra
This matches jobsets for cross-jobs. This way it' will be a bit easier
to automatically extract `bootstrapTools` for mass updates in
https://github.com/NixOS/nixpkgs/issues/253713
2024-01-26 20:09:43 +00:00
Weijia Wang
927f9393c1 llvmPackages_6: remove
Remove as the last two users are gone.
2024-01-09 22:38:47 +01:00
Sergei Trofimovich
b227d7851b pkgs/top-level/release.nix: drop already removed llvmPackages_7 mention
All the entries are in comments.
2024-01-08 10:39:22 +00:00
Adam Joseph
02a2822def pkgs/top-level/release.nix: add attrNamesOnly option 2023-12-15 04:21:32 -08:00
Raito Bezarius
389b175993 pkgs/top-level/release: drop nodejs 16 exception
Node.js 16.20.2 was an insecure but cached package, it is not necessary
to keep it anymore as Node.js 16 was dropped.
2023-11-20 18:50:14 +01:00
Raito Bezarius
9866a5be7e llvmPackages_5: drop
While using very old compilers is a fair usecase, it induces a maintenance churn as
we collect more and more LLVM versions for the LLVM maintainers.

Especially when we need to backport uniform changes to the whole tree,
furthermore, it consumes and waste CI resources.
2023-11-17 16:12:32 +01:00
sternenseemann
18c39645a0 release.nix: add HLS jobs for more compilers to nixpkgs:trunk
Works without introducing extra bogus attributes. Ref #266682.
2023-11-16 19:04:33 +01:00
Michael Hoang
aca5e77875 release: block on linux-builder.aarch64-darwin 2023-10-19 11:33:41 +01:00
Robert Hensing
4ff8491ac0 nixpkgs release: leave breadcrumb about commented tests
Wish I could do more rn, so adding this to help the next person.
2023-10-11 14:32:18 +02:00
Robert Hensing
9321e71d93 nixpkgs release: replace outdated comment 2023-10-11 14:27:59 +02:00
Graham Christensen
0255c3a1ef nixpkgs release: explicitly add aarch64-darwin blockers 2023-10-11 14:25:33 +02:00
Graham Christensen
6a5c6a9e07 unstable: include nix explicitly 2023-10-11 14:25:33 +02:00
Alyssa Ross
ac279b4e1b
release.nix: generate bootstrap tools for musl
This will allow us to regenerate our woefully out-of-date
aarch64-unknown-linux-gnu musl bootstrap tools, which can't compile
lots of modern code.

We could technically also do i686-unknown-linux-musl bootstrap tools,
but I don't know if there's demand for that, so it's best to wait and
see if somebody asks for it before we commit Hydra to it.
2023-10-07 19:44:28 +00:00
Alyssa Ross
1da4b5c99e
release.nix: namespace bootstrap tools with triples
This will allow buliding bootstrap tools for platforms with
non-default libcs, like *-unknown-linux-musl.

This gets rid of limitedSupportSystems/systemsWithAnySupport.  There
was no need to use systemsWithAnySupport for supportDarwin, because it
was always equivalent to supportedSystems for that purpose, and the
only other way it was used was for determining which platforms to
build the bootstrap tools for, so we might as well use a more explicit
parameter for that, and then we can change how it works without
affecting the rest of the Hydra jobs.

Not affecting the rest of the Hydra jobs is important, because if we
changed all jobs to use config triples, we'd end up renaming every
Hydra job.  That might still be worth thinking about at some point,
but it's unnecessary at this point (and would be a lot of work).

I've checked by running

    nix-eval-jobs --force-recurse pkgs/top-level/release.nix

that the actual bootstrap tools derivations are unaffected by this
change, and that the only other jobs that change are ones that depend
on the hash of all of Nixpkgs.  Of the other jobset entrypoints that
end up importing pkgs/top-level/release.nix, none used the
limitedSupportedSystems parameter, so they should all be unaffected as
well.
2023-10-07 19:38:01 +00:00
Michael Hoang
e90add3e18 release: add darwin.linux-builder as a blocker
Fixes #257686
2023-10-02 01:58:53 +01:00
ajs124
93840b4878 openssl_1_1: 1.1.1v -> 1.1.1w
https://github.com/openssl/openssl/blob/OpenSSL_1_1_1w/NEWS
2023-09-11 17:28:09 +02:00
Artturin
8d650ed229 pkgs/top-level/release: update cc-wrapper attr names 2023-09-07 22:36:15 +03:00
Mario Rodas
b72c3a8fa9 nodejs_16: 16.20.1 -> 16.20.2
Changelog: https://github.com/nodejs/node/releases/tag/v16.20.2
2023-08-09 04:20:00 +00:00
ajs124
828dea331a openssl_1_1: 1.1.1u -> 1.1.1v
https://github.com/openssl/openssl/blob/OpenSSL_1_1_1v/NEWS
2023-08-01 16:28:52 +02:00
Pol Dellaiera
4968ffb38a pkgs/top-level/release: allow nodejs 16.20.1 to be cached on Hydra temporarily 2023-06-23 18:06:16 +02:00
Raito Bezarius
69a2b23a01 pkgs/top-level/release: cache openssl-1.1.1u instead of openssl-1.1.1t
We were caching this insecure package as part of a decision during 23.05, we will now cache
openssl-1.1.1u too as this is now the de-facto OpenSSL package on 23.05, which is EOL.
2023-06-19 00:27:09 +02:00
Raito Bezarius
85ceb3d6b1 pkgs/top-level/release: allow nodejs 16 and openssl 1.1 to be cached on Hydra temporarily
Until the 11 September 2023, those two packages will be built and cached by Hydra so they can be used
by users without recompilation penalties.

This is an exception due to mismatched release windows and should not set any precedent
without community discussion in coordination with release managers.
2023-05-20 17:28:03 +02:00
Connor Baker
b2eb5c816f apple_sdk: remove cf-private alias 2023-05-01 21:59:03 -04:00
zowoq
6913fadec8 Revert "release.nix: don't block on aarch64-darwin bootstrap tools"
This reverts commit 4d5d4a7df3.
2023-03-16 21:55:50 +10:00
Weijia Wang
5028ec96c9
Merge pull request #202347 from stephank/feat/bootstrap-aarch64-darwin
stdenvBootstrapTools: native aarch64-darwin build
2023-03-03 20:05:28 +02:00
Artturin
8876a5c91f tests.stdenv: move patch-shebangs test 2023-02-17 22:23:33 +02:00
Stéphan Kochen
c3693fbfd5 stdenvBootstrapTools: native aarch64-darwin build 2023-02-11 20:11:55 +01:00
Vladimír Čunát
4d5d4a7df3
release.nix: don't block on aarch64-darwin bootstrap tools
They haven't worked for several months, so let's not start blocking now:
https://hydra.nixos.org/job/nixpkgs/nixpkgs-unstable-aarch64-darwin/stdenvBootstrapTools.aarch64-darwin.dist
2023-01-05 19:31:12 +01:00