mirror of
https://github.com/rust-lang/rust.git
synced 2024-11-25 16:24:46 +00:00
e5bb341f0e
Test benchmarks with `-Z panic-abort-tests` During test execution, when a `#[bench]` benchmark is encountered it's executed once to check whether it works. Unfortunately that was not compatible with `-Z panic-abort-tests`: the feature works by spawning a subprocess for each test, which prevents the use of dynamic tests as we cannot pass closures to child processes, and before this PR the conversion from benchmark to test was done by turning benchmarks into dynamic tests whose closures execute the benchmark once. The approach this PR took was to add two new kinds of `TestFn`s: `StaticBenchAsTestFn` and `DynBenchAsTestFn` (⚠️ **this is a breaking change** ⚠️). With that change, a `StaticBenchFn` can be converted into a `StaticBenchAsTestFn` without creating dynamic tests, and making it possible to test `#[bench]` functions with `-Z panic-abort-tests`. The subprocess test runner also had to be updated to perform the conversion from benchmark to test when appropriate. Along with the bug fix, in the first commit I refactored how tests are executed: rather than executing the test function in multiple places across `libtest`, there is now a private `TestFn::into_runnable()` method, which returns either a `RunnableTest` or `RunnableBench`, on which you can call the `run()` method. This simplified the rest of the changes in the PR. This PR is best reviewed commit-by-commit. Fixes https://github.com/rust-lang/rust/issues/73509 |
||
|---|---|---|
| .. | ||
| auxiliary | ||
| custom-test-frameworks | ||
| decl-macro-test.rs | ||
| inaccessible-test-modules.rs | ||
| inaccessible-test-modules.stderr | ||
| issue-12997-1.rs | ||
| issue-12997-1.stderr | ||
| issue-12997-2.rs | ||
| issue-12997-2.stderr | ||
| issue-16597-empty.rs | ||
| issue-16597.rs | ||
| issue-20823.rs | ||
| issue-34932.rs | ||
| issue-36768.rs | ||
| issue-52557.rs | ||
| issue-53675-a-test-called-panic.rs | ||
| issue-109816.rs | ||
| issue-109816.stderr | ||
| run-unexported-tests.rs | ||
| test-attr-non-associated-functions.rs | ||
| test-attr-non-associated-functions.stderr | ||
| test-cant-be-shadowed.rs | ||
| test-filter-multiple.rs | ||
| test-filter-multiple.run.stdout | ||
| test-fn-signature-verification-for-explicit-return-type.rs | ||
| test-function-signature.rs | ||
| test-function-signature.stderr | ||
| test-main-not-dead-attr.rs | ||
| test-main-not-dead.rs | ||
| test-on-not-fn.rs | ||
| test-on-not-fn.stderr | ||
| test-panic-abort-disabled.rs | ||
| test-panic-abort-disabled.stderr | ||
| test-panic-abort-nocapture.rs | ||
| test-panic-abort-nocapture.run.stderr | ||
| test-panic-abort-nocapture.run.stdout | ||
| test-panic-abort.rs | ||
| test-panic-abort.run.stdout | ||
| test-panic-while-printing.rs | ||
| test-passed-wasm.rs | ||
| test-passed-wasm.run.stdout | ||
| test-passed.rs | ||
| test-passed.run.stdout | ||
| test-runner-hides-buried-main.rs | ||
| test-runner-hides-main.rs | ||
| test-runner-hides-start.rs | ||
| test-should-fail-good-message.rs | ||
| test-should-panic-attr.rs | ||
| test-should-panic-attr.stderr | ||
| test-thread-capture.rs | ||
| test-thread-capture.run.stdout | ||
| test-thread-nocapture.rs | ||
| test-thread-nocapture.run.stderr | ||
| test-thread-nocapture.run.stdout | ||
| test-type.rs | ||
| test-type.run.stdout | ||
| test-vs-cfg-test.rs | ||
| test-warns-dead-code.rs | ||
| test-warns-dead-code.stderr | ||
| tests-listing-format-default.rs | ||
| tests-listing-format-default.run.stdout | ||
| tests-listing-format-json-without-unstableopts.rs | ||
| tests-listing-format-json-without-unstableopts.run.stderr | ||
| tests-listing-format-json.rs | ||
| tests-listing-format-json.run.stdout | ||
| tests-listing-format-terse.rs | ||
| tests-listing-format-terse.run.stdout | ||