gitea/tests/integration
Jason Song 33cc5837a6
Support compression for Actions logs (#31761)
Support compression for Actions logs to save storage space and
bandwidth. Inspired by
https://github.com/go-gitea/gitea/issues/24256#issuecomment-1521153015

The biggest challenge is that the compression format should support
[seekable](https://github.com/facebook/zstd/blob/dev/contrib/seekable_format/zstd_seekable_compression_format.md).
So when users are viewing a part of the log lines, Gitea doesn't need to
download the whole compressed file and decompress it.

That means gzip cannot help here. And I did research, there aren't too
many choices, like bgzip and xz, but I think zstd is the most popular
one. It has an implementation in Golang with
[zstd](https://github.com/klauspost/compress/tree/master/zstd) and
[zstd-seekable-format-go](https://github.com/SaveTheRbtz/zstd-seekable-format-go),
and what is better is that it has good compatibility: a seekable format
zstd file can be read by a regular zstd reader.

This PR introduces a new package `zstd` to combine and wrap the two
packages, to provide a unified and easy-to-use API.

And a new setting `LOG_COMPRESSION` is added to the config, although I
don't see any reason why not to use compression, I think's it's a good
idea to keep the default with `none` to be consistent with old versions.

`LOG_COMPRESSION` takes effect for only new log files, it adds `.zst` as
an extension to the file name, so Gitea can determine if it needs
decompression according to the file name when reading. Old files will
keep the format since it's not worth converting them, as they will be
cleared after #31735.

<img width="541" alt="image"
src="https://github.com/user-attachments/assets/e9598764-a4e0-4b68-8c2b-f769265183c9">
2024-08-09 10:10:30 +08:00
..
migration-test Preserve BOM in web editor (#28935) 2024-01-27 18:02:51 +00:00
schemas verify nodeinfo response by schema (#22137) 2022-12-17 01:22:34 -05:00
actions_trigger_test.go Add permission check when creating PR (#31033) 2024-07-29 02:21:22 +00:00
admin_config_test.go Fix admin config page error, use tests to cover the admin config and 500 error page (#24965) 2023-05-29 15:00:21 +00:00
admin_user_test.go User details page (#26713) 2023-08-31 11:21:18 +02:00
api_actions_artifact_test.go Fix uploaded artifacts should be overwritten (#28726) 2024-01-17 11:21:16 +08:00
api_actions_artifact_v4_test.go Actions Artifacts v4 backend (#28965) 2024-03-02 09:12:17 +00:00
api_activitypub_person_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_admin_org_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_admin_test.go Add result check in TestAPIEditUser (#29674) 2024-05-05 02:10:20 +00:00
api_branch_test.go Recommend/convert to use case-sensitive collation for MySQL/MSSQL (#28662) 2024-01-10 11:03:23 +00:00
api_comment_attachment_test.go Catch and handle unallowed file type errors in issue attachment API (#30791) 2024-05-02 16:33:31 +00:00
api_comment_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_feed_user_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
api_fork_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
api_gitignore_templates_test.go Add API for gitignore templates (#22783) 2023-04-27 11:51:20 +08:00
api_gpg_keys_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_helper_for_declarative_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_httpsig_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_issue_attachment_test.go Catch and handle unallowed file type errors in issue attachment API (#30791) 2024-05-02 16:33:31 +00:00
api_issue_config_test.go Update misspell to 0.5.1 and add misspellings.csv (#30573) 2024-04-27 08:03:49 +00:00
api_issue_label_test.go Support using label names when changing issue labels (#30943) 2024-05-13 04:28:53 +00:00
api_issue_milestone_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_issue_pin_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_issue_reaction_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_issue_stopwatch_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_issue_subscription_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_issue_templates_test.go Refactor issue template parsing and fix API endpoint (#29069) 2024-02-12 05:04:10 +00:00
api_issue_test.go Fix no edit history after editing issue's title and content (#30814) 2024-05-03 14:11:51 +08:00
api_issue_tracked_time_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_keys_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_label_templates_test.go Add API for Label templates (#24602) 2023-05-23 18:10:23 +08:00
api_license_templates_test.go Add API for License templates (#23009) 2023-04-26 02:08:28 -04:00
api_nodeinfo_test.go Allow non-admin users to delete review requests (#29057) 2024-02-24 12:38:43 +00:00
api_notification_test.go Enable more revive linter rules (#30608) 2024-04-22 11:48:42 +00:00
api_oauth2_apps_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_org_avatar_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_org_test.go Allow non-admin users to delete review requests (#29057) 2024-02-24 12:38:43 +00:00
api_packages_alpine_test.go Integrate alpine noarch packages into other architectures index (#29137) 2024-02-25 15:10:55 +00:00
api_packages_cargo_test.go Run go generate and go vet on all packages (#30529) 2024-04-17 09:40:35 +00:00
api_packages_chef_test.go Resolve lint for unused parameter and unnecessary type arguments (#30750) 2024-04-29 08:47:56 +00:00
api_packages_composer_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_conan_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_conda_test.go Support compression for Actions logs (#31761) 2024-08-09 10:10:30 +08:00
api_packages_container_test.go Remove sub-path from container registry realm (#31293) 2024-06-09 16:29:29 +08:00
api_packages_cran_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_debian_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_generic_test.go Azure blob storage support (#30995) 2024-05-30 07:33:50 +00:00
api_packages_goproxy_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_helm_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_maven_test.go Avoid 500 panic error when uploading invalid maven package file (#31014) 2024-05-20 06:44:16 +00:00
api_packages_npm_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_nuget_test.go Fix NuGet Package API for $filter with Id equality (#31188) 2024-06-04 06:45:56 +00:00
api_packages_pub_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_pypi_test.go Fix links in PyPI Simple Repository API page (#30594) 2024-04-20 01:15:14 +00:00
api_packages_rpm_test.go Add signature support for the RPM module (#27069) 2024-08-06 09:03:33 -04:00
api_packages_rubygems_test.go Improve rubygems package registry (#31357) 2024-06-17 08:42:46 +00:00
api_packages_swift_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_packages_test.go Use crypto/sha256 (#29386) 2024-02-25 13:32:13 +00:00
api_packages_vagrant_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_private_serv_test.go Final round of db.DefaultContext refactor (#27587) 2023-10-14 08:37:24 +00:00
api_pull_commits_test.go api: GetPullRequestCommits: return file list (#27483) 2023-10-09 11:22:12 +00:00
api_pull_review_test.go Allow non-admin users to delete review requests (#29057) 2024-02-24 12:38:43 +00:00
api_pull_test.go Add permission check when creating PR (#31033) 2024-07-29 02:21:22 +00:00
api_releases_test.go Protected tag is no internal server error (#30962) 2024-05-14 06:48:21 +00:00
api_repo_archive_test.go Add an immutable tarball link to archive download headers for Nix (#31139) 2024-05-28 15:30:34 +00:00
api_repo_avatar_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_branch_test.go Disable query token param in integration tests (#28592) 2023-12-23 11:29:51 +08:00
api_repo_collaborator_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_repo_compare_test.go feat(api): implement branch/commit comparison API (#30349) 2024-04-16 11:45:04 +08:00
api_repo_edit_test.go Add merge style fast-forward-only (#28954) 2024-02-12 23:37:23 +01:00
api_repo_file_create_test.go Move context from modules to services (#29440) 2024-02-27 08:12:22 +01:00
api_repo_file_delete_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_file_get_test.go Redesign Scoped Access Tokens (#24767) 2023-06-04 20:57:16 +02:00
api_repo_file_helpers.go Fix Bug in Issue Config when only contact links are set (#26521) 2023-09-28 20:16:40 +08:00
api_repo_file_update_test.go Move context from modules to services (#29440) 2024-02-27 08:12:22 +01:00
api_repo_files_change_test.go Move context from modules to services (#29440) 2024-02-27 08:12:22 +01:00
api_repo_get_contents_list_test.go Simplify how git repositories are opened (#28937) 2024-01-27 21:09:51 +01:00
api_repo_get_contents_test.go Simplify how git repositories are opened (#28937) 2024-01-27 21:09:51 +01:00
api_repo_git_blobs_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_git_commits_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_git_hook_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_git_notes_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_git_ref_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_git_tags_test.go Resolve lint for unused parameter and unnecessary type arguments (#30750) 2024-04-29 08:47:56 +00:00
api_repo_git_trees_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_hook_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_languages_test.go Remove session in api tests (#21984) 2022-12-01 22:39:42 -05:00
api_repo_lfs_locks_test.go Fix #31185 try fix lfs download from bitbucket failed (#31201) 2024-06-11 22:22:28 +00:00
api_repo_lfs_migrate_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_lfs_test.go Fix #31185 try fix lfs download from bitbucket failed (#31201) 2024-06-11 22:22:28 +00:00
api_repo_raw_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_secrets_test.go feat(api): enhance Actions Secrets Management API for repository (#30656) 2024-04-26 21:11:49 +08:00
api_repo_tags_test.go Add lint-go-gopls (#30729) 2024-06-05 09:22:38 +08:00
api_repo_teams_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_repo_test.go Don't only list code-enabled repositories when using repository API (#30817) 2024-05-03 15:58:31 +08:00
api_repo_topic_test.go Refactor topic Find functions and add more tests for pagination (#30127) 2024-03-29 11:38:16 +08:00
api_repo_variables_test.go Add API for Variables (#29520) 2024-03-28 20:40:35 +00:00
api_settings_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
api_team_test.go Allow everyone to read or write a wiki by a repo unit setting (#30495) 2024-04-17 15:58:37 +00:00
api_team_user_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_token_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_twofa_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_avatar_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_block_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_user_email_test.go Unify user update methods (#28733) 2024-02-04 13:29:09 +00:00
api_user_follow_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_user_heatmap_test.go Refactor timeutil package (#28623) 2023-12-28 10:09:57 +00:00
api_user_info_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_org_perm_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_orgs_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
api_user_search_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_secrets_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
api_user_star_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_user_update_test.go Add an api test for updating user (#30539) 2024-04-18 03:16:20 +00:00
api_user_variables_test.go Clarify Actions resources ownership (#31724) 2024-08-01 09:04:04 +00:00
api_user_watch_test.go Add user blocking (#29028) 2024-03-04 08:16:03 +00:00
api_wiki_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
attachment_test.go Use fetch to send requests to create issues/comments (#25258) 2023-06-16 06:32:43 +00:00
auth_ldap_test.go allow synchronizing user status from OAuth2 login providers (#31572) 2024-07-16 20:33:16 +02:00
avatar.png Add API for changing Avatars (#25369) 2023-06-29 23:22:55 +00:00
benchmarks_test.go Replace deprecated math/rand functions (#30733) 2024-04-27 18:50:35 +02:00
branches_test.go Refactor locale&string&template related code (#29165) 2024-02-14 21:48:45 +00:00
change_default_branch_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
cmd_keys_test.go Refactor to use urfave/cli/v2 (#25959) 2023-07-21 17:28:19 +08:00
compare_test.go Simplify 404/500 page (#31409) 2024-06-23 17:45:21 +00:00
cors_test.go Refactor CORS handler (#28587) 2023-12-25 20:13:18 +08:00
create_no_session_test.go Refactor tests (#26464) 2023-08-12 16:30:16 +00:00
csrf_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
db_collation_test.go Partially enable MSSQL case-sensitive collation support (#29238) 2024-03-08 03:19:35 +00:00
delete_user_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
download_test.go Remove deprecated packages & staticcheck fixes (#22012) 2022-12-02 17:06:23 -05:00
dump_restore_test.go Add lint-go-gopls (#30729) 2024-06-05 09:22:38 +08:00
editor_test.go Fix automerge will not work because of some events haven't been triggered (#30780) 2024-05-21 23:23:22 +08:00
empty_repo_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
eventsource_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
explore_repos_test.go Improve repo search UI (#29767) 2024-03-15 09:45:30 +00:00
explore_user_test.go Remove unnecessary ".Link" usages (#29909) 2024-03-20 13:56:42 +08:00
git_clone_wiki_test.go Use raw Wiki links for non-renderable Wiki files (#30273) 2024-04-10 17:49:57 +00:00
git_helper_for_declarative_test.go Fix push multiple branches error with tests (#31151) 2024-05-29 06:43:02 +00:00
git_push_test.go Fix push multiple branches error with tests (#31151) 2024-05-29 06:43:02 +00:00
git_smart_http_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
git_test.go Allow force push to protected branches (#28086) 2024-07-05 18:21:56 +00:00
goget_test.go Support SSH for go get (#24664) 2023-05-12 09:44:37 +00:00
gpg_git_test.go Add lint-go-gopls (#30729) 2024-06-05 09:22:38 +08:00
html_helper.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
incoming_email_test.go Next round of db.DefaultContext refactor (#27089) 2023-09-16 14:39:12 +00:00
integration_test.go Refactor names (#31405) 2024-06-19 06:32:45 +08:00
issue_test.go Prevent simultaneous editing of comments and issues (#31053) 2024-05-27 15:34:18 +00:00
lfs_getobject_test.go Remove GetByBean method because sometimes it's danger when query condition parameter is zero and also introduce new generic methods (#28220) 2023-12-07 15:27:36 +08:00
lfs_local_endpoint_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
lfs_view_test.go Test views of LFS files (#22196) 2022-12-23 07:41:56 +08:00
linguist_test.go Add support for linguist-detectable and linguist-documentation (#29267) 2024-02-23 17:24:27 +00:00
links_test.go Simplify 404/500 page (#31409) 2024-06-23 17:45:21 +00:00
markup_external_test.go Run go generate and go vet on all packages (#30529) 2024-04-17 09:40:35 +00:00
migrate_test.go Upgrade xorm to new version which supported update join for all supported databases (#28590) 2023-12-31 05:00:35 +00:00
mirror_pull_test.go Move migration functions to services layer (#29497) 2024-03-01 02:23:00 +00:00
mirror_push_test.go Move context from modules to services (#29440) 2024-02-27 08:12:22 +01:00
nonascii_branches_test.go Refactor route path normalization (#31381) 2024-06-17 23:28:47 +00:00
oauth_test.go add username to OIDC introspection response (#31688) 2024-07-25 12:36:05 +00:00
org_count_test.go Use db.Find instead of writing methods for every object (#28084) 2023-11-24 03:49:41 +00:00
org_project_test.go Fix data-race during testing (#30999) 2024-05-20 04:35:38 +00:00
org_team_invite_test.go Update team invitation email link (#26550) 2023-08-31 16:26:13 +00:00
org_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
private-testing.key Kd/ci playwright go test (#20123) 2022-09-02 15:18:23 -04:00
privateactivity_test.go Convert to url auth to header auth in tests (#28484) 2023-12-21 23:59:59 +00:00
project_test.go Rename project board -> column to make the UI less confusing (#30170) 2024-05-27 08:59:54 +00:00
pull_compare_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
pull_create_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
pull_diff_test.go Add commits dropdown in PR files view and allow commit by commit review (#25528) 2023-07-28 21:18:12 +02:00
pull_merge_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
pull_review_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
pull_status_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
pull_update_test.go Performance improvements for pull request list page (#29900) 2024-03-21 14:13:08 +01:00
README_ZH.md Require MySQL 8.0, PostgreSQL 12, MSSQL 2012 (#27337) 2023-10-03 13:27:57 -04:00
README.md Revert "Support SAML authentication (#25165)" (#29358) 2024-02-24 12:18:49 +08:00
release_test.go Restyle release list, fix branch dropdown (#30837) 2024-05-13 23:33:51 +02:00
rename_branch_test.go Fix rename branch 500 when the target branch is deleted but exist in database (#30430) 2024-04-12 13:11:16 +03:00
repo_activity_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
repo_archive_test.go Skip gzip for some well-known compressed file types (#30796) 2024-05-02 02:27:25 +00:00
repo_branch_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
repo_commits_search_test.go Integration Test for Commit Search containing Square Brackets (#28751) 2024-01-11 11:04:45 +08:00
repo_commits_test.go Restore warning commit status (#27504) 2023-10-08 22:16:06 +00:00
repo_fork_test.go Fix wrong display of recently pushed notification (#25812) 2024-05-21 17:00:35 +00:00
repo_generate_test.go Substitute variables in path names of template repos too (#25294) 2023-06-20 21:14:47 +00:00
repo_mergecommit_revert_test.go Run go generate and go vet on all packages (#30529) 2024-04-17 09:40:35 +00:00
repo_migrate_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
repo_search_test.go Resolve lint for unused parameter and unnecessary type arguments (#30750) 2024-04-29 08:47:56 +00:00
repo_tag_test.go Protected tag is no internal server error (#30962) 2024-05-14 06:48:21 +00:00
repo_test.go Fix repo home UI when there is no repo description (#30552) 2024-04-21 23:47:31 +00:00
repo_topic_test.go Refactor topic Find functions and add more tests for pagination (#30127) 2024-03-29 11:38:16 +08:00
repo_watch_test.go Replace 'userxx' with 'orgxx' in all test files when the user type is org (#27052) 2023-09-14 02:59:53 +00:00
repo_webhook_test.go Fix incorrect menu/link on webhook edit page (#29709) 2024-03-14 01:37:15 +00:00
repofiles_change_test.go Refactor names (#31405) 2024-06-19 06:32:45 +08:00
session_test.go Fix session key conflict with database keyword (#28613) 2023-12-27 15:24:23 +08:00
setting_test.go Introduce flex-list & flex-item elements for Gitea UI (#25790) 2023-08-01 00:13:42 +02:00
signin_test.go Refactor locale&string&template related code (#29165) 2024-02-14 21:48:45 +00:00
signout_test.go Use JSON response for "user/logout" (#25522) 2023-06-26 21:36:10 +02:00
signup_test.go Allow to change primary email before account activation (#29412) 2024-02-27 10:55:13 +00:00
ssh_key_test.go Redesign Scoped Access Tokens (#24767) 2023-06-04 20:57:16 +02:00
timetracking_test.go Replace 'userxx' with 'orgxx' in all test files when the user type is org (#27052) 2023-09-14 02:59:53 +00:00
user_avatar_test.go Reserve ".png" suffix for user/org names (#23992) 2023-04-10 16:14:16 -04:00
user_settings_test.go Allow disabling authentication related user features (#31535) 2024-07-09 17:36:31 +00:00
user_test.go Fix user router possbile panic (#29751) 2024-03-13 06:57:30 +00:00
version_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
view_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00
webfinger_test.go Replace interface{} with any (#25686) 2023-07-04 18:36:08 +00:00
xss_test.go Implement FSFE REUSE for golang files (#21840) 2022-11-27 18:20:29 +00:00

Integration tests

Integration tests can be run with make commands for the appropriate backends, namely:

make test-sqlite
make test-pgsql
make test-mysql
make test-mssql

Make sure to perform a clean build before running tests:

make clean build

Run tests via local act_runner

Run all jobs

act_runner exec -W ./.github/workflows/pull-db-tests.yml --event=pull_request --default-actions-url="https://github.com" -i catthehacker/ubuntu:runner-latest

Warning: This file defines many jobs, so it will be resource-intensive and therefor not recommended.

Run single job

act_runner exec -W ./.github/workflows/pull-db-tests.yml --event=pull_request --default-actions-url="https://github.com" -i catthehacker/ubuntu:runner-latest -j <job_name>

You can list all job names via:

act_runner exec -W ./.github/workflows/pull-db-tests.yml --event=pull_request --default-actions-url="https://github.com" -i catthehacker/ubuntu:runner-latest -l

Run sqlite integration tests

Start tests

make test-sqlite

Run MySQL integration tests

Setup a MySQL database inside docker

docker run -e "MYSQL_DATABASE=test" -e "MYSQL_ALLOW_EMPTY_PASSWORD=yes" -p 3306:3306 --rm --name mysql mysql:latest #(just ctrl-c to stop db and clean the container)
docker run -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" --rm --name elasticsearch elasticsearch:7.6.0 #(in a second terminal, just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_MYSQL_HOST=localhost:3306 TEST_MYSQL_DBNAME=test TEST_MYSQL_USERNAME=root TEST_MYSQL_PASSWORD='' make test-mysql

Run pgsql integration tests

Setup a pgsql database inside docker

docker run -e "POSTGRES_DB=test" -p 5432:5432 --rm --name pgsql postgres:latest #(just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_PGSQL_HOST=localhost:5432 TEST_PGSQL_DBNAME=test TEST_PGSQL_USERNAME=postgres TEST_PGSQL_PASSWORD=postgres make test-pgsql

Run mssql integration tests

Setup a mssql database inside docker

docker run -e "ACCEPT_EULA=Y" -e "MSSQL_PID=Standard" -e "SA_PASSWORD=MwantsaSecurePassword1" -p 1433:1433 --rm --name mssql microsoft/mssql-server-linux:latest #(just ctrl-c to stop db and clean the container)

Start tests based on the database container

TEST_MSSQL_HOST=localhost:1433 TEST_MSSQL_DBNAME=gitea_test TEST_MSSQL_USERNAME=sa TEST_MSSQL_PASSWORD=MwantsaSecurePassword1 make test-mssql

Running individual tests

Example command to run GPG test:

For SQLite:

make test-sqlite#GPG

For other databases(replace mssql to mysql, or pgsql):

TEST_MSSQL_HOST=localhost:1433 TEST_MSSQL_DBNAME=test TEST_MSSQL_USERNAME=sa TEST_MSSQL_PASSWORD=MwantsaSecurePassword1 make test-mssql#GPG

Setting timeouts for declaring long-tests and long-flushes

We appreciate that some testing machines may not be very powerful and the default timeouts for declaring a slow test or a slow clean-up flush may not be appropriate.

You can either:

  • Within the test ini file set the following section:
[integration-tests]
SLOW_TEST = 10s ; 10s is the default value
SLOW_FLUSH = 5S ; 5s is the default value
  • Set the following environment variables:
GITEA_SLOW_TEST_TIME="10s" GITEA_SLOW_FLUSH_TIME="5s" make test-sqlite