Skip to content

chore(deps): Bump rstest from 0.26.1 to 0.27.0 - #1234

Open
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/cargo/rstest-0.27.0
Open

chore(deps): Bump rstest from 0.26.1 to 0.27.0#1234
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/cargo/rstest-0.27.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 14, 2026

Copy link
Copy Markdown
Contributor

Bumps rstest from 0.26.1 to 0.27.0.

Release notes

Sourced from rstest's releases.

v0.27.0

[0.27.0] 2026/9/6

Changed

  • Bump msrv to 1.85.0 both for rstest and rstest_reuse
  • Disabled default features of futures-util

Added

  • Doc comments before #[values(...)] entries can be used to override the generated matrix test names (both for the legacy arg => [..] syntax and the new attribute form). See #321 thanks to @​orhun.

Fixed

  • Use fully-qualified core import. See #336.
  • Fix mut arguments failing to compile with #[trace]. See #345 thanks to @​super-cooper.
  • Fix compilation under bazel by upgrading proc-macro-crate to 3.4.0.
Changelog

Sourced from rstest's changelog.

[0.27.0] 2026/9/6

Changed

  • Bump msrv to 1.85.0 both for rstest and rstest_reuse
  • Disabled default features of futures-util

Added

  • Doc comments before #[values(...)] entries can be used to override the generated matrix test names (both for the legacy arg => [..] syntax and the new attribute form). See #321 thanks to @​orhun.

Fixed

  • Use fully-qualified core import. See #336.
  • Fix mut arguments failing to compile with #[trace]. See #345 thanks to @​super-cooper.
  • Fix compilation under bazel by upgrading proc-macro-crate to 3.4.0.
Commits
  • 59cd3d1 Release 0.27.0
  • 0821ebc test: Add E2E test for mut arguments with #[trace]
  • 509ffef fix: mut arguments with #[trace]
  • 043437d fix: Resolve clippy warnings and truncate long test project names
  • 9aa8d1a fix: Suppress nightly cargo lints in test scaffolding
  • 3d3c76c fix: Bump rstest_test MSRV to 1.85 and mark as unpublished
  • d9ae990 chore: Add changelog entry
  • 05d4b1a fix: Use fully-qualified core import
  • 6da56a1 Bump msrv to 1.85 also for rstest_reuse (#342)
  • 1e9963b Add CLAUDE.md for Claude Code guidance (#340)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [rstest](https://github.com/la10736/rstest) from 0.26.1 to 0.27.0.
- [Release notes](https://github.com/la10736/rstest/releases)
- [Changelog](https://github.com/la10736/rstest/blob/master/CHANGELOG.md)
- [Commits](la10736/rstest@v0.26.1...v0.27.0)

---
updated-dependencies:
- dependency-name: rstest
  dependency-version: 0.27.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file rust Pull requests that update Rust code labels Sep 14, 2026
@github-actions

Copy link
Copy Markdown

🧪 Tempest Identity Compatibility Results (advisory, non-blocking)

rust

Totals
======
Ran: 133 tests in 31.0001 sec.
 - Passed: 66
 - Skipped: 4
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 63
Sum of execute time for each test: 26.1071 sec.
Failed test IDs
===== FAILED TESTS (target=rust) =====
tempest.api.identity.admin.v3.test_application_credentials.ApplicationCredentialsV3AdminTest.test_create_application_credential_with_roles[id-3b3dd48f-3388-406a-a9e6-4d078a552d0e]
setUpClass (tempest.api.identity.admin.v3.test_endpoint_groups.EndPointGroupsTest)
tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete[id-7cd59bf9-bda4-4c72-9467-d21cab278355,smoke]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_domain_without_description[id-2abf8764-309a-4fa9-bc58-201b799817ad]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain[id-f2f5b44a-82e8-4dad-8084-0661ea3b18cf,smoke]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_domain_delete_cascades_content[id-d8d318b7-d1b3-4c37-94c5-3c5ba0b121ea]
tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_list_domains_filter_by_enabled[id-3fd19840-65c1-43f8-b48c-51bdd066dff9]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_create_domain_config_and_show_config_groups_and_options[id-9e3ff13c-f597-4f01-9377-d6c06c2a1477]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_create_update_and_delete_domain_config_groups_and_opts[id-c7510fa2-6661-4170-9c6b-4783a80651e9]
tempest.api.identity.admin.v3.test_domain_configuration.DomainConfigurationTestJSON.test_show_default_group_config_and_options[id-11a02bf0-6f94-4380-b3b0-c8dc18fc0d22]
tempest.api.identity.admin.v3.test_default_project_id.TestDefaultProjectId.test_default_project_id[id-d6110661-6a71-49a7-a453-b5e26640ff6d]
tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete[id-1598521a-2f36-4606-8df9-30772bd51339,smoke]
tempest.api.identity.admin.v3.test_domains_negative.DomainsNegativeTestJSON.test_create_domain_with_name_length_over_64[id-37b1bbf2-d664-4785-9a11-333438586eae,negative]
tempest.api.identity.admin.v3.test_domains_negative.DomainsNegativeTestJSON.test_delete_active_domain[gate,id-1f3fbff5-4e44-400d-9ca1-d953f05f609b,negative]
tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_list_user_groups[id-64573281-d26a-4a52-b899-503cb0f4e4ec]
tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON.test_list_users_with_not_enabled[id-bff8bf2f-9408-4ef5-b63a-753c8c2124eb]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsStaticTestJSON.test_list_projects[id-1d830662-22ad-427c-8c3e-4ec854b0af44]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_check_revoke_roles_on_projects_group[id-26021436-d5a4-4256-943c-ded01e0d4b45]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsTestJSON.test_list_projects_with_enabled[id-0fe7a334-675a-4509-b00e-1c4b95d5dae8]
tempest.api.identity.admin.v3.test_list_projects.ListProjectsTestJSON.test_list_projects_with_parent[id-6edc66f5-2941-4a17-9526-4073311c1fac]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_check_revoke_roles_on_projects_user[id-18b70e45-7687-4b72-8277-b8f1a47d7591]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_check_revoke_roles_on_domains_group[id-c7a8dda2-be50-4fb4-9a9c-e830771078b1]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_check_revoke_roles_on_domains_user[id-4e6f0366-97c8-423c-b2be-41eae6ac91c8]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_revoke_user_roles_on_domain[id-3acf666e-5354-42ac-8e17-8b68893bcd36]
tempest.api.identity.admin.v3.test_inherits.InheritsV3TestJSON.test_inherit_assign_list_revoke_user_roles_on_project_tree[id-9f02ccd9-9b57-46b4-8f77-dd5a736f3a06]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_create_and_show_consumer[id-c8307ea6-a86c-47fd-ae7b-5b3b2caca76d]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_delete_consumer[id-fdfa1b7f-2a31-4354-b2c7-f6ae20554f93]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_list_consumers[id-09ca50de-78f2-4ffb-ac71-f2254036b2b8]
tempest.api.identity.admin.v3.test_oauth_consumers.OAUTHConsumersV3Test.test_update_consumer[id-080a9b1a-c009-47c0-9979-5305bf72e3dc]
tempest.api.identity.admin.v3.test_project_tags.IdentityV3ProjectTagsTest.test_list_update_delete_project_tags[id-7c123aac-999d-416a-a0fb-84b915ab10de]
tempest.api.identity.admin.v3.test_projects.ProjectsTestJSON.test_create_is_domain_project[id-a7eb9416-6f9b-4dbb-b71b-7f73aaef59d5]
tempest.api.identity.admin.v3.test_projects.ProjectsTestJSON.test_project_create_with_parent[id-1854f9c0-70bc-4d11-a08a-1c789d339e3d]
tempest.api.identity.admin.v3.test_projects.ProjectsTestJSON.test_project_get_equals_list[id-d1db68b6-aebe-4fa0-b79d-d724d2e21162]
tempest.api.identity.admin.v3.test_projects_negative.ProjectsNegativeStaticTestJSON.test_create_projects_name_length_over_64[id-502b6ceb-b0c8-4422-bf53-f08fdb21e2f0,negative]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all[id-4773ebd5-ecbf-4255-b8d8-b63e6f72b65d,smoke]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_query[id-6268b345-87ca-47c0-9ce3-37792b43403a]
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_get_available_domain_scopes[id-ec5ecb05-af64-4c04-ac86-4d9f6f12f185]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_expire[id-0ed14b66-cefd-4b5c-a964-65759453e292]
tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token[id-565fa210-1da1-4563-999b-f7b5b67cf112]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_impersonate[id-5a0a91a4-baef-4a14-baba-59bf4d7fcace]
tempest.api.identity.v3.test_projects.IdentityV3ProjectsTest.test_list_projects_returns_only_authorized_projects[id-86128d46-e170-4644-866a-cc487f699e1d]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_assignments_for_domain_roles[id-3859df7e-5b78-4e4d-b10e-214c8953842a]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_assignments_for_implied_roles_create_delete[id-c8828027-df48-4021-95df-b65b92c7429e]
tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_trust_noimpersonate[id-ed2a8779-a7ac-49dc-afd7-30f32f936ed2]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_domain[id-4bf8a70b-e785-413a-ad53-9f91ce02faa7]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_project[id-cbf11737-1904-4690-9613-97bcbb3df1c4]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_group_on_system[id-c888fe4f-8018-48db-b959-542225c1b4b6]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_grant_list_revoke_role_to_user_on_domain[id-6c9a2940-3625-43a3-ac02-5dcec62ef3bd]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_domain_roles[id-eb1e1c24-1bc4-4d47-9748-e127a1852c82]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_implied_roles_create_check_show_delete[id-c90c316c-d706-4728-bcba-eb1912081b69]
tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list[id-18afc6c0-46cf-4911-824e-9989cc056c3a,smoke]
tempest.api.identity.admin.v3.test_users.UsersV3TestJSON.test_list_user_projects[id-a831e70c-e35b-430b-92ed-81ebbc5437b8]
tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types[id-657c1970-4722-4189-8831-7325f3bc4265,smoke]
tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources[id-b9232f5e-d9e5-4d97-b96c-28d3db4de1bd,smoke]
tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_identity_v3_existence[id-79aec9ae-710f-4c54-a4fc-3aa25b4feac3]
tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions[id-721f480f-35b6-46c7-846e-047e6acea0dc,smoke]
tempest.api.identity.v3.test_catalog.IdentityCatalogTest.test_catalog_standardization[id-56b57ced-22b8-4127-9b8a-565dfb0207e2]
tempest.api.identity.admin.v3.test_users_negative.UsersNegativeTest.test_create_user_for_non_existent_domain[id-e75f006c-89cc-477b-874d-588e4eab4b17,negative]
tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential[id-8080c75c-eddc-4786-941a-c2da7039ae61]
tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_create_application_credential_expires[id-852daf0c-42b5-4239-8466-d193d0543ed3]
tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_list_application_credentials[id-ff0cd457-6224-46e7-b79e-0ada4964a8a6]
tempest.api.identity.v3.test_application_credentials.ApplicationCredentialsV3Test.test_query_application_credentials[id-9bb5e5cc-5250-493a-8869-8b665f6aa5f6]
tempest.api.identity.v3.test_tokens.TokensV3Test.test_validate_token[id-a9512ac3-3909-48a4-b395-11f438e16260]
===== END FAILED TESTS (target=rust) =====

View full run

@github-actions

Copy link
Copy Markdown

🦢 Load Test Results

Goose Attack Report

Plan Overview

Action Started Stopped Elapsed Users
Increasing 26-09-14 08:44:56 26-09-14 08:45:19 00:00:23 0 → 45
Maintaining 26-09-14 08:45:19 26-09-14 08:45:49 00:00:30 45
Decreasing 26-09-14 08:45:49 26-09-14 08:45:49 00:00:00 0 ← 45

Request Metrics

Method Name # Requests # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
DELETE DELETE /v3/auth/tokens 45 0 541.80 170 721 1.50 0.00
DELETE DELETE /v3/projects/:id (teardown) 1 0 190.00 190 190 0.03 0.00
DELETE DELETE /v3/roles/:id (teardown) 1 0 171.00 171 171 0.03 0.00
DELETE DELETE /v3/users/:id (teardown) 2 0 316.00 290 342 0.07 0.00
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 1 0 183.00 183 183 0.03 0.00
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 1 0 251.00 251 251 0.03 0.00
GET 609 0 577.00 339 816 20.30 0.00
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 2005 2005 14.60 1 659 66.83 66.83
GET GET /v3/auth/tokens (validate new) 45 0 539.82 385 733 1.50 0.00
GET GET /v3/auth/tokens (validate revoked) 45 0 485.22 41 758 1.50 0.00
GET GET /v3/projects/:id 57 0 535.12 377 692 1.90 0.00
GET GET /v3/projects/:id (catalog) 85 0 535.47 379 708 2.83 0.00
GET GET /v3/role_assignments 42 0 575.64 327 718 1.40 0.00
GET GET /v3/role_assignments?role.id 44 0 520.57 385 704 1.47 0.00
GET GET /v3/role_assignments?scope.domain.id 44 0 511.09 360 682 1.47 0.00
GET GET /v3/role_assignments?user.id 43 0 522.81 343 665 1.43 0.00
GET GET /v3/roles 115 0 534.19 327 733 3.83 0.00
GET GET /v3/roles/:id 58 0 530.67 368 691 1.93 0.00
GET GET /v3/users/:id 107 0 570.07 387 737 3.57 0.00
GET GET /v3/users/:id (catalog) 107 0 566.18 385 730 3.57 0.00
GET GET /v4/api-keys 28 0 541.18 330 744 0.93 0.00
GET GET /v4/api-keys/:client_id 28 0 555.96 397 775 0.93 0.00
GET GET /v4/mappings/rulesets 28 0 559.86 325 688 0.93 0.00
GET GET /v4/mappings/rulesets/:mapping_id 29 0 508.41 356 676 0.97 0.00
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 872 0 50.24 8 202 29.07 0.00
GET GET /v4/oauth2/:domain_id/clients 29 0 516.28 332 644 0.97 0.00
GET GET /v4/oauth2/:domain_id/clients/:provider_id 29 0 535.38 386 679 0.97 0.00
GET GET /v4/oauth2/:domain_id/jwks 871 0 52.46 10 185 29.03 0.00
GET GET /v4/scim_realms 18 0 523.06 307 702 0.60 0.00
GET GET /v4/scim_realms/:domain_id/:provider_id 19 0 536.68 390 674 0.63 0.00
POST POST /v3/auth/tokens 45 0 482.38 331 680 1.50 0.00
POST POST /v3/auth/tokens (password, invalid) 32 0 973.97 573 1474 1.07 0.00
POST POST /v3/auth/tokens (password, project-scoped) 52 0 1285.67 889 1896 1.73 0.00
POST POST /v3/auth/tokens (password, unscoped) 53 0 1107.57 661 1705 1.77 0.00
POST POST /v3/auth/tokens (rescope to system) 101 0 607.57 417 818 3.37 0.00
POST POST /v3/auth/tokens (rescope, invalid project) 61 0 506.41 321 694 2.03 0.00
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 48 0 1288.88 641 2061 1.60 0.00
POST POST /v4/api-keys/:client_id/revoke (teardown) 1 0 240.00 240 240 0.03 0.00
PUT PUT /v4/scim_realms/:domain_id/:provider_id 19 0 587.53 446 766 0.63 0.00
Aggregated 5820 2005 236.97 1 2061 194.00 66.83

Response Time Metrics

Method Name 50%ile (ms) 60%ile (ms) 70%ile (ms) 80%ile (ms) 90%ile (ms) 95%ile (ms) 99%ile (ms) 100%ile (ms)
DELETE DELETE /v3/auth/tokens 600 600 600 600 700 700 700 700
DELETE DELETE /v3/projects/:id (teardown) 190 190 190 190 190 190 190 190
DELETE DELETE /v3/roles/:id (teardown) 171 171 171 171 171 171 171 171
DELETE DELETE /v3/users/:id (teardown) 290 290 290 340 340 340 340 340
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 183 183 183 183 183 183 183 183
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 251 251 251 251 251 251 251 251
GET 600 600 600 600 700 700 800 800
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 6 8 10 12 17 22 360 659
GET GET /v3/auth/tokens (validate new) 600 600 600 600 600 700 700 700
GET GET /v3/auth/tokens (validate revoked) 500 500 500 600 600 600 758 758
GET GET /v3/projects/:id 500 500 600 600 600 692 692 692
GET GET /v3/projects/:id (catalog) 500 600 600 600 600 700 700 700
GET GET /v3/role_assignments 600 600 600 600 700 700 700 700
GET GET /v3/role_assignments?role.id 500 500 600 600 600 600 700 700
GET GET /v3/role_assignments?scope.domain.id 500 500 500 600 600 682 682 682
GET GET /v3/role_assignments?user.id 500 500 600 600 600 600 665 665
GET GET /v3/roles 500 600 600 600 600 700 700 700
GET GET /v3/roles/:id 500 600 600 600 691 691 691 691
GET GET /v3/users/:id 600 600 600 600 700 700 700 700
GET GET /v3/users/:id (catalog) 600 600 600 600 700 700 700 700
GET GET /v4/api-keys 500 600 600 600 700 700 700 700
GET GET /v4/api-keys/:client_id 600 600 600 600 600 600 775 775
GET GET /v4/mappings/rulesets 600 600 600 600 600 600 688 688
GET GET /v4/mappings/rulesets/:mapping_id 500 500 600 600 600 600 676 676
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 44 51 59 71 84 98 130 200
GET GET /v4/oauth2/:domain_id/clients 500 500 600 600 600 600 600 600
GET GET /v4/oauth2/:domain_id/clients/:provider_id 500 600 600 600 600 679 679 679
GET GET /v4/oauth2/:domain_id/jwks 45 54 63 73 90 110 130 185
GET GET /v4/scim_realms 500 600 600 600 600 600 700 700
GET GET /v4/scim_realms/:domain_id/:provider_id 500 600 600 600 600 600 674 674
POST POST /v3/auth/tokens 480 500 500 500 600 600 680 680
POST POST /v3/auth/tokens (password, invalid) 1,000 1,000 1,000 1,000 1,000 1,000 1,000 1,000
POST POST /v3/auth/tokens (password, project-scoped) 1,000 1,000 1,000 1,000 1,896 1,896 1,896 1,896
POST POST /v3/auth/tokens (password, unscoped) 1,000 1,000 1,000 1,000 1,000 1,000 1,705 1,705
POST POST /v3/auth/tokens (rescope to system) 600 600 600 700 700 800 800 800
POST POST /v3/auth/tokens (rescope, invalid project) 500 500 500 600 600 600 694 694
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 1,000 1,000 1,000 1,000 2,000 2,000 2,000 2,000
POST POST /v4/api-keys/:client_id/revoke (teardown) 240 240 240 240 240 240 240 240
PUT PUT /v4/scim_realms/:domain_id/:provider_id 600 600 600 700 700 700 766 766
Aggregated 47 81 470 600 600 700 1,000 2,000

Status Code Metrics

Method Name Status Codes
DELETE DELETE /v3/auth/tokens 45 [204]
DELETE DELETE /v3/projects/:id (teardown) 1 [204]
DELETE DELETE /v3/roles/:id (teardown) 1 [204]
DELETE DELETE /v3/users/:id (teardown) 2 [204]
DELETE DELETE /v4/mappings/rulesets/:mapping_id (teardown) 1 [204]
DELETE DELETE /v4/oauth2/:domain_id/clients/:provider_id (teardown) 1 [204]
GET 609 [200]
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 31 [401], 1,974 [429]
GET GET /v3/auth/tokens (validate new) 45 [200]
GET GET /v3/auth/tokens (validate revoked) 45 [404]
GET GET /v3/projects/:id 57 [200]
GET GET /v3/projects/:id (catalog) 85 [200]
GET GET /v3/role_assignments 42 [200]
GET GET /v3/role_assignments?role.id 44 [200]
GET GET /v3/role_assignments?scope.domain.id 44 [200]
GET GET /v3/role_assignments?user.id 43 [200]
GET GET /v3/roles 115 [200]
GET GET /v3/roles/:id 58 [200]
GET GET /v3/users/:id 107 [200]
GET GET /v3/users/:id (catalog) 107 [200]
GET GET /v4/api-keys 28 [200]
GET GET /v4/api-keys/:client_id 28 [200]
GET GET /v4/mappings/rulesets 28 [200]
GET GET /v4/mappings/rulesets/:mapping_id 29 [200]
GET GET /v4/oauth2/:domain_id/.well-known/openid-configuration 872 [200]
GET GET /v4/oauth2/:domain_id/clients 29 [200]
GET GET /v4/oauth2/:domain_id/clients/:provider_id 29 [200]
GET GET /v4/oauth2/:domain_id/jwks 871 [200]
GET GET /v4/scim_realms 18 [200]
GET GET /v4/scim_realms/:domain_id/:provider_id 19 [200]
POST POST /v3/auth/tokens 45 [201]
POST POST /v3/auth/tokens (password, invalid) 32 [401]
POST POST /v3/auth/tokens (password, project-scoped) 52 [201]
POST POST /v3/auth/tokens (password, unscoped) 53 [201]
POST POST /v3/auth/tokens (rescope to system) 101 [201]
POST POST /v3/auth/tokens (rescope, invalid project) 61 [401]
POST POST /v3/auth/tokens (system-scoped, bootstrap admin) 48 [201]
POST POST /v4/api-keys/:client_id/revoke (teardown) 1 [200]
PUT PUT /v4/scim_realms/:domain_id/:provider_id 19 [200]
Aggregated 299 [201], 51 [204], 124 [401], 1,974 [429], 3,327 [200], 45 [404]

Transaction Metrics

Transaction # Times Run # Fails Average (ms) Min (ms) Max (ms) RPS Failures/s
ReadHeavy
0.0 1 0 31.00 31 31 0.03 0.00
0.1 110 0 596.18 403 804 3.67 0.00
0.2 109 0 545.15 359 705 3.63 0.00
0.3 107 0 540.47 341 751 3.57 0.00
TokenLifecycle
1.0 0 0 0.00 0 0 0.00 0.00
1.1 45 0 2050.89 1157 2442 1.50 0.00
ValidateToken
2.0 0 0 0.00 0 0 0.00 0.00
2.1 95 0 641.54 428 816 3.17 0.00
UserCRUD
3.0 0 0 0.00 0 0 0.00 0.00
3.1 0 0 0.00 0 0 0.00 0.00
3.2 107 0 570.11 387 737 3.57 0.00
3.3 2 0 316.00 290 342 0.07 0.00
ProjectCRUD
4.0 0 0 0.00 0 0 0.00 0.00
4.1 0 0 0.00 0 0 0.00 0.00
4.2 57 0 535.14 377 692 1.90 0.00
4.3 1 0 190.00 190 190 0.03 0.00
RoleCRUD
5.0 0 0 0.00 0 0 0.00 0.00
5.1 0 0 0.00 0 0 0.00 0.00
5.2 58 0 530.71 368 691 1.93 0.00
5.3 1 0 171.00 171 171 0.03 0.00
RoleList
6.0 0 0 0.00 0 0 0.00 0.00
6.1 115 0 534.19 327 733 3.83 0.00
RoleAssignmentList
7.0 0 0 0.00 0 0 0.00 0.00
7.1 42 0 575.64 327 718 1.40 0.00
7.2 43 0 522.81 343 665 1.43 0.00
7.3 44 0 511.11 360 682 1.47 0.00
7.4 44 0 520.61 386 704 1.47 0.00
UserRead
8.0 0 0 0.00 0 0 0.00 0.00
8.1 105 0 586.07 339 773 3.50 0.00
8.2 107 0 566.21 385 730 3.57 0.00
ProjectRead
9.0 0 0 0.00 0 0 0.00 0.00
9.1 83 0 555.57 347 732 2.77 0.00
9.2 85 0 535.53 379 708 2.83 0.00
PasswordAuth
10.0 53 0 1107.57 661 1705 1.77 0.00
10.1 52 0 1285.71 889 1896 1.73 0.00
PasswordAuthNegative
11.0 32 0 974.03 574 1474 1.07 0.00
Rescope
12.0 0 0 0.00 0 0 0.00 0.00
12.1 101 0 607.63 418 818 3.37 0.00
RescopeNegative
13.0 0 0 0.00 0 0 0.00 0.00
13.1 61 0 506.54 321 694 2.03 0.00
SystemScopeAuth
14.0 48 0 1288.98 641 2061 1.60 0.00
ApiKeyCRUD
15.0 0 0 0.00 0 0 0.00 0.00
15.1 0 0 0.00 0 0 0.00 0.00
15.2 28 0 555.96 397 775 0.93 0.00
15.3 28 0 541.18 330 744 0.93 0.00
15.4 1 0 240.00 240 240 0.03 0.00
MappingCRUD
16.0 0 0 0.00 0 0 0.00 0.00
16.1 0 0 0.00 0 0 0.00 0.00
16.2 29 0 508.41 356 676 0.97 0.00
16.3 28 0 559.89 325 688 0.93 0.00
16.4 1 0 183.00 183 183 0.03 0.00
OAuth2ClientCRUD
17.0 0 0 0.00 0 0 0.00 0.00
17.1 0 0 0.00 0 0 0.00 0.00
17.2 29 0 535.38 386 679 0.97 0.00
17.3 29 0 516.31 332 644 0.97 0.00
17.4 1 0 251.00 251 251 0.03 0.00
OAuth2Discovery
18.0 871 0 52.48 11 185 29.03 0.00
18.1 872 0 50.27 8 202 29.07 0.00
ScimRealmRead
19.0 0 0 0.00 0 0 0.00 0.00
19.1 19 0 536.74 390 674 0.63 0.00
19.2 18 0 523.11 307 702 0.60 0.00
19.3 19 0 587.58 446 766 0.63 0.00
ScimSync
20.0 0 0 0.00 0 0 0.00 0.00
20.1 0 0 0.00 0 0 0.00 0.00
20.2 0 0 0.00 0 0 0.00 0.00
20.3 2005 0 14.62 1 659 66.83 0.00
20.4 2004 0 0.00 0 0 66.80 0.00
20.5 2004 0 0.00 0 0 66.80 0.00
20.6 1 0 0.00 0 0 0.03 0.00
Aggregated 9695 0 142.25 1 2442 323.17 0.00

Scenario Metrics

Transaction # Users # Times Run Average (ms) Min (ms) Max (ms) Scenarios/s Iterations
ReadHeavy 6 106 1688.47 1456 2031 3.53 17.67
TokenLifecycle 3 42 2097.60 1843 2442 1.40 14.00
ValidateToken 2 93 643.65 462 816 3.10 46.50
UserCRUD 2 105 570.29 387 737 3.50 52.50
ProjectCRUD 1 56 537.96 408 692 1.87 56.00
RoleCRUD 1 57 533.56 368 691 1.90 57.00
RoleList 2 113 536.59 327 733 3.77 56.50
RoleAssignmentList 3 42 2133.00 1795 2510 1.40 14.00
UserRead 4 104 1152.75 938 1467 3.47 26.00
ProjectRead 3 82 1091.98 852 1327 2.73 27.33
PasswordAuth 4 51 2392.45 1685 3084 1.70 12.75
PasswordAuthNegative 1 31 982.06 574 1474 1.03 31.00
Rescope 2 99 608.67 418 818 3.30 49.50
RescopeNegative 1 60 509.63 349 694 2.00 60.00
SystemScopeAuth 2 46 1307.11 849 2061 1.53 23.00
ApiKeyCRUD 1 28 1099.07 940 1365 0.93 28.00
MappingCRUD 1 28 1073.54 877 1287 0.93 28.00
OAuth2ClientCRUD 1 29 1056.93 917 1246 0.97 29.00
OAuth2Discovery 3 871 103.26 29 313 29.03 290.33
ScimRealmRead 1 19 1655.84 1292 1926 0.63 19.00
ScimSync 1 2004 14.47 1 659 66.80 2004.00
Aggregated 45 4066 332.59 1 3084 135.53 2942.08

Error Metrics

Method Name # Error
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 49 401 Unauthorized: GET /SCIM/v2/:domain_id/Users (sync reconcile list)
POST POST /SCIM/v2/:domain_id/Users (sync provision) 1 401 Unauthorized: POST /SCIM/v2/:domain_id/Users (sync provision)
POST POST /v3/auth/tokens (password, invalid) 74 401 Unauthorized: POST /v3/auth/tokens (password, invalid)
POST POST /v3/auth/tokens (rescope, invalid project) 154 401 Unauthorized: POST /v3/auth/tokens (rescope, invalid project)
GET GET /v3/auth/tokens (validate revoked) 160 404 Not Found: GET /v3/auth/tokens (validate revoked)
GET GET /SCIM/v2/:domain_id/Users (sync reconcile list) 2159 429 Too Many Requests: GET /SCIM/v2/:domain_id/Users (sync reconcile list)

View full report

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file rust Pull requests that update Rust code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants