Skip to content

test: add golden outputs for docs.bzl scenarios - #804

Open
AlexanderLanin wants to merge 1 commit into
eclipse-score:mainfrom
etas-contrib:refactor/docs-bzl-golden-tests
Open

test: add golden outputs for docs.bzl scenarios#804
AlexanderLanin wants to merge 1 commit into
eclipse-score:mainfrom
etas-contrib:refactor/docs-bzl-golden-tests

Conversation

@AlexanderLanin

Copy link
Copy Markdown
Member

Why

The public docs.bzl scenario tests kept many expected outputs encoded as Python assertions. That made the scenarios incomplete and difficult to understand or update.

What

  • Add direct _expected/ golden files and directories for the positive docs.bzl scenarios.
  • Centralize the mapping from short expected-output names to Bazel targets and output roots.
  • Compare complete JSON documents in readable canonical form and preserve byte-exact HTML fixtures.
  • Add a scoped updater for refreshing existing golden files.
  • Keep focused semantic tests for runtime behavior and failure cases.
  • Split CI execution into cacheable and slow test groups, with the cacheable group first.

@MaximilianSoerenPollak MaximilianSoerenPollak left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have to understand it a bit more, some questions etc.
But overall it makes sense to me in the most parts.

Once they are answered and I understand it a bit better I think we could look towards merging it.

@@ -0,0 +1,1403 @@
{

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This one is formatted but the other one isn't.
Not sure if that matters or not?

@@ -0,0 +1,7 @@
{

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compatibility findings are not yet on main no? I'm not sure this should be in this PR.
Or do you intent for them to be merged first?

Comment thread pyproject.toml

markers = [
"bazel_cached: successful build-only test expected to reuse Bazel actions",
"bazel_slow: runtime execution or an uncached expected Bazel failure",

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do not quiet understand this marker?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

2 participants