-
Notifications
You must be signed in to change notification settings - Fork 14
feat: Add integration test framework #126
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
135 commits
Select commit
Hold shift + click to select a range
5fa6733
add hello world itf test
lurtz 7520403
add docker in docker feature for running itf
lurtz 8c7b658
stricter capabilities check
lurtz b4f24d4
copy integration test framework from communication
lurtz c6ffa97
add quality to QNX tests
lurtz 1342568
delete unused files
lurtz 2cb9000
restore docs-as-code 3.0.0 to fix build
lurtz 350a350
actually run tests on QNX
lurtz 9775c06
remove tests already present in communication
lurtz 073b6fe
use actual qnx workflow
lurtz 8df4cf1
add another qnx toolchain
lurtz 3de7ab9
use_repo score qcc toolchain pkg
lurtz 0273b7b
bump QNX version to 8.0.3
lurtz 057c091
bump score bazel cpp toolchains to 0.5.1
lurtz 03f49e0
run integration tests in Linux via QEMU
lurtz ced97e3
at the moment no ARM64 QNX image is build
lurtz c90fa43
add Qemu, ping and genisoimage to workflow
lurtz 902c043
add Qemu, ping and genisoimage to devcontainer
lurtz fca75e4
only build seed.iso if really needed
lurtz 1cd3779
proper QNX x86_64 constraint
lurtz ec5322f
avoid patching ITF and use a plugin instead
lurtz 96c49f0
remove unused config_setting
lurtz 8f84bd0
remove not needed user-data
lurtz d56b344
run Linux QEMU tests in CI
lurtz f25f084
enable KVM
lurtz 1005d20
Revert "remove not needed user-data"
lurtz d48ca0a
ensure Ubuntu image is not permanently altered by tests
lurtz 2d3cc49
only build linux qemu plugin on linux
lurtz 9a0b094
try another way to enable SSH password login
lurtz 90f99fd
Add documentation
lurtz 15112e3
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz 5ab37ba
reintroduce cpp toolchains git override
lurtz 7e77fdb
ci: retry flaky linux qemu integration test in host workflow
lurtz 5539497
itf: harden qemu target readiness against transient ssh resets
lurtz 5c4304a
buildifier: sort linux_qemu BUILD deps
lurtz 884ec4f
itf: increase linux qemu ssh readiness budget
lurtz 827a9fb
ci: raise qemu integration test timeout in host workflow
lurtz 8f76a9f
ci: don't fail pull_request on flaky qemu host integration step
lurtz 0bf28ac
restore build_and_test_host to simpler state
lurtz b5446b7
put integration testing into separate job
lurtz d8cb5fa
comment restarting SSH
lurtz 65014ad
fix(itf): attach cloud-init seed as cdrom for linux qemu
lurtz 7a752a2
fix(itf): keep nocloud seed filenames in iso9660
lurtz 1f6f7d8
Instead of CD image inject cloud-init data as disk image
lurtz 91665f3
fix(ci): upgrade Bazel 8.3.0 to 8.4.1 and fix Starlark formatting
lurtz 83b68eb
add missing tools
lurtz 2911539
try again with genisoimage
lurtz 5f4edb0
add cloud-image-utils to Dockerfile
lurtz c410c9d
clould-localds with way more fallbacks
lurtz 21bd39d
simplify seed.img creation
lurtz 4587dfa
remove git override
lurtz f3dbf94
diff minimization
lurtz 9598802
run all tests with QEMU if possible and better job name
lurtz e8eddfc
better explanation why docs_as_code uses version override
lurtz b3de3e7
remove first ITF tryout
lurtz 691b535
Support parallel execution of integration tests
lurtz 9e9b33e
Bump docker-in-docker to version 3
lurtz 1b957d7
towards ITF based integration tests
lurtz 1a51e9d
smal test cleanup
lurtz 0423230
cleanup
lurtz 75bd0fd
make Linux Qemu and Docker work
lurtz 8dfabad
check that daemons do not crash immediately
lurtz fc45cde
actually follow self established naming convection
lurtz c25f35d
ensure mergedusr is set
lurtz c456e5a
Allow other sandboxes in QNX workflows
lurtz 5b91fdd
switch to bridge interfaces for integration testing
lurtz a17390f
move qemu based integration test execution into dedicated test config…
lurtz c65abea
use qnx workflow supporting linux-sandbox
lurtz 02a5403
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz bfe164b
use correct repo name
lurtz 831b424
correct branch name
lurtz 92082ed
retry qnx job
lurtz 85c0f14
retry 2
lurtz 0c052cb
Enforce linux-sandbox for QNX builds
lurtz 049b9a6
copy QNX config from ITF
lurtz 3a7589f
make QNX QEMU with TAP networking work
lurtz 2f91731
Revert "make QNX QEMU with TAP networking work"
lurtz 03e64e2
use network setup as done by ITF
lurtz 3423c5f
remove docker backend
lurtz 8ea09b3
Remove Ubuntu 24.04 docker
lurtz 176c190
more complex working test with tcpdump
lurtz b327788
test killing tcpdump
lurtz 4a73af5
cleanup
lurtz 30aaaaf
split tcpdump tests into new file
lurtz d97cf01
someipd with tcpdump finally works
lurtz 05e095d
tcpdump test cleanup
lurtz 7e85682
add ping to the QNX image
lurtz fc3629f
fix lola startup in QNX
lurtz 68640b6
move target specific setup into environment
lurtz 9d6c9b5
Make QNX send SOME/IP-SD messages
lurtz 6eab853
perform cleanup before starting a test
lurtz 0765d37
split deamon and tcpdump test
lurtz ae9eea3
cleanup stale code
lurtz 29249cd
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz f7eea6f
install cloud-image-utils needed for Ubuntu QEMU tests
lurtz 9c556d4
add null_serializer to the test image
lurtz 18ea28b
remove setcap for tcpdump
lurtz f78e177
Add integration tests to QNX
lurtz 93056e3
Support github runner ps aux messages in tcpdump test
lurtz 43d2035
fix some pylint warnins
lurtz 9cdc403
Fix killing and checking for running processes on target
lurtz 166590d
correct copyright year for files in integration_test
lurtz f23cab0
put someipd and gatewayd startup into test fixture
lurtz e0c41c7
preparation to capture test traffic with tcpdump
lurtz 5ffb06d
simplify tcpdump test
lurtz b01fbfa
assert that stopped applications are really stopped
lurtz 859d36f
test killing tcpdump while still receiving data
lurtz c7b9b8c
simplify tcpdump output retrieval
lurtz 2bf8b60
split tests to one test per file
lurtz 71b6421
Add README to integration tests
lurtz 0610501
correct use of accelerator parameters
lurtz e6986ae
defensive programming when stopping QEMU
lurtz a2d5c56
Avoid busy loop at service discovery
lurtz 1072ad7
ping Ubuntu QEMU image
lurtz ea119f4
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz cd25f98
Finally stopping processes works
lurtz 8cbba0b
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz e34553a
remove call to ssh-keygen
lurtz 87b3729
Remove sanitizer configuration
lurtz 0bee483
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz 2be6d11
Fix host qemu workflow
lurtz e2c571c
block internet access for integration tests
lurtz 37bbe54
Only enforce network namespace for integration tests
lurtz 49cfb1d
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz af5e3c7
delete unused expand_template
lurtz ed8bc51
Use Ubuntu image from fixed date
lurtz d5554b1
use s-core setup-bazel-cache
lurtz 1dbbc55
remove test QNX job
lurtz 31b3716
remove unneeded file export
lurtz 2309d8e
Revert "remove test QNX job"
lurtz d35e4b8
patch score_tooling to remove Android dependency
lurtz 948e8a5
Remove build_and_test_qnx from CI job
lurtz e7ebd8d
Revert "patch score_tooling to remove Android dependency"
lurtz a6e3b62
resend ping if tcpdump capture failed
lurtz 3c5bc0b
Merge remote-tracking branch 'origin/main' into add-score-itf-for-int…
lurtz File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| { | ||
| "features": { | ||
| "ghcr.io/devcontainers/features/docker-in-docker:3": { | ||
| "version": "3.0.1", | ||
| "resolved": "ghcr.io/devcontainers/features/docker-in-docker@sha256:ca2508495b01ba29eba93e8153772a2daa65eaa86471cc6863fe2a3d21933df9", | ||
| "integrity": "sha256:ca2508495b01ba29eba93e8153772a2daa65eaa86471cc6863fe2a3d21933df9" | ||
| } | ||
| } | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
These tools are at the moment not managed by bazel, but used from the environment by bazel. I guess some might not like it.