feat: Add integration test framework - #126

Merged

lurtz merged 135 commits into

mainfrom

add-score-itf-for-intergration-tests

Jun 30, 2026

Commits on May 13, 2026

add hello world itf test
lurtz
committed
5fa6733
add docker in docker feature for running itf
lurtz
committed
7520403
stricter capabilities check
lurtz
committed
8c7b658

Commits on May 18, 2026

copy integration test framework from communication
lurtz
committed
b4f24d4
add quality to QNX tests
lurtz
committed
c6ffa97
delete unused files
lurtz
committed
1342568
restore docs-as-code 3.0.0 to fix build
lurtz
committed
2cb9000
actually run tests on QNX
lurtz
committed
350a350
remove tests already present in communication
lurtz
committed
9775c06
use actual qnx workflow
lurtz
committed
073b6fe

Commits on May 19, 2026

add another qnx toolchain
lurtz
committed
8df4cf1
use_repo score qcc toolchain pkg
lurtz
committed
3de7ab9
bump QNX version to 8.0.3
lurtz
committed
0273b7b
bump score bazel cpp toolchains to 0.5.1
lurtz
committed
057c091
run integration tests in Linux via QEMU
lurtz
committed
03f49e0
at the moment no ARM64 QNX image is build
lurtz
committed
ced97e3
add Qemu, ping and genisoimage to workflow
lurtz
committed
c90fa43
add Qemu, ping and genisoimage to devcontainer
lurtz
committed
902c043
only build seed.iso if really needed
lurtz
committed
fca75e4
proper QNX x86_64 constraint
lurtz
committed
1cd3779

Commits on May 20, 2026

avoid patching ITF and use a plugin instead
lurtz
committed
ec5322f
remove unused config_setting
lurtz
committed
96c49f0
remove not needed user-data
lurtz
committed
8f84bd0
run Linux QEMU tests in CI
lurtz
committed
d56b344
enable KVM
lurtz
committed
f25f084
Revert "remove not needed user-data"
lurtz
committed
1005d20
ensure Ubuntu image is not permanently altered by tests
lurtz
committed
d48ca0a
only build linux qemu plugin on linux
lurtz
committed
2d3cc49

Commits on May 21, 2026

try another way to enable SSH password login
lurtz
committed
9a0b094
Add documentation
lurtz
committed
90f99fd
Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
15112e3
reintroduce cpp toolchains git override
lurtz
committed
5ab37ba
ci: retry flaky linux qemu integration test in host workflow
lurtz
committed
7e77fdb
itf: harden qemu target readiness against transient ssh resets
lurtz
committed
5539497
buildifier: sort linux_qemu BUILD deps
lurtz
committed
5c4304a
itf: increase linux qemu ssh readiness budget
lurtz
committed
884ec4f

Commits on May 22, 2026

ci: raise qemu integration test timeout in host workflow
lurtz
committed
827a9fb
ci: don't fail pull_request on flaky qemu host integration step
lurtz
committed
8f76a9f
restore build_and_test_host to simpler state
lurtz
committed
0bf28ac
put integration testing into separate job
lurtz
committed
b5446b7
comment restarting SSH
lurtz
committed
d8cb5fa
fix(itf): attach cloud-init seed as cdrom for linux qemu
lurtz
committed
65014ad
fix(itf): keep nocloud seed filenames in iso9660
lurtz
committed
7a752a2
Instead of CD image inject cloud-init data as disk image
lurtz
committed
1f6f7d8
fix(ci): upgrade Bazel 8.3.0 to 8.4.1 and fix Starlark formatting
lurtz
committed
91665f3
add missing tools
lurtz
committed
83b68eb
try again with genisoimage
lurtz
committed
2911539
add cloud-image-utils to Dockerfile
lurtz
committed
5f4edb0
clould-localds with way more fallbacks
lurtz
committed
c410c9d

Commits on May 26, 2026

simplify seed.img creation
lurtz
committed
21bd39d
remove git override
lurtz
committed
4587dfa
diff minimization
lurtz
committed
f3dbf94
run all tests with QEMU if possible and better job name
lurtz
committed
9598802
better explanation why docs_as_code uses version override
lurtz
committed
e8eddfc
remove first ITF tryout
lurtz
committed
b3de3e7
Support parallel execution of integration tests
lurtz
committed
691b535
Bump docker-in-docker to version 3
lurtz
committed
9e9b33e

Commits on May 27, 2026

towards ITF based integration tests
lurtz
committed
1b957d7
smal test cleanup
lurtz
committed
1a51e9d
cleanup
lurtz
committed
0423230
make Linux Qemu and Docker work
lurtz
committed
75bd0fd
check that daemons do not crash immediately
lurtz
committed
8dfabad
actually follow self established naming convection
lurtz
committed
fc45cde
ensure mergedusr is set
lurtz
committed
c25f35d
Allow other sandboxes in QNX workflows
lurtz
committed
c456e5a

Commits on Jun 3, 2026

switch to bridge interfaces for integration testing
lurtz
committed
5b91fdd
move qemu based integration test execution into dedicated test configuration
lurtz
committed
a17390f
use qnx workflow supporting linux-sandbox
lurtz
committed
c65abea
Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
02a5403
use correct repo name
lurtz
committed
bfe164b
correct branch name
lurtz
committed
831b424
retry qnx job
lurtz
committed
92082ed
retry 2
lurtz
committed
85c0f14

Commits on Jun 4, 2026

Enforce linux-sandbox for QNX builds
lurtz
committed
0c052cb
copy QNX config from ITF
lurtz
committed
049b9a6
make QNX QEMU with TAP networking work
lurtz
committed
3a7589f
Revert "make QNX QEMU with TAP networking work"
lurtz
committed
2f91731
use network setup as done by ITF
lurtz
committed
03e64e2
remove docker backend
lurtz
committed
3423c5f
Remove Ubuntu 24.04 docker
lurtz
committed
8ea09b3

Commits on Jun 8, 2026

more complex working test with tcpdump
lurtz
committed
176c190
test killing tcpdump
lurtz
committed
b327788
cleanup
lurtz
committed
4a73af5
split tcpdump tests into new file
lurtz
committed
30aaaaf

Commits on Jun 9, 2026

someipd with tcpdump finally works
lurtz
committed
d97cf01
tcpdump test cleanup
lurtz
committed
05e095d
add ping to the QNX image
lurtz
committed
7e85682
fix lola startup in QNX
lurtz
committed
fc3629f
move target specific setup into environment
lurtz
committed
68640b6

Commits on Jun 10, 2026

Make QNX send SOME/IP-SD messages
lurtz
committed
9d6c9b5
perform cleanup before starting a test
lurtz
committed
6eab853
split deamon and tcpdump test
lurtz
committed
0765d37
cleanup stale code
lurtz
committed
ae9eea3
Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
29249cd
install cloud-image-utils needed for Ubuntu QEMU tests
lurtz
committed
f7eea6f
add null_serializer to the test image
lurtz
committed
9c556d4
remove setcap for tcpdump
lurtz
committed
18ea28b
Add integration tests to QNX
lurtz
committed
f78e177
Support github runner ps aux messages in tcpdump test
lurtz
committed
93056e3
fix some pylint warnins
lurtz
committed
43d2035
Fix killing and checking for running processes on target
lurtz
committed
9cdc403
correct copyright year for files in integration_test
lurtz
committed
166590d
put someipd and gatewayd startup into test fixture
lurtz
committed
f23cab0
preparation to capture test traffic with tcpdump
lurtz
committed
e0c41c7

Commits on Jun 11, 2026

simplify tcpdump test
lurtz
committed
5ffb06d
assert that stopped applications are really stopped
lurtz
committed
b01fbfa
test killing tcpdump while still receiving data
lurtz
committed
859d36f
simplify tcpdump output retrieval
lurtz
committed
c7b9b8c
split tests to one test per file
lurtz
committed
2bf8b60
Add README to integration tests
lurtz
committed
71b6421
correct use of accelerator parameters
lurtz
committed
0610501
defensive programming when stopping QEMU
lurtz
committed
e6986ae
Avoid busy loop at service discovery
lurtz
committed
a2d5c56
ping Ubuntu QEMU image
lurtz
committed
1072ad7
Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
ea119f4
Finally stopping processes works
lurtz
committed
cd25f98

Commits on Jun 15, 2026

Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
8cbba0b
remove call to ssh-keygen
lurtz
committed
e34553a

Commits on Jun 17, 2026

Commits on Jun 25, 2026

Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
49cfb1d
delete unused expand_template
lurtz
committed
af5e3c7
Use Ubuntu image from fixed date
lurtz
committed
ed8bc51
use s-core setup-bazel-cache
lurtz
committed
d5554b1
remove test QNX job
lurtz
committed
1dbbc55
remove unneeded file export
lurtz
committed
31b3716
Revert "remove test QNX job"
lurtz
committed
2309d8e
patch score_tooling to remove Android dependency
lurtz
committed
d35e4b8

Commits on Jun 26, 2026

Remove build_and_test_qnx from CI job
lurtz
authored
948e8a5
Revert "patch score_tooling to remove Android dependency"
lurtz
committed
e7ebd8d
resend ping if tcpdump capture failed
lurtz
committed
a6e3b62

Commits on Jun 29, 2026

Merge remote-tracking branch 'origin/main' into add-score-itf-for-intergration-tests
lurtz
committed
3c5bc0b