Add some v0.3.0 API testing in daily integration tests

[bharat-thotakura]

Closes #1354

[bharat-thotakura]

An example integration test workflow against this branch can be found here

[Copilot]

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

Suppressed comments (8)

qiskit-superstaq/qiskit_superstaq/daily_integration_test.py:80

• _get_validated_list_compiled_circuits calls out.compiled_circuits(idx) for every index and then calls out.compiled_circuits() again. This is redundant and can increase job polling/refresh overhead; retrieving the list once and validating it is sufficient.

        assert isinstance(out, qss.SuperstaqJobV3)
        assert all(
            isinstance(out.compiled_circuits(idx), qiskit.QuantumCircuit)
            for idx in range(num_circuits)
        )
        compiled_circuits = out.compiled_circuits()

cirq-superstaq/cirq_superstaq/daily_integration_test.py:82

• _get_validated_list_compiled_circuits calls out.compiled_circuits(idx) for each index and then calls out.compiled_circuits() again. Fetch the list once and validate its contents/length to avoid redundant job refresh/polling calls.

        assert isinstance(out, css.JobV3)
        assert all(
            isinstance(out.compiled_circuits(idx), cirq.Circuit) for idx in range(num_circuits)
        )
        compiled_circuits = out.compiled_circuits()

qiskit-superstaq/qiskit_superstaq/daily_integration_test.py:60

• In the JobV3 path, compiled_circuits() / compiled_circuits(0) are called multiple times; even if cached, this adds redundant work and makes debugging failures harder. Cache the result once and assert on it.

This issue also appears on line 75 of the same file.

    assert isinstance(out, qss.SuperstaqJobV3)
    assert isinstance(out.compiled_circuits(), list)
    assert len(out.compiled_circuits()) == 1
    assert isinstance(out.compiled_circuits(0), qiskit.QuantumCircuit)
    return out.compiled_circuits(0)

qiskit-superstaq/qiskit_superstaq/daily_integration_test.py:47

• provider fixture assumes request.param is always set; if a future test uses the fixture without indirect parametrization this will raise at collection/runtime. Consider providing a default API version (e.g., the existing v0.2.0 behavior) to make the fixture safer to reuse.

    api_version = request.param
    return qss.SuperstaqProvider(api_version=api_version)

qiskit-superstaq/qiskit_superstaq/daily_integration_test.py:122

• This hard-coded exclusion list will be easy to forget and could mask regressions for these targets. Add a TODO describing the removal condition (and ideally link to a tracking issue) so it’s clear when this should be deleted.

        # Temporary filtering of targets without target info:
        if backend.name not in ("aqt_demo_qpu", "aqt_iqm20q_qpu"):
            assert backend.target_info().get("target") == backend.name
            assert backend.target.num_qubits is not None

cirq-superstaq/cirq_superstaq/daily_integration_test.py:49

• service fixture unconditionally reads request.param; if another test later uses this fixture without indirect parametrization it will fail. Consider defaulting to v0.2.0 so the fixture remains usable without extra decorators.

    api_version = request.param
    return css.Service(api_version=api_version)

cirq-superstaq/cirq_superstaq/daily_integration_test.py:62

• In the JobV3 path, compiled_circuits() / compiled_circuits(0) are called repeatedly. Cache the list once and validate against it to avoid redundant work and make failures clearer.

This issue also appears on line 77 of the same file.

    assert isinstance(out, css.JobV3)
    assert isinstance(out.compiled_circuits(), list)
    assert len(out.compiled_circuits()) == 1
    assert isinstance(out.compiled_circuits(0), cirq.Circuit)
    return out.compiled_circuits(0)

cirq-superstaq/cirq_superstaq/daily_integration_test.py:283

• This hard-coded target exclusion can easily linger and hide regressions for those targets. Add a TODO describing when it can be removed (and ideally a tracking issue link).

        # Temporary filtering of targets without target info:
        if target_name not in ("aqt_demo_qpu", "aqt_iqm20q_qpu"):
            assert service.target_info(target_name).get("target") == target_name

[bharat-thotakura]

Integration test passing against latest commits

[bharat-thotakura]

Note: update some tests to be less brittle against failures seen in workflows like this

[CLAassistant]

All committers have signed the CLA.