Skip to content

Temp pf - #1063

Open
mihir-datazip wants to merge 36 commits into
masterfrom
temp-pf
Open

Temp pf#1063
mihir-datazip wants to merge 36 commits into
masterfrom
temp-pf

Conversation

@mihir-datazip

@mihir-datazip mihir-datazip commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Description

Fixes # (issue)

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • Scenario A
  • Scenario B

Screenshots or Recordings

Documentation

  • Documentation Link: [link to README, olake.io/docs, or olake-docs]
  • N/A (bug fix, refactor, or test changes only)

Related PR's (If Any):

@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 3, 2026 07:33 — with GitHub Actions Inactive
@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 3, 2026 07:33 — with GitHub Actions Inactive
@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 3, 2026 08:30 — with GitHub Actions Inactive
@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 3, 2026 08:30 — with GitHub Actions Inactive
@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 4, 2026 10:49 — with GitHub Actions Inactive
@mihir-datazip
mihir-datazip temporarily deployed to Performance Testing August 4, 2026 10:49 — with GitHub Actions Inactive
mihir-datazip and others added 30 commits August 28, 2026 12:19
@mihir-datazip
chore: temp - skip the ghcr image restore to measure the worst case
d62e69b
@mihir-datazip
chore: single machine for single compatibility check
cfc9d93
@mihir-datazip
chore: cache driver docker images
2c42541
@mihir-datazip
chore: artifacts for candidate docker image
bee8d8d
@mihir-datazip
chore: temp
3f858c4
@Kaileshwar16 @vikaxsh
chore(ci): add composite actions to dependabot scans (#1141)
3df2fd2 
Co-authored-by: vikash choudhary <vikash@datazip.io>
@mihir-datazip
chore: single docker image export job
c4035ec
@mihir-datazip
chore: parallel image restore
f218515
@mihir-datazip
Merge branch 'staging' into backward-compatibility-tests
60d8e60
@mihir-datazip
chore: minor changes
e6447b1
@dependabot @vikaxsh
chore(deps): bump version.grpc from 1.69.0 to 1.83.1 in /destination/…
34efc9f 
…iceberg/olake-iceberg-java-writer (#1092)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump actions/setup-java from 3 to 5 (#1146)
f40d829 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump org.postgresql:postgresql from 42.7.7 to 42.7.13 in…
7b9960d 
… /destination/iceberg/olake-iceberg-java-writer (#1147)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump DerJuulsn/todo-issue from 1.1.4 to 2.0.0 (#1148)
d3cd2de 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump version.jackson from 2.22.1 to 2.22.2 in /destinati…
88a9f4c 
…on/iceberg/olake-iceberg-java-writer (#1150)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump aws-actions/configure-aws-credentials from 4 to 6 (#…
14b2ee1 
…1152)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@mihir-datazip
chore: merge staging into backward-compatibility-tests
269611b 
Keeps the workflow consolidation (integration-tests.yml and performance-test.yml
were replaced by tests.yml + test-preflight.yml) and carries staging's dependabot
bumps into the files that inherited those action calls:
  actions/setup-java v3/v4 -> v5
  aws-actions/configure-aws-credentials v4 -> v6
@hash-data
feat: introducing pos deletes in olake (interoperabilty v0) (#1064)
2967a8e
@dependabot @vikaxsh
chore(deps): bump software.amazon.awssdk:bom from 2.51.3 to 2.54.2 in…
69a98e2 
… /destination/iceberg/olake-iceberg-java-writer (#1151)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump actions/github-script from 6 to 9 (#1153)
5c37b8e 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps-dev): bump org.apache.maven.plugins:maven-failsafe-plugin …
def1b56 
…from 3.5.2 to 3.5.6 in /destination/iceberg/olake-iceberg-java-writer (#1156)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@dependabot @vikaxsh
chore(deps): bump org.apache.httpcomponents.client5:httpclient5 from …
84abb3e 
…5.6.3 to 5.6.4 in /destination/iceberg/olake-iceberg-java-writer (#1157)

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: vikash choudhary <vikash@datazip.io>
@mihir-datazip
chore: tests UTs
cdf3f0f
@mihir-datazip
Merge branch 'staging' into backward-compatibility-tests
cbc7ea3
@mihir-datazip
chore: minor changes
d3843ef
@mihir-datazip
fix: postgres issue
24b8b12
@mihir-datazip
chore: rename func
44be097
@mihir-datazip
chore(tests): run driver containers as the invoking user in a fixed n…
c7b4571 
…on-UTC zone

--user: TestWorkingDir is a t.TempDir() bind-mounted into the container, and the
image declares no USER. On a Linux bind mount everything the driver writes there
belongs to root. A root-owned file is still removable, but a root-owned directory
is not, and pkg/indexdb creates one (olake-table-index). Go's own t.TempDir
cleanup then fails with permission denied and, reporting through t.Errorf, fails
a test whose sync had already passed.

TZ: several state-version gates only change behavior when the machine timezone is
not UTC. In a UTC container the old and new branches produce identical output, so
the compatibility suite could not tell a working gate from a removed one.

Also drops the temporary pg_class diagnostic added while chasing the concurrent
CREATE TABLE failure.
@mihir-datazip
revert(tests): drop the non-UTC container timezone
e043b3a 
TZ=Asia/Kolkata broke the compatibility sweep in CI: the reference and upgrade
runs diverge by exactly 19800000000us (5h30m, the IST offset) on db2 col_date /
col_timestamp at state version 1 and on mysql created_timestamp at state
version 0, with no fault applied.

That divergence is worth investigating on its own -- it suggests those two gates
do not keep an old state file consistent outside UTC -- but it must not run in CI
while it does. Keeps the --user fix, which is unrelated.
@mihir-datazip
chore: temp - enable the full test matrix on temp-pf
3d9b5ba 
Scratch-branch commit on top of backward-compatibility-tests. Never merged; drop
it when rebasing.

  - push to temp-pf triggers the workflow (it otherwise runs only on master/staging)
  - test-backward-compatibility gated exactly like integration-tests: no if:, and an
    environment expression that self-disables outside a pull request
  - performance-tests matrix populated on a push to temp-pf (was: staging only)
  - approval environments dropped from compatibility-sweep and performance-tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

do not review

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mihir-datazip @Kaileshwar16 @hash-data