Skip to content

feat(vectordb): add openGauss DataVec adapter with standalone and dis… - #4045

Open
LinQiang391 wants to merge 1 commit into
volcengine:mainfrom
LinQiang391:feat/opengauss-vectordb-adapter
Open

feat(vectordb): add openGauss DataVec adapter with standalone and dis…#4045
LinQiang391 wants to merge 1 commit into
volcengine:mainfrom
LinQiang391:feat/opengauss-vectordb-adapter

Conversation

@LinQiang391

Copy link
Copy Markdown
Collaborator

…tributed support

Add an opengauss VectorDB backend following the adapter integration guide:

  • map eight logical ANN index types (hnsw/ivfflat/diskann plus PQ and RabitQ variants) to DataVec access methods with validated build_params and search_params, applied via transaction-local GUCs
  • verify physical indexes through pg_indexes before persisting metadata; training-type indexes materialize once data exists (bulk-ingest aware) and never silently degrade to sequential scans
  • support spq distributed clusters: hash-distributed collection and metadata tables, startup environment validation, and SET LOCAL spq.propagate_set_commands='local' so search parameters reach DN shard scans (spq defaults to none)
  • pool connections with per-thread checkout and rollback-safe error paths
  • ship an opengauss extra (psycopg2-binary), bilingual guides, and unit plus DSN-gated integration tests

Description

Human Involvement

  • A human participated in the implementation or review loop
  • This PR was generated entirely by AI agents without human participation in the loop

Related Issue

Type of Change

  • Bug fix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update
  • Refactoring (no functional changes)
  • Performance improvement
  • Test update

Changes Made

Testing

  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have tested this on the following platforms:
    • Linux
    • macOS
    • Windows

Checklist

  • My code follows the project's coding style
  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • Any dependent changes have been merged and published

Screenshots (if applicable)

Additional Notes

@LinQiang391
LinQiang391 force-pushed the feat/opengauss-vectordb-adapter branch 10 times, most recently from e4a4433 to 8308f13 Compare August 19, 2026 03:06
@LinQiang391
LinQiang391 force-pushed the feat/opengauss-vectordb-adapter branch from 8308f13 to aaeb1f8 Compare August 19, 2026 03:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

1 participant