Skip to content

[FLINK-39383][Docs] Improve scan.incremental.snapshot.chunk.key-column documentation for MySQL/PostgreSQL/Oracle/DB2/SQLServer connectors#4405

Open
ThorneANN wants to merge 3 commits into
apache:masterfrom
ThorneANN:fix/chunk-key-column-docs
Open

[FLINK-39383][Docs] Improve scan.incremental.snapshot.chunk.key-column documentation for MySQL/PostgreSQL/Oracle/DB2/SQLServer connectors#4405
ThorneANN wants to merge 3 commits into
apache:masterfrom
ThorneANN:fix/chunk-key-column-docs

Conversation

@ThorneANN
Copy link
Copy Markdown
Contributor

The scan.incremental.snapshot.chunk.key-column option had several gaps
and inaccuracies in its documentation across multiple connectors:

  1. NOT NULL / no-primary-key constraint was undocumented.
    The option is required when a captured table has no primary key and the chosen column must be NOT NULL. None of the connector docs mentioned this.

  2. Multi-table format was undocumented (MySQL).
    The MySQL connector supports <table-pattern>:<column>[;...] for assigning different chunk key columns to different tables. This was not documented in either the flink-source or pipeline connector docs.

  3. Option was entirely missing from PostgreSQL pipeline connector docs.

  4. Stale option description wording across all connectors.

ThorneANN added 3 commits May 20, 2026 17:45
…entation

- Document NOT NULL requirement for tables without a primary key across
  all connectors (MySQL, PostgreSQL, Oracle, DB2, SQLServer flink-sources)
- Document multi-table format (<table-pattern>:<column>[;...]) for the
  MySQL pipeline connector and MySQL flink-source connector
- Add missing scan.incremental.snapshot.chunk.key-column option to MySQL
  and PostgreSQL pipeline connector docs (both EN and ZH)
- Add missing Warning link in DB2 flink-source option table entry
- Refresh stale option description wording across all five connectors
scan.snapshot.fetch.size <tr> tag was missing after inserting the
chunk.key-column row in both EN and ZH postgres pipeline connector docs.
- Remove pipeline connector multi-table format description from flink-source
  mysql-cdc.md (EN+ZH): the <table-pattern>:<column> format is only
  supported by the pipeline connector, not the flink-source connector
- Fix sentence order in oracle-cdc.md (EN+ZH): put the no-primary-key
  requirement before the non-PK performance note for logical consistency
@github-actions github-actions Bot added the docs Improvements or additions to documentation label May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant