feat(ticdc): prevent using the same TiDB cluster as both upstream and downstream#3956
Conversation
Summary of ChangesHello @wlwilliamx, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed! This pull request enhances TiCDC's robustness by implementing a critical safeguard against self-replication. It ensures that a TiDB cluster cannot serve as both the data source and the replication target for a changefeed, thereby preventing potential data inconsistencies and operational issues. The change integrates a new cluster identification and comparison logic into the changefeed lifecycle management, providing immediate feedback and preventing misconfigurations. Highlights
🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console. Using Gemini Code AssistThe full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips. Invoking Gemini You can request assistance from Gemini at any point by creating a comment using either
Customization To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a Limitations & Feedback Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here. You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension. Footnotes
|
There was a problem hiding this comment.
Code Review
This pull request introduces a valuable feature to prevent a changefeed from using the same TiDB cluster as both upstream and downstream, which could lead to replication loops. The implementation correctly adds checks at changefeed creation, update, and resume. The core logic for comparing cluster IDs is well-encapsulated in the new pkg/check package and is accompanied by good unit and integration tests.
My main feedback is regarding code duplication in api/v2/changefeed.go, where the check logic is repeated in three different API handlers. Refactoring this into a shared helper function would improve maintainability. I've also included a couple of minor suggestions for improving code clarity and error handling in pkg/check/cluster.go.
Overall, this is a solid contribution that enhances the robustness of TiCDC.
|
CC @tenfyzhong |
|
CC @asddongmen |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: tenfyzhong, wk989898 The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
[LGTM Timeline notifier]Timeline:
|
…-upstream-downstream
|
/test all |
What problem does this PR solve?
TiCDC does not support using the same TiDB logical cluster as both the upstream and downstream, because it can easily lead to self-replication loops or unexpected data behaviors.
In TiDB Next-Gen, a physical cluster can contain multiple logical clusters (keyspaces). Different keyspaces should be treated as different clusters from TiCDC's perspective. So this PR keeps rejecting same upstream/downstream for the same keyspace, while allowing cross-keyspace replication within the same physical cluster.
Issue Number: close #3949
What is changed and how it works?
mysql.tidb(cluster_id).cluster_idare the same, query the downstream keyspace via:show config where type = 'tidb' and name = 'keyspace-name'(cluster_id, keyspace)as the cluster identity, so cross-keyspace is allowed but same keyspace is rejected.same_upstream_downstream.Check List
Tests
Questions
Will it cause performance regression or break compatibility?
Do you need to update user documentation, design documentation or monitoring documentation?
N/A
Release note