Skip to content
This repository was archived by the owner on Jul 24, 2024. It is now read-only.

log_restore: refactor write and ingest logic. (#645)#729

Open
ti-srebot wants to merge 12 commits into
pingcap:release-4.0from
ti-srebot:release-4.0-d87292ca02cb
Open

log_restore: refactor write and ingest logic. (#645)#729
ti-srebot wants to merge 12 commits into
pingcap:release-4.0from
ti-srebot:release-4.0-d87292ca02cb

Conversation

@ti-srebot
Copy link
Copy Markdown
Contributor

@ti-srebot ti-srebot commented Jan 31, 2021

cherry-pick #645 to release-4.0
You can switch your code base to this Pull Request by using git-extras:

# In br repo:
git pr https://github.com/pingcap/br/pull/729

After apply modifications, you can push your change to this PR via:

git push git@github.com:ti-srebot/br.git pr/729:release-4.0-d87292ca02cb

What problem does this PR solve?

Both Lightning and BR have a similar logic. write and ingest kv as well as retry policy. This abstract Ingest method for BR and Lightning easy to use.

What is changed and how it works?

  1. Refactor write and ingest code from log_client to Ingestser.

Check List

Tests

  • No code

Related changes

  • Need to cherry-pick to the release branch

Release Note

  • No release note.

Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@kennytm
Copy link
Copy Markdown
Collaborator

kennytm commented Feb 4, 2021

/lgtm

@ti-srebot ti-srebot added the status/LGT1 LGTM1 label Feb 4, 2021
@3pointer
Copy link
Copy Markdown
Collaborator

3pointer commented Mar 3, 2021

/rebuild

Comment thread tests/config/tikv.toml
Comment on lines +19 to +20
[cdc]
hibernate-regions-compatible=false
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wrong config for release-4.0

@glorv
Copy link
Copy Markdown
Collaborator

glorv commented Mar 10, 2021

/run-all-tests

run_sql "DROP DATABASE ${DB}_DDL2"

# restore full
export GO_FAILPOINTS='github.com/pingcap/tidb-lightning/lightning/backend/local/FailIngestMeta=return("notleader")'
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
export GO_FAILPOINTS='github.com/pingcap/tidb-lightning/lightning/backend/local/FailIngestMeta=return("notleader")'
export GO_FAILPOINTS='github.com/pingcap/br/pkg/lightning/backend/FailIngestMeta=return("notleader")'

echo "TEST: [$TEST_NAME] fail on ts range test."
fi

export GO_FAILPOINTS='github.com/pingcap/tidb-lightning/lightning/backend/local/FailIngestMeta=return("epochnotmatch")'
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ditto

@ti-chi-bot
Copy link
Copy Markdown
Member

@ti-srebot: PR needs rebase.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@glorv
Copy link
Copy Markdown
Collaborator

glorv commented Jul 21, 2021

@3pointer Do we still need to cherry-pick this PR to release-4.0?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants