Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

changefeed task status failed after inject one of tikv io hang even if fault recovery #9650

Closed
Lily2025 opened this issue Aug 28, 2023 · 4 comments
Closed

changefeed task status failed after inject one of tikv io hang even if fault recovery #9650

Lily2025 opened this issue Aug 28, 2023 · 4 comments
Assignees
@asddongmen
Labels
area/ticdc Issues or PRs related to TiCDC. may-affects-5.3 may-affects-5.4 may-affects-6.1 may-affects-6.5 may-affects-7.1 severity/major type/bug The issue is confirmed as a bug.

Comments

@Lily2025
Copy link

What did you do?

1、run tpcc with 1000 warehouse and 10 thread
2、inject one of tikv io hang last for 40min

What did you expect to see?

changefeed task stauts should be normal

What did you see instead?

changefeed task status failed after inject one of tikv io hang
the target status of TiCDC changfeed ticdc-task is normal, but the current status is failed

image

Versions of the cluster

git hash：c903b8723c245b0e3640c3fb09a8845f62c6e713

current status of DM cluster (execute query-status <task-name> in dmctl)

(paste current status of DM cluster here)
@Lily2025 Lily2025 added area/dm Issues or PRs related to DM. type/bug The issue is confirmed as a bug. labels Aug 28, 2023
@Lily2025
Copy link
Author

/remove-area dm
/area ticdc

@ti-chi-bot ti-chi-bot bot added area/ticdc Issues or PRs related to TiCDC. and removed area/dm Issues or PRs related to DM. labels Aug 28, 2023
@Lily2025
Copy link
Author

/severity major

@Lily2025
Copy link
Author

/assign asddongmen

@ti-chi-bot ti-chi-bot added the affects-7.5 This bug affects the 7.5.x(LTS) versions. label Oct 23, 2023
@asddongmen asddongmen mentioned this issue Oct 31, 2023
Merged
@asddongmen asddongmen removed the affects-7.5 This bug affects the 7.5.x(LTS) versions. label Oct 31, 2023
@asddongmen
Copy link
Contributor

fix by #9893

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@asddongmen asddongmen

Labels
area/ticdc Issues or PRs related to TiCDC. may-affects-5.3 may-affects-5.4 may-affects-6.1 may-affects-6.5 may-affects-7.1 severity/major type/bug The issue is confirmed as a bug.
Projects
Question and Bug Reports
Status: Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@asddongmen @ti-chi-bot @Lily2025