Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add index failed with error “Error 1105 (HY000): PD invalid response” when kill pdleader #48206

Open
Lily2025 opened this issue Nov 2, 2023 · 3 comments
Assignees
Labels
affects-7.6 affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/ddl This issue is related to DDL of TiDB. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 severity/major type/bug The issue is confirmed as a bug.

Comments

@Lily2025
Copy link

Lily2025 commented Nov 2, 2023

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

tidb_enable_dist_task='on'
1、run workload
2、add index for one table
3、kill pdleader

case config:
workloads:
- type: sysbench
storage: s3://benchmark/sysbench_64_7000w
db: sysbench_64_7000w
tableNum: 64
tableSize: 70000000
threads: 64
subType: oltp_read_write
ignoreErrors: "all"
cases:
- name: "ha_pdleader_kill"
warmUpTime: 1m
faultType: kill
selector: "pd(leader)"
period: "@every 5m"
faultDuration: 1m
faultTotalRunTime: 30m
ddl:
addIndex:
- db: "sysbench_64_7000w"
table: "sbtest1"
timeout: 60m
times: 5
index_col_name: "c"
job_type: "ingest"
admin_check: true
count_check: false

2. What did you expect to see? (Required)

add index can success

3. What did you see instead (Required)

add index failed with error “Error 1105 (HY000): PD invalid response” when kill pdleader

add index failed at 2023-11-01 16:13:49 (Error 1105 (HY000): PD invalid response)
operatorLogs:
[2023-11-01 16:11:36] ###### start adding index
alter table sbtest1 add index index_test_1698826296315 (c)
[2023-11-01 16:11:36] ###### wait for ddl job finish

4. What is your TiDB version? (Required)

git hash:5f7b6973b0d730b446d840733f213ad6637bee1f

@Lily2025 Lily2025 added the type/bug The issue is confirmed as a bug. label Nov 2, 2023
@Lily2025
Copy link
Author

Lily2025 commented Nov 2, 2023

/assign ywqzzy

@Lily2025 Lily2025 changed the title add index failed with error “Error 1105 (HY000): PD invalid response” when inject pdleader io delay 500ms last for 2m add index failed with error “Error 1105 (HY000): PD invalid response” when inject pdleader io delay 500ms last for 2m or kill pdleader Nov 2, 2023
@jebter jebter added severity/major component/ddl This issue is related to DDL of TiDB. labels Nov 2, 2023
@ti-chi-bot ti-chi-bot bot added may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 labels Nov 2, 2023
@Lily2025 Lily2025 changed the title add index failed with error “Error 1105 (HY000): PD invalid response” when inject pdleader io delay 500ms last for 2m or kill pdleader add index failed with error “Error 1105 (HY000): PD invalid response” when kill pdleader Nov 8, 2023
@ywqzzy
Copy link
Contributor

ywqzzy commented Nov 13, 2023

tikv/pd#7251

@Lily2025
Copy link
Author

tikv/pd#7251

maybe is not the same issue because pd can elect leader when kill leader

@ti-chi-bot ti-chi-bot added the affects-8.1 This bug affects the 8.1.x(LTS) versions. label Apr 9, 2024
@ti-chi-bot ti-chi-bot added the affects-8.5 This bug affects the 8.5.x(LTS) versions. label Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-7.6 affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. component/ddl This issue is related to DDL of TiDB. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 severity/major type/bug The issue is confirmed as a bug.
Projects
None yet
Development

No branches or pull requests

4 participants