changefeed lag more than 120s when injection some pd fault

[Lily2025]

What did you do?

1、create changefeed
2、run sysbench
3、lag may be more than 120s when inject pd fault，such as “network partition between pd leader and followers” , "pd leader io delay or hang"

What did you expect to see?

lag less than 120s when inject pd fault: “network partition between pd leader and followers” or "pd leader io delay or hang"

What did you see instead?

changefeed lag more than 120s when injection “network partition between pd leader and followers” or "pd leader io delay or hang"
network partition between pd leader and followers:

pd leader io hang:

pd leader io delay:

Versions of the cluster

./cdc version
Release Version: v8.2.0-alpha
Git Commit Hash: 4d89c24
Git Branch: heads/refs/tags/v8.2.0-alpha
UTC Build Time: 2024-05-21 11:40:40
Go Version: go version go1.21.10 linux/amd64
Failpoint Build: false
2024-05-22T05:44:18.288+0800

[Lily2025]

/remove-area dm
/area ticdc

[Lily2025]

/remove-type bug
/type enhancement

[flowbehappy]

Check here for the root cause: tikv/pd#8204 (comment)