You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I believe there is an edge case in the initial snapshot process for Postgres LOG_BASED replication.
This can only occur when snapshotting from a 'replica' and when the replication slot did not previously exist.
Under the above conditions it is possible for the following to occur:
a replication slot is created on the primary database
the most recent LSN of present on the replica is used as the starting point for logical replication
this LSN is actually before the replication slot was created / became consistent due to replication lag between the primary and replica
the replica is snapshotted but has missing data that will never be available to the replication slot
I believe this can be solved by #929. This approach is inspired heavily by how Debezium does its initial snapshotting with the addition of waiting for the replica to catch up enough with the primary if needed.
To Reproduce
Steps to reproduce the behavior:
Difficult
Expected behavior
I expect all rows in the source database to be present in the destination database.
Screenshots
If applicable, add screenshots to help explain your problem.
Your environment
Version of PipelineWise, e.g branch/commit #/release/tag
Source type and setup
Target type and setup
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered:
Describe the bug
I believe there is an edge case in the initial snapshot process for Postgres LOG_BASED replication.
This can only occur when snapshotting from a 'replica' and when the replication slot did not previously exist.
Under the above conditions it is possible for the following to occur:
I believe this can be solved by #929. This approach is inspired heavily by how Debezium does its initial snapshotting with the addition of waiting for the replica to catch up enough with the primary if needed.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
I expect all rows in the source database to be present in the destination database.
Screenshots
If applicable, add screenshots to help explain your problem.
Your environment
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: