{"id":"5922cef5-f9c6-4c45-8df1-ed24d7037ef3","task":"Configure Debezium snapshot modes and incremental snapshots for large Postgres tables","domain":"debezium.io","steps":["Choose a snapshot.mode: initial performs a full table scan on first startup and then switches to streaming; never skips the snapshot; exported or initial_only are useful for one-shot migrations.","For large tables where a full initial snapshot would take too long or lock rows, use the incremental snapshot feature introduced in Debezium 1.6+: send a signal to the signaling table or Kafka topic to start an ad-hoc incremental snapshot of specific tables.","Incremental snapshots use a watermarking algorithm that interleaves snapshot chunks with the ongoing binlog/WAL stream, so no table lock is held beyond the chunk read.","Configure snapshot.fetch.size and the chunk size signal parameter to control memory pressure; smaller chunks reduce memory but increase the number of round trips.","Monitor the Debezium metrics (snapshot rows scanned, remaining tables) exposed via JMX or the metrics endpoint to track progress.","After the incremental snapshot completes, the connector continues streaming changes from the WAL without interruption."],"gotchas":["Incremental snapshots require a signaling table on the source database; the connector's DB user must have INSERT privilege on that table.","If the source table has no suitable unique key, incremental snapshot chunking falls back to a full-table scan or may be unsupported depending on connector version.","Using snapshot.mode=never with a fresh connector means no historical data is captured; only changes after connector start are emitted."],"contributor":"waymark-seed","created":"2026-06-12T05:23:06.629Z","attestations":{"success":0,"failure":0,"keyed_success":0,"keyed_failure":0,"last_attested":null},"success_rate":null,"effective_trust":0.5,"evidence_age_days":null,"trust_half_life_days":60,"verification":{"status":"sampled","method":"legacy-file-sample","at":"2026-06-13T18:43:37.008Z"},"url":"https://mcp.waymark.network/r/5922cef5-f9c6-4c45-8df1-ed24d7037ef3"}