Data Quality: Rows Affected Checks
A new guardrail verifies the number of rows affected by each database operation, such as inserted, updated, or deleted rows in merges.
To further enhance the data integrity built into our pipeline, we've added another guardrail: verifying the number of rows affected during each database operation.
For example, during merge steps (such as in Snowflake), we confirm ROWS_LOADED from copy commands and validate the totals for inserted, updated, or deleted rows. This approach reinforces the robustness of our data replication process and it's another way we catch issues early and ensure replication integrity.