Data Quality

Three Severity Levels, Not Pass/Fail — and Why Severity Decides Where the Rule Lives

by

At some point, someone switches the check off. What usually happened before is always the same story: a missing country code stopped the entire load at three in the morning, the business side was left without numbers, and the cause was a triviality. Binary pass/fail only lets you choose whether a rule blocks everything or … Read more

Checking Data Quality with SQL — a Configurable Framework for Spotting Bad Data Generically

by

Bad data gives no warning. An age of 200 years, a duplicate customer number, a country code that doesn’t exist — in the source system nobody notices. Only when the ETL run tries to push the rows into the strictly modelled target layer does the load break: on a CHECK, on a UNIQUE index, on a foreign key. Checking … Read more