History of Data Quality

When did the first data quality issue occur? Wikipedia says in the data quality article section titled history that it began with the mainframe computer in the United States of America.

Fellow data quality blogger Steve Sarsfield made a blog post a few years ago called A Brief History of Data Quality where it is said “Believe it or not, the concept of data quality has been touted as important since the beginning of the relational database”.

However, a predominant sentiment in the data quality realm is that data quality is not about technology. It is about people. People are the sinners of data quality flaws and as the main part of the problem people should also be the overwhelming part, if not the only part, of the solution.

So I guess data quality challenges were introduced when people showed up in the real world. How and when that happened is a matter of discussion as discussed in the blog post Out of Africa.

As explained in the post Movable Types the invention of movable types in printing some hundreds of years ago (the most important invention since someone invented the wheel for the first time) made a big boost in knowledge sharing among people – and also a big boost in data and information quality issues.

But I think the saying “To err is human, but to really foul things up you need a computer” is valid. Consequently I also think you may need a computer to help with cleaning up the mess and to prevent the mess from happening again. End of (hi)story.    

Bookmark and Share

4 thoughts on “History of Data Quality

  1. Tirthankar Ghosh 22nd June 2011 / 11:34

    Issues around Data Quality, it seems, originated in ancient times when we started to gather piles data to come to some sort of conclusion.
    I wonder how troublesome it was for Kepler to come out with the laws of planetary motion by analyzing tons of observational data.

    • Henrik Liliendahl Sørensen 22nd June 2011 / 12:45

      You are right Tirthankar, it is amazing what could be done without a computer in old times (and what sometimes can’t be done with a computer today).

  2. Steve Sarsfield 22nd June 2011 / 15:29

    Thanks for mentioning my post, Henrik. The worst part is that today we have so much MORE opportunity for folly when it comes to introducing DQ issues. We are moving, sharing, warehousing and aggregrating data much more these days. There are opportunities for us to mess up everywhere!

    • Henrik Liliendahl Sørensen 22nd June 2011 / 15:57

      Indeed Steve, it’s a bit like in the old times before writing became a household habit. Stories were passed orally from man to man until the original content was totally different.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s