From Where Will the Data Quality Machine-Learning Disruption Come?

The 2020 Gartner Magic Quadrant for Data Quality Solutions is out.

In here Gartner assumes that: “By 2022, 60% of organizations will leverage machine-learning-enabled data quality technology for suggestions to reduce manual tasks for data quality improvement”.

The data quality tool vendor rankings according to Gartner looks pretty much as last year. Precisely is the brand that last year was in there as Syncsort and Pitney Bowes.

Gartner DQ MQ 2020

Bigger picture here.

You can get a free reprint of the report from Talend or Informatica.

The question is if we are going to see the machine-learning based solutions coming from the crowd of vendors in a bit stalled quadrant or the disruption will come from new solution providers. You can find some of the upcoming machine-learning / Artificial Intelligence (AI) based vendors on The Disruptive MDM / PIM DQM List.

Congrats to Datactics for Having the Happiest DQM Customers

The latest Information Difference Data Quality Landscape is out. The Data Quality Management (DQM) market is, based on the changes seen from last year, a stable market with little movement.

Information Difference DQ Landscape 2019 and 2020

Atacama and Active Prime have joined this year’s landscape and Pitney Bowes has left the market after the take over by Syncsort as reported in the post Syncsort Nabs Pitney Bowes Software Solutions.

The report also measures how happy the end customers are with the vendors: “The happiest customers based on this survey were those of Datactics, followed by those of Syncsort and Active Prime, closely followed by those of Innovative Systems and Melissa Data, then Experian. Congratulations to those vendors.”

Also, this time it strikes again that the mega vendors (IBM, SAP, Informatica) are not in this crowd.

Check out The Information Difference Data Quality Landscape Q1 2020 here.

Get Your Free Bespoke MDM / PIM / DQM Solution Ranking

The Disruptive MDM / PIM / DQM List has an interactive service that can help you jumpstart in your tool selection for a Master Data Management (MDM), Product Information Management (PIM) and/or Data Quality Management (DQM) solution.

MDM PIM DQM Context, Scope and RequirementsThe selection model is based on the context, scope and requirements for your solution.

The context includes the geographical reach and the industry where your organization operates.

The scope includes the number of entities as for example consumers (B2C customers), companies (B2B customers, suppliers and other business partners), products and digital assets as well as the organizational reach.

The requirements are those that differentiate the MDM / PIM / DQM solutions on the market.

MDM PIM DQM Vendor capabilitiesThe solution capabilities considered in the selection process are those of who are:

  • On this Disruptive MDM / PIM / DQM Solutions List or
  • Gartner MDM Magic Quadrant or
  • Forrester MDM Wave or Forrester PIM Wave or
  • Information Difference MDM Landscape

MDM PIM DQM AI EngineThese two sets of information are compared in a continuously supervised learning algorithm – also known in marketing as machine learning and artificial intelligence (AI).

Filling in the information usually takes less than 15 minutes. You will get your solution list within 1 to 48 hours.

MDM PIM DQM Ranking OutcomeThe outcome is:

  • The best fit solution for a Proof of Concept
  • Two more solutions to be in a shortlist
  • Four more solutions to be in a longlist
  • If fit, a couple of more solutions to be considered as alternatives or supplements

During the half year this service has been online, more than 100 end user organizations or their consultants have received their solution list.

This service is free. No information is shared with anyone unless requested. Are you ready? Start with step 1 here.

MDM / PIM / DQM Resources

Last week The Resource List went live on The Disruptive MDM / PIM / DQM List.

The rationale behind the scaling up of this site is explained in the article Preaching Beyond the Choir in the MDM / PIM / DQM Space.

These months are in general a yearly peak for conferences, written content and webinars from solution and service providers in the Master Data Management (MDM), Product Information Management (PIM) and Data Quality Management (DQM) space. With the covid-19 crises conferences are postponed and therefore the content providers are now ramping up the online channel.

As one who would like to read, listen to and/or watch relevant content, it is hard to follow the stream of content being pushed from the individual providers every day.

The Resource List on this site is a compilation of white papers, ebooks, reports, podcasts, webinars and other content from potentially all the registered tool vendors and service providers on The Solution List and coming service list. The Resource List is divided into sections of topics. Here you can get a quick overview of the content available within the themes that matters to you right now.

The list of content and topics is growing.

Check out The Resource List here.

MDM PIM DQM resourcesPS: The next feature on the site is planned to be The Case Story List. Stay tuned.

Looking for the Right MDM / PIM / DQM Implementation Partner

The Disruptive MDM / PIM / DQM List has been running for a couple of years and is now a list of 15 of some of the most innovative and forward looking solutions on the Master Data Management (MDM), Product Information Management (PIM) and Data Quality Management (DQM) market.

The list can be seen as an online MDM / PIM / DQM conference:

The Online MDM PIM DQM Conference

In these times when offline MDM / PIM / DQM conferences are cancelled, I thought it might be useful to uncover if there is an interest among implementation partners in this space to join the list on an adjacent list on the site covering these services, as it besides choosing the right solution is equally important to choose the right implementation partner.

So, if you as an implementation partner are interested, you can register here.

Alternatively, give me a shout here:

10 MDMish TLAs You Should Know

TLA stands for Three Letter Acronym. The world is full of TLAs. The IT world is indeed full of TLAs. The Data Management world is also full of TLAs. Here are 10 TLAs from the data management space that surrounds Master Data Management:

Def MDM

MDM: Master Data Management can be defined as a comprehensive method of enabling an enterprise to link all of its critical data to a common point of reference. When properly done, MDM improves data quality, while streamlining data sharing across personnel and departments. In addition, MDM can facilitate computing in multiple system architectures, platforms and applications. You can find the source of this definition and 3 other – somewhat similar – definitions in the post 4 MDM Definitions: Which One is the Best?

The most addressed master data domains are parties encompassing customer, supplier and employee roles, things as products and assets as well as location.

Def PIM

PIM: Product Information Management is a discipline that overlaps MDM. In PIM you focus on product master data and a long tail of specific product information – often called attributes – that is needed for a given classification of products.

Furthermore, PIM deals with how products are related as for example accessories, replacements and spare parts as well as the cross-sell and up-sell opportunities there are between products.

PIM also handles how products have digital assets attached.

This data is used in omni-channel scenarios to ensure that the products you sell are presented with consistent, complete and accurate data. Learn more in the post Five Product Information Management Core Aspects.

Def DAM

DAM: Digital Asset Management is about handling extended features of digital assets often related to master data and especially product information. The digital assets can be photos of people and places, product images, line drawings, certificates, brochures, videos and much more.

Within DAM you are able to apply tags to digital assets, you can convert between the various file formats and you can keep track of the different format variants – like sizes – of a digital asset.

You can learn more about how these first 3 mentioned TLAs are connected in the post How MDM, PIM and DAM Stick Together.

Def DQM

DQM: Data Quality Management is dealing with assessing and improving the quality of data in order to make your business more competitive. It is about making data fit for the intended (multiple) purpose(s) of use which most often is best to achieved by real-world alignment. It is about people, processes and technology. When it comes to technology there are different implementations as told in the post DQM Tools In and Around MDM Tools.

The most used technologies in data quality management are data profiling, that measures what the data stored looks like, and data matching, that links data records that do not have the same values, but describes the same real world entity.

Def RDM

RDM: Reference Data Management encompass those typically smaller lists of data records that are referenced by master data and transaction data. These lists do not change often. They tend to be externally defined but can also be internally defined within each organization.

Examples of reference data are hierarchies of location references as countries, states/provinces and postal codes, different industry code systems and how they map and the many product classification systems to choose from.

Learn more in the post What is Reference Data Management (RDM)?

Def CDI

CDI: Customer Data Integration is considered as the predecessor to MDM, as the first MDMish solutions focused on federating customer master data handled in multiple applications across the IT landscape within an enterprise.

The most addressed sources with customer master data are CRM applications and ERP applications, however most enterprises have several of other applications where customer master data are captured.

You may ask: What Happened to CDI?

Def CDP

CDP: Customer Data Platform is an emerging kind of solution that provides a centralized registry of all data related to parties regarded as (prospective) customers at an enterprise.

In that way CDP goes far beyond customer master data by encompassing traditional transaction data related to customers and the emerging big data sources too.

Right now, we see such solutions coming both from MDM solution vendors and CRM vendors as reported in the post CDP: Is that part of CRM or MDM?

Def ADM

ADM: Application Data Management is about not just master data, but all critical data that is somehow shared between personel and departments. In that sense MDM covers all master within an organization and ADM covers all (critical) data in a given application and the intersection is looking at master data in a given application.

ADM is an emerging term and we still do not have a well-defined market – if there ever will be one – as examined in the post Who are the ADM Solution Providers?

Def PXM

PXM: Product eXperience Management is another emerging term that describes a trend to distance some PIM solutions from the MDM flavour and more towards digital experience / customer experience themes.

In PXM the focus is on personalization of product information, Search Engine Optimization and exploiting Artificial Intelligence (AI) in those quests.

Read more about it in the post What is PxM?

Def PDS

PDS: Product Data Syndication connects MDM, PIM (and other) solutions at each trading partner with each other within business ecosystems. As this is an area where we can expect future growth along with the digital transformation theme, you can get the details in the post What is Product Data Syndication (PDS)?

One example of a PDS service is the Product Data Lake solution I have been working with during the last couple of year. Learn why this PDS service is needed here.

When Can We Expect the Next Major MDM/PIM/DQM Market Report?

When selecting a solution for Master Data Management (MDM), Product Information Management (PIM) and Data Quality Management (DQM) buyers and their advisers are using the market reports from the acknowledged analyst firms operating in these markets.

The latest such ones are:

The publication schedule from the analyst firms can be unpredictable.

Information Difference is an exception. There have during the years every year been a Data Quality landscape named Q1 and published shortly after that quarter and an MDM landscape named Q2 and published shortly after that quarter. However, these reports are relying on participation from relevant vendors and not all vendors prioritize this scheme.

Forrester is quite unpredictable both with timing and which market segments (MDM, PIM, DQM) to be covered.

Gartner is a bit steadier. However, for example the MDM solution reports have been coming in varying intervals during the latest years. Let us see when the next ones are published and what news they bring.

MDM PIM DQM Solutions

PS: You can check out many of the included solutions on The Disruptive MDM / PIM / DQM List.

It Is Black Friday and Cyber Monday All the Time at the Disruptive MDM / PIM / DQM List

The upcoming Black Friday and Cyber Monday are synonymous with good deals.

At the Disruptive MDM / PIM / DQM List there are good deals all the days.

As a potential buyer on the look for a solution covering your Master Data Management (MDM), Product Information Management (PIM) and/or Data Quality Management (DQM) needs you can use the free service that based on your context, scope and requirement selects the best fit solution(s). You can start here.

Black Friday

As a solution provider you can against a very modest fee register your solution here.

Happy Black Friday and Cyber Monday.

MDM / PIM / DQM List September 2019 Achievements

September 2019 were in many ways a record month for the sister site – The Disruptive MDM / PIM / DQM List.

The number of visitors has doubled compared to last month and increased three times compared to last year’s average – and so have the page views.

Number of LinkedIn page followers has increased 27 % since last month.

The new Select your solution service has got a good debut with 16 requests for a tailored list of solutions fit for your context, scope and requirements.

A new solution has entered the list: Check out Reifier here.

MDMlist stats 2019 09

Thanks to all visitors, followers, solution selectors and registrants.

Data Quality Tool Market Musings

There is a market for data quality tools and most of the tools on this market have been operating since before year 2k either still by an independent data quality tool provider or now as part of a data management suite.

The prominent market reports telling about the market with generic ranking of the solutions are from Gartner and Information Difference (and earlier on from Forrester, who though have not published a report on data quality tools for years now).

The latest Gartner report from March 2019 was examined in the post Data Quality Tools are Vital for Digital Transformation. Information Difference has their report available here: The Data Quality Landscape – Q1 2019.

As told in the post DQM Tools In and Around MDM Tools there are three main ways of providing Data Quality Management (DQM) capabilities: As an independent data quality tool, as part of a data management suite or inside an MDM platform. The data quality tool market reports encompasses the first two of three options (while the MDM solution market reports encompasses the latter two of three).

DQ Tool Market

The data quality tools represented in the above-mentioned DQ markets reports are:

  • Informatica, who acquired the veteran DQ service SSA-Name3, Similarity Systems and other DQ services, now part of the Informatica data management suite
  • Experian, who acquired among others veteran DQ service QAS and also offers other solutions mainly related to credit check and fraud prevention
  • Syncsort, who acquired veteran DQ service Trillium, recently also Pitney Bowes and also have some other data management services
  • IBM, who acquired DQ services as Ascential now being part of a data management suite with several overlapping services
  • SAP, who bought several DQ services now being part of the huge ERP/data management suite
  • SAS Institute, who acquired Dataflux that now is part of the BI focused suite
  • Talend, as part of a data management suite
  • Oracle, who acquired veteran DQ service Datanomic and other DQ services now being part of the ERP/data management suite
  • Information Builders, as part of a data management and BI suite
  • Ataccama, together with MDM services
  • Melissa, a veteran company in DQ
  • Uniserv, a veteran company in DQ
  • Innovative, a veteran company in DQ
  • Datactics, a veteran company in DQ
  • MIQsoft
  • RedPoint Global
  • BackOffice Associates, as part of a data governance focused solution

However, there are a lot of other data quality tools on the market.

PS: If you represent a vendor providing DQM capabilities as an independent data quality tool, as part of a data management suite or inside an MDM / PIM solution, you are welcome to register your solution on The Disruptive MDM / DQM List here.