Data Quality Tools are Vital for Digital Transformation

The Gartner Magic Quadrant for Data Quality Tools 2019 is out. It will take you 43 minutes to read through, so let me provide a short overview.

Gartner says that “data quality tools are vital for digital business transformation, especially now that many have emerging features like automation, machine learning, business-centric workflows and cloud deployment models.”

The data quality software tools market was at 1.61 billion USD in 2017 which was an increase of 11.6% compared to 2016.

Gartner sees that end-user demand is shifting toward having broader capabilities spanning data management and information governance. Therefore, the data quality tool market continues to interact closely with the markets for data integration tools and for Master Data Management (MDM) products.

Among the capabilities mentioned is multidomain support meaning capabilities covering all the specific data subject areas, such as customer, product, asset and location. Interestingly Gartner continues to focus on customer as the one of several party data domains out there. In my experience, there are the same data quality challenges with vendor and other business partner data as well as with employee data.

According to Gartner, data quality tool vendors are competing to address shifting market requirements by introducing an array of new technologies, such as machine learning, interactive visualization and predictive/prescriptive analytics, all of which they are embedding in data quality tools. They are, according to Gartner, also offering new pricing models, based on open source and subscriptions.

The vendors included in the quadrant are positioned as seen below:

Gartner DQ 2019

If you want a full copy of the report you can, against providing your personal data, get it from Information Builders here.

Several Sources of Truth about MDM / PIM Solutions

The previous post on this blog was about Forrester vs Gartner on MDM/PIM. This post was about who is recognized as a major Master Data Management (MDM) / Product Information Management (PIM) solution vendor by the analyst firm Forrester versus who is recognized as a major MDM solution provider by the analyst firm Gartner.

MDM Truths

Now, let us have a look into how the individual solution providers are ranked in either the same way or differently by these major analyst firms spiced with my humble take on where this will be going. In the cause of brevity, I will focus on vendors positioned by Forrester as an MDM /PIM leader or strong performer or by Gartner as an MDM leader, visionary or challenger.

Informatica is an MDM leader both with Forrester and Gartner. When it comes to PIM Forrester has Informatica a little behind the leaders and back in the days when Gartner had specific customer MDM and product MDM quadrants, Informatica did better in customer MDM versus product MDM. Informatica has strengthened their grip on customer MDM with the recent AllSight acquisition. Will be interesting to see what moves Informatica will take to catching up on the product MDM / PIM battle ground and thus consolidating their multidomain MDM leadership.

Orchestra Networks who was recently acquired by Tibco is a leader in the eyes of Gartner but a bit less prominent positioned as a strong performer in the eyes of Forrester. The question asked on the market is if Tibco, against how earlier acquisitions turned out, will be able uphold Orchestra’s position as examined in the post Tibco, Orchestra and Netrics.

Reltio is a leader in the Forrester wave but still a niche player in the Gartner quadrant. This may say more about Forrester versus Gartner than about Reltio. Forrester seems to focus more on where the market is going while Gartner emphasizes on where the market has gone.

Riversand is a strong MDM and PIM performer at Forrester and a visionary in the Gartner quadrant. Perhaps Gartner sees a bit more on the vision side and Forrester a bit more on the offering side, but all in all the two analyst firms seems to be in agreement about Riversand. I think Riversand is on a good track.

SAP is a strong performer in the Forrester wave and a strong challenger according to Gartner. A lot of SAP ECC clients have and will choose the SAP MDG offering based on IT landscape simplification considerations. The Forrester PIM wave has SAP trailing the other solutions, which corresponds with my impression, which is that the SAP Hybris offering is struggling with really being a PIM solution.

Semarchy just made a high jump into the Gartner MDM quadrant challenger zone and according to Forrester they have the strongest MDM strategy possible. No doubt about that Semarchy is going in the fast track.

Profisee just moved up from niche player to challenger in the latest Gartner MDM quadrant. However, they were not included in the Forrester MDM wave. In my eyes, Profisee belongs among the major MDM solution providers.

Stibo Sytems is a challenger in the Gartner MDM quadrant. Forrester has Stibo Systems as a PIM leader but less prominent as an MDM contender. Stibo Systems has been on the same track as Riversand going from being a PIM vendor to become a multidomain MDM vendor. Perhaps because they are self-funded, versus Riversand being funded from outside, their tracks seem different.

IBM hangs on as a challenger in the Gartner MDM quadrant. Forrester only have IBM as a contender both for MDM and PIM. Nevertheless, large companies, not at least in the financial sector, will continue to rely on IBM also when it comes to MDM.

EnterWorks is a PIM leader and also an MDM leader according to Forrester. According to Gartner they are still a niche player in MDM. Recently EnterWorks joined forces with WinShuttle as told in the post The Recent Coupling on the MDM Market. It is not unlikely, that the Forrester view and the Gartner view will be aligned in the future.

Pitney Bowes is a strong performer in the latest Forrester wave sliding a bit from being a leader two years ago. They are not included in the Gartner quadrant. Pitney Bowes need to promote themselves as an MDM vendor and come up with new stuff to remain a major player on the MDM market.

Magnitude Software, who’s MDM solution was formerly known as Kalido, has moved up from contender to be a strong performer in the Forrester Wave. They are not included in the Gartner quadrant. Will be exciting to see if Magnitude Software can reignite the momentum Kalido had back in the first MDM years. Agility Multichannel is a part of Magnitude Software and a strong PIM performer at Forrester – and in my eyes too.

Contentserv is a PIM leader on the Forrester wave. Contentserv is also an MDM niche player on the Gartner quadrant. inRiver and Salsify are strong PIM performers on the Forrester wave but not big enough (and perhaps not MDM focussed enough) to be on the Gartner MDM quadrant.

PS: You can learn more about many of solutions mentioned here – and some more – on The Disruptive Master Data Management Solutions List.

MDM Use Case Status

As reported in the post Counting MDM Licenses there is movement in the MDM landscape when it comes to the offerings for the various use cases we have been working with the last 15 years and those we will be working with in the future.

Borrowing from the Gartner lingo, we can sketch the MDM use case overview this way:

  • Party MDM, meaning handling master data about persons and companies interacting with your company. Their role may be as employee, partner, supplier/vendor and customer. With the customer role we can make a distinction between:
    • MDM of B2C (Business-to-Consumer) customer data, meaning handling master data about persons in their private roles as consumers, citizens, patients, students and more. This may also cover how persons are part of a household.
    • MDM of B2B (Business-to-Business) customer data, meaning handling master data about organizations with a customer role in your company. This may also cover the hierarchy these organizations form (typically company family trees) and the persons who are your contacts at these organizations.
  • Product MDM, meaning handling data about product models and their item variants as well as each instance of a product as an asset. This can be divided into:
    • MDM of buy-side product data covering the procurement and Supply Chain Management (SCM) view of products going into your company from suppliers.
    • MDM of sell-side product data covering the sales and marketing view of products being sold directly to customers or through partners.
  • Multidomain MDM being combining product and party master data possibly with other domains as locations, general ledger accounts and specific master data domains in your industry.
  • Multivector MDM being a special Gartner term meaning use case split into multiple domains (as mentioned above), multiple industries, operational/analytical usage scenarios, organizational structures and implementation styles (registry, consolidation, coexistence, centralized).
  • Multienterprise MDM being handling master data in collaboration with your business partners as told in this post about Multienterprise MDM.

In the latest Gartner MDM quadrant, the status of the use cases is:

  • Customer MDM and Product MDM continue to climb the Slope of Enlightenment toward the Plateau of Productivity in Gartner’s Hype Cycle for Information Governance and Master Data Management.
  • Multidomain MDM solutions are sliding toward the bottom of the Trough of Disillusionment, while Multivector MDM solutions continue their climb toward the Peak of Inflated Expectations in the Hype Cycle.
  • Multienterprise MDM is near the Peak of Inflated Expectations on the Hype Cycle as well as mentioned in the post MDM Hype Cycle, GDSN, Data Quality, Multienterprise MDM and Product Data Syndication. In the Gartner MDM quadrant 2018 multienterprise MDM was only mentioned as a strength at one of the included vendors – Enterworks.

Stay tuned on this blog for more news about Multienterprise MDM as how it looks like from standing on the peak.

mdm hype cycle
Based on Gartner sources

Counting MDM Licenses

The Gartner Magic Quadrant for Master Data Management (MDM) Solutions 2018 was published last month.

Some of the numbers in the market that were revealed in the report was the number and distribution of MDM licenses from the included vendors. These covered their top-three master data domains and estimated license counts as well as the number of customers managing multiple domains:

mdm licenses

One should of course be aware of the data quality issues related to comparing these numbers, as they in some degree are estimates based on different perceptions at the included vendors. So, let me just highlight these observations:

  • The overall number of MDM licenses and unique MDM customers (at the included vendors) is not high. Under 10,000 organizations world-wide is running such a solution. The potential new market out there for the salesforce at the MDM vendors is huge.
  • If you find an existing MDM solution user organization, they probably have a solution from SAP or Informatica – or maybe IBM. To be complete, Oracle has been dropped from the MDM quadrant, they practically do not promote their MDM solutions anymore, but there are still existing solutions operating out there.
  • The reign of Customer MDM is over. Product MDM is selling and multidomain is becoming the norm. Several MDM vendors are making their way into the quadrant from a Product Information Management (PIM) base as reported in the post The Road from PIM to Multidomain MDM.

PS: If you, as an end customer organization or a MDM and PIM vendor, want to work with me on the consequences for MDM solutions, here are some Popular Offerings for you.

The Road from PIM to Multidomain MDM

The previous post on this blog was about the recent Gartner Magic Quadrant for Master Data Management Solutions. The post was called Who Will Make the Next Disruption on the MDM Market?

In a comment to this post Nadim observes that this Gartner quadrant is mixing up pure MDM players and PIM players.

That is true. It has always been a discussion point if one should combine or separate solutions for Master Data Management (MDM) and Product Information Management (PIM). This is a question to be asked by end user organizations and it is certainly a question the vendors on the market(s) ask themselves.

If we look at the vendors included in the 2018 Magic Quadrant the PIM part is represented in some different ways.

I would say that two of the newcomers, Viamedici and Contentserv (yellow dots in below figure), are mostly PIM players today. This is also mentioned as a caution by Gartner and is a reason for the current left-bottom’ish placement in the quadrant. But both companies want to be more multidomain MDM’ish.

PIM to MDM vendors

8 years ago, I was engaged at Stibo Systems as part of their first steps on the route from PIM to multidomain MDM. Enterworks and Riversand (the orange dots in above figure) is on the same road.

Informatica has taken a different path towards the same destination as they back in 2012 bought the PIM player Heiler. Gartner has some cautions about how well the MDM and PIM components makes up a whole in the Informatica offerings and similar cautions was expressed around the Forrester PIM Wave as seen in the comments to the post There is no PIM quadrant, but there is a PIM wave.

Who Will Make the Next Disruption on the MDM Market?

As reported in the previous post on this blog, there were some Movements in the Gartner MDM Magic Quadrant 2018.

But there was also a good deal of steadiness. Informatica still holds pole position in the race for going towards the top-right corner. Orchestra EBX, now disguised as Tibco EBX, is trailing them in the leaders quadrant. Old challengers as IBM, SAP and Stibo is watching them among the newcomers in the challengers quadrant and still as the only visionary – according to Gartner – we have Riversand.

In the niche players quadrant, we also still have Ataccama and Enterworks.

But there is still lot of free space in the top-right corner. There is still room for disruption. Gartner mentions some traditional forces still on the move being the good old 360 degree view on party data (customer, patient and the bit US biased provider) as well as Product Information Management (PIM) maybe in new wrappings as PCM or PXM.

Gartner still promotes this stuff as Application Data Management (ADM).

Else Gartner focuses on these tracks to disruption:

  • Subscription pricing – both for on-promise and cloud
  • The need for professional services – still a lot of money goes into that pit
  • Cloud based deployment – going up from 19% last year to 24 % this year among Gartner’s respondents
  • Machine Learning (ML) and Artificial Intelligence (AI)

Informatica is one of the vendors who – against your registration – offers a free copy of the 2018 Gartner MDM Quadrant.

If you like our personal data to be in the hands of Profisee, here is their free copy of the 2018 Gartner MDM Quadrant.

Another option is to get it from Riversand. Here is their free copy of the 2018 Gartner MDM Quadrant.

MDM 2018 Disruption

Movements in the Gartner MDM Magic Quadrant 2018

Finally, the Gartner Magic Quadrant for Master Data Management (MDM) Solutions 2018 has arrived.

This year there have been some interesting movements for the included vendors.

First of all, we have 4 new vendors: Viamedici, Contentserv, Reltio and not at least Semarchy, who have jumped into a top position in the challengers quadrant

Profisee has also advanced to the challengers quadrant.

Tibco is left-bottom cornered, but is of course saved by the recent acquisition of Orchestra, who is still a leader together with Informatica.

Oracle has effectively departed the market.

Stay tuned on this blog for more reflections on the Gartner MDM Magic Quadrant.

MDM MQ 2018

Tibco, Orchestra and Netrics

Today’s Master Data Management (MDM) news is that Tibco Software has bought Orchestra Networks. So, now the 11 vendors in last year’s Gartner Magic Quadrant for Master Data Management Solutions is down to 10.

If Gartner is still postponing this year’s MDM quadrant, they may even manage to reflect this change. We are of course also waiting to see if newcomers will make it to the quadrant and make the crowd of vendors in there go back to an above 10 number. Some of the candidates will be likes of Reltio and Semarchy.

Else, back to the takeover of Orchestra by Tibco, this is not the first time Tibco buys something in the MDM and Data Quality realm. Back in 2010 Tibco bought the data quality tool and data matching front runner Netrics as reported in the post What is a best-in-class match engine?

Then Tibco didn’t defend Netrics’ position in the Gartner Magic Quadrant for Data Quality Tools. The latest Data Quality Tool quadrant is also as the MDM quadrant from 2017 and was touched on this blog here.

So, will be exciting to see how Tibco will defend the joint Tibco MDM solution, which in 2017 was a sliding niche player at Gartner, and the Orchestra MDM solution, which in 2017 was a leader at the Gartner MDM quadrant.

Tibco Orchestra Netrics

MDM Hype Cycle, GDSN, Data Quality, Multienterprise MDM and Product Data Syndication

Gartner, the analyst firm, has a hype cycle for Information Governance and Master Data Management.

Back in 2012 there was a hype cycle for just Master Data Management. It looked like this:

Hype cycle MDM 2012
Source: Gartner

I have made a red circle around the two rightmost terms: “Data Quality Tools” and “Information Exchange and Global Data Synchronization”.

Now, 6 years later, the terms included in the cycle are the below:

Hype Cycle MDM 2018
Source: Gartner

The two terms “Data Quality Tools” and “Information Exchange and Global Data Synchronization” are not mentioned here. I do not think it is because the they ever fulfilled their purpose. I think they are being supplemented by something new. One of these terms that have emerged since 2012 is, in red circle, Multienterprise MDM.

As touched in the post Product Data Quality we have seen data quality tools in action for years when it comes to customer (or party) master data, but not that much when it comes to product master data.

Global Data Synchronization has been around the GS1 concept of GDSN (Global Data Synchronization Network) and exchange of product data between trading partners. However, after 40 years in play this concept only covers a fraction of the products traded worldwide and only for very basic product master data. Product data syndication between trading partners for a lot of product information and related digital assets must still be handled otherwise today.

In my eyes Multienterprise MDM comes to the rescue. This concept was examined in the post Ecosystem Wide MDM. You can gain business benefits from extending enterprise wide product master data management to be multienterprise wide. This includes:

  • Working with the same product classifications or being able to continuously map between different classifications used by trading partners
  • Utilizing the same attribute definitions (metadata around products) or being able to continuously map between different attribute taxonomies in use by trading partners
  • Sharing data on product relationships (available accessories, relevant spare parts, updated succession for products, cross-sell information and up-sell opportunities)
  • Having shared access to latest versions of digital assets (text, audio, video) associated with products.

This is what we work for at Product Data Lake – including Machine Learning Enabled Data Quality, Data Classification, Cloud MDM Hub Service and Multienterprise Metadata Management.

What is Interenterprise Data Sharing?

The term “Interenterprise Data Sharing” has been used a couple of times by Gartner, the analyst firm, during the last two decades.

Lately it has been part of the picturing in conjunction with a recent research document with the title Fundamentals for Data Integration Initiatives.

Data Integration.png
Source: Gartner Inc with red ovals added

The term was also used back in 2001 in the piece about that Data Ownership Extends Outside the Enterprise. Here on the blog it was included in the title of the post about Interenterprise Data Sharing and the 2016 Data Quality Magic Quadrant.

In my eyes interenterprise data sharing is closely related to how you can achieve business benefits from taking part in the ecosystem flavor of a digital business platform. Some of the data types where we will see such business ecosystem platform flourish will be around sharing product model master data and data about and coming from things related to the Internet of Things (IoT) theme. This is further explained in the blog page about Master Data Share.