When discussing with peers and interested parties about Product Data Lake, some of the alternatives are often brought up. These are EDI and GDSN.
So, what is the difference between those services and Product Data Lake.
Electronic Data Interchange (EDI) is the concept of businesses electronically communicating information that was traditionally communicated on paper, such as purchase orders and invoices. EDI also has a product catalog functionality encompassing:
Seller name and contact information
Terms of sale information, including discounts available
Item identification and description
Item physical details including type of packaging
Item pricing information including quantity and unit of measure
The Global Data Synchronization Network (GDSN) is an internet-based, interconnected network of interoperable data pools and a global registry known as the GS1 Global Registry, that enables companies around the globe to exchange standardised and synchronised supply chain data with their trading partners using a standardised Global Product Classification (GPC).
This service focuses on retail, healthcare, food-service and transport / logistics. In some geographies GS1 is also targeting DIY – do it yourself building materials and tools for consumers.
Product Data Lake is a cloud service for sharing product information (product data syndication) in the business ecosystems of manufacturers, distributors / wholesalers, merchants, marketplaces and large end users of product information.
Our vision is that Product Data Lake will be the process driven key service for exchanging any sort of product information within business ecosystems all over the world, with the aim of optimally assist self-service purchase – both B2C and B2B – of every kind of product.
In that way, Product Data Lake is the long tail of product data synchronization supplementing EDI and GDSN for a long range of product groups, product attributes, digital assets, product relationships and product classification systems:
In software architecture, publish–subscribe is a messaging pattern where senders of messages, called publishers, do not program the messages to be sent directly to specific receivers, called subscribers, but instead categorize published messages into classes without knowledge of which subscribers, if any, there may be. Similarly, subscribers express interest in one or more classes and only receive messages that are of interest, without knowledge of which publishers, if any, there are.
This kind of thinking is behind the service called Product Data Lake I am working with now. Whereas a publish-subscribe service is usually something that goes on behind the firewall of an enterprise, Product Data Lake takes this theme into the business ecosystem that exists between trading partners as told in the post Product Data Syndication Freedom.
Therefore, a modification to the publish-subscribe concept in this context is that we actually do make it possible for publishers of product information and subscribers of product information to care a little about who gets and who receives the messages as exemplified in the post Using a Business Entity Identifier from Day One. However, the scheme for that is a modern one resembling a social network where partnerships are requested and accepted/rejected.
As messages between global trading partners can be highly asynchronous and as the taxonomy in use often will be different, there is a storage part in between. How this is implemented is examined in the post Product Data Lake Behind the Scenes.
The term narcissism originates from Greek mythology, where the young Narcissus fell in love with his own image reflected in a pool of water. While this is about how a natural person may behave it can certainly also be applied to how a company behaves.
Not to show empathy to customers
I think we all know the classic sales presentation with endless slides about how big and wonderful the selling company is and how fantastic the products they sell are. This approach contradicts everything we know about selling, which is to start with the needs and pain points at the buying company and then how the selling company effectively can fulfill the needs and make the pain points go away.
Not to show empathy to trading partners
While business outcomes originate from selling to your customers it certainly also is affected by how you treat your trading partners and how you can put yourself in their place.
An example close to me is exchange of product information (product data syndication) between trading partners. We often see solutions which is made to make it easy for you but then being difficult for your trading partner. This includes requiring your spreadsheet format to filled out by your trading partner, may be a customer data portal set up by a manufacturer or opposite a supplier data portal set up by a merchant. These are narcissistic dead ends as told in the post The Death Trap in Product Information Management: Your Customer/Supplier Portal.
Until now my venture called Product Data Lake has been a rather technical quest. As with most start-ups the first years have been around building the actual software (in our case facilitated by Larion Computing in Vietnam), adjusting the market fit and run numerous trials with interested parties.
Now it is time to go to market for real. I am happy that another Henrik has joined as CEO and will emphasize on leading the marketing, sales and financial activities.
While I will be concentrating on the product strategy and product management activities it is time to recap the business outcomes we want our subscribers and partners to achieve. Let me express those towards three kinds of business partners:
Manufacturers and brand owners:
On the upstream side of Product Data Lake our goal is to let you as a manufacturer and/or brand owner:
Sell more: Your re-sellers will have the most complete, accurate and timely product information in front of their customers.
Reduce costs: Push your product information in one uniform way and let your re-sellers pull it in their many ways.
Our concept, using emerging technologies within Product Data Lake, will free you from applying many different solutions to providing product information to your re-sellers. You will avoid errors. You will be able to automate the processes and you will be easy to do business with in the eyes of your trading partners.
The people who will use your products want to get complete product information when making the buying decision wherever they are in the supply chain.
You can follow the news stream for this on our LinkedIn showcase page called Product Data Push.
Merchants (dealers and retailers):
On the downstream side of Product Data Lake our goal is to let you as a merchant (dealer or retailer) gain substantial business outcome.
You will sell more by having the most complete, accurate and timely product information in front of your online customers when they make self-service buying decisions.
You will reduce costs as you can pull product information in one uniform way and let your suppliers push it in their many ways. Hereby you can automate the processes, avoid errors and reduce product returns.
Our solution, using emerging technologies within Product Data Lake, will make you be easy to do business with in the eyes of your suppliers and make your product information transform into a powerful weapon in the quest for winning more online market share.
The people who may buy your product range deserves to know all about it and wants to get that information when making the buying decision. Remember: 81 % of visitors will leave a web-shop with incomplete product information.
You can follow the news stream for this on our LinkedIn showcase page called Product Data Pull.
Technology and service partners:
Ambassadors at Product Data Lake can sign up subscribers, assisting these subscribers in uploading their relevant product information portfolio to Product Data Lake and assisting these subscribers in linking their product information with the product information at their trading partners. As an ambassador, you will:
Have the opportunity to work with a big data solution within Product Information Management.
Have the opportunity to make data mapping and/or data integration services and cross-sell of other services for subscribers in a whole supply ecosystem.
Get 25 % kickback on new subscriptions in a potentially exponentially growing subscriber base in supply ecosystems
As Reservoir you can bring new life into product data portals and pools. Product Data Lake is a unique opportunity for service providers with product data portfolios for utilizing modern data management technology and offer a comprehensive way of linking, collecting and distributing product data within the business processes used by subscribers. Signing up as reservoir is free.
The linking theme also related to applying artificial intelligence / machine learning to mapping between the different product information taxonomies in use at trading partners, where we collaborate with business partners who provide such capabilities.
You can follow the news stream for this on our LinkedIn showcase page called Product Data Link.
The intersection between Artificial Intelligence (AI) and Master Data Management (MDM) – and the associated discipline Product Information Management (PIM) – is an emerging topic.
A use case close to me
In my work at setting up a service called Product Data Lake the inclusion of AI has become an important topic. The aim of this service is to translate between the different taxonomies in use at trading partners for example when a manufacturer shares his product information with a merchant.
In some cases the manufacturer, the provider of product information, may use the same standard for product information as the merchant. This may be deep standards as eCl@ss and ETIM or pure product classification standards as UNSPSC. In this case we can apply deterministic matching of the classifications and the attributes (also called properties or features).
However, most often there are uncovered areas even when two trading partners share the same standard. And then again, the most frequent situation is that the two trading partners are using different standards.
As always, applying too much human interaction is costly, time consuming and error prone. Therefore, we are very eagerly training our machines to be able to do this work in a cost-effective way, within a much shorter time frame and with a repeatable and consistent outcome to the benefit of the participating manufacturers, merchants and other enterprises involved in exchanging products and the related product information.
Learning from others
This week I participated in a workshop around exchanging experiences and proofing use cases for AI and MDM. The above-mentioned use case was one of several use cases examined here. And for sure, there is a basis for applying AI with substantial benefits for the enterprises who gets this. The workshop was arranged by Camelot Management Consultants within their Global Community for Artificial Intelligence in MDM.
There is a tendency when deploying Product Information Management (PIM) solutions, that you may want to add a portal for your trading partners:
If you are a manufacturer, you could have a customer portal where your downstream re-sellers can fetch the nicely arranged product information that is the result of your PIM implementation.
If you are a merchant, you could have a supplier portal where your upstream suppliers can deliver their information nicely arranged according to your product information standards in your PIM implementation.
This is a death trap for both manufacturers and merchants, because:
As a trading manufacturer and merchant, you probably follow different standards, so one must obey to the other. The result is that one side will have a lot of manual and costly work to do to obey the strongest trading partner. Only a few will be the strongest all the time.
If all manufacturers have a customer portal and all merchants have a supplier portal everyone will be waiting for the other and no product information will flow in the supply chains.
In here Frank has this question: Do ecosystems represent an opportunity to establish non-traditional revenue streams (e.g. monetizing data)?
I think so. One example very close to me is how merchants, shippers and manufacturers can work closely together in not only moving the goods between them in an efficient way, but also moving the product information between them in the most efficient way.
There are three kinds of data monetization: Selling data, wrapping data around products and utilizing advanced analytics leading to fast operational decision making. These options were examined in the post Three Flavors of Data Monetization.
If we look at the middle option, wrapping data around products, and narrow it down to wrapping data around tangible products, there are some ways to execute that for supply change delegates, not at least if the participating business entities embraces the business ecosystem where goods are moved through:
Manufacturers need to streamline the handling of product information internally. This includes disciplines as PLM (Product Lifecycle Management) and PIM (Product Information Management). On top of that, manufacturers need to be effective in the way the product information is forwarded to direct customers and distributors/wholesalers and merchants as exemplified in the post How Manufacturers of Building Materials Can Improve Product Information Efficiency.
Merchants need to utilize the best way of getting data into inhouse PIM (Product Information Management) solutions or other kind of solutions where data flows in from trading partners. Many merchants have a huge variety in product information needs as told in the post Work Clothes versus Fashion: A Product Information Perspective. On top of that a merchant will have supplying manufacturers and distributors with varying formats and capabilities to offer product information as discussed in the post PIM Supplier Portals: Are They Good or Bad?.
Work clothes and clothes for private (and white collar) use are as products quite similar. You have the same product groups as shoes, trousers, belts, shirts, jackets, hats and so on.
However, the sales channels have different structures and the product information needed in sales, not at least self-service sales as in ecommerce, are as Venus and Mars.
Online fashion sales are driven by nice images – nice clothes on nice models. The information communicated is often fluffy with only sparse hard facts on data like fabrics, composition, certificates, origin. Many sales channel nodes only deal with fashion.
Selling work clothes, including doing it on the emerging online channels, does include images. But they should be strict to presenting the product as is. There is a huge demand for complete and stringent product information.
Work clothes are often sold in conjunction with very different products as for example building materials, where the requirements for product information attributes are not the same. Work clothes comes, as fashion, in variants in sizes and colors. This is not so often used, or used quite differently, when selling for example building materials.
At Product Data Lake we offer a product information sharing environments for manufacturers of work clothes and their merchants who may have a lot of other products in range with different product information requirements. We call it Product Data Syndication Freedom.
Building materials is a very diverse product group. Even within a manufacturing enterprise there may be considerable variances in what kind of product information you need for different product groups. If production is taking place on plants around the world, then local demands and cultural differences is another source of diversity in how product information is handled.
In many cases building materials are not sold directly to end users, but are forwarded in the supply chain to re-sellers being distributors/wholesalers, merchants/dealers and marketplaces. These trading partners each have their range of products and specific requirements for product information which makes it very hard for the manufacturer to prepare product information that fits all.
The IT enabled discipline aimed at solving such challenges is called product data syndication. There are namely these three kinds of product data syndication relevant to manufacturers:
Enterprise wide product data syndication aiming at linking, transforming and consolidating product information created by various business units and production sites around the world. The goal is to have consistent, accurate and timely information ending up in one place, often being an in-house Product Information Management (PIM) or Master Data Management (MDM) solution.
Ecosystem wide product data syndication push aiming at providing product information to re-sellers in a uniform way. On the other hand, it should be possible for the diverse crowd of re-sellers to pull that information adhering to each one’s requirements for format, completeness and conformity at a certain time.
Ecosystem wide product data syndication pull also in many cases applies to a manufacturer. It is not unusual that a manufacturer complements the own produced product range with special products supplied from other manufacturers, where product information must be provided by those. In addition to that manufacturers buys raw materials, spare parts for machinery and other products where product information is needed when the surrounding processes should be automated.
At Product Data Lake, we offer a solution to these challenges. We emphasize on these capabilities:
Product Data Quality aiming at improvements of completeness of product data, as well as the accuracy, timeliness, consistency and conformity of the product information shared with trading partners and end users.
Product Data Syndication Freedom, as the solution is suited for consolidating enterprise wide diversities and pushing information to trading partners in a uniform way while making it possible for trading partners to pull the product information in their many ways.
Learn more about the solution and the benefits for manufacturers of building materials on the Product Data Push site.