A European Logistics Company Builds a Data Marketplace with OvalEdge

CLIENT’S PROFILE

The client is a conglomerate in the European logistics and cargo sector and encompasses a range of businesses. Its shipping division serves as a critical component of its operations. This case study delves into the journey of one of the client’s business units, showcasing their transformation through the implementation of a cutting-edge data marketplace powered by OvalEdge.

CONTEXT

The client generates a trove of data from its multifaceted operations. Passenger information, encompassing ticketing details, seating arrangements, and cabin class, represents just one facet. Onboard commercial activities, from dining options to advertising opportunities, contribute further to this data deluge. Coupled with data from port and terminal operations, the volume of information is immense. 

Initially, their objective was to effectively catalog this data, establishing clear end-to-end data flows with the ultimate aim of monetization. However, their needs evolved over time. The client’s data resided in a variety of systems, including a data lake built on Iceberg. They had already taken steps to create views of this data, effectively crafting pre-built "data products" ripe for consumption. Yet, these data products lacked a crucial element– a business-friendly interface.

Business users found themselves adrift, struggling to discover and access the relevant data necessary for informed decision-making. For example, the business development teams tasked with attracting new vendors (think restaurants, shops, and other concessions) to operate on their ships needed readily available data on passenger demographics and foot traffic.

This data existed, but it was buried beneath layers of technical complexity, making it nearly impossible for the business development team to effectively utilize. While they knew the data was there, but it was like trying to find a specific grain of sand on a beach. Their core challenge was clear, they needed data products that were intuitive and accessible for their business users.

WHY OVALEDGE

The client’s initial engagement with OvalEdge centered around traditional data governance functionalities: workflows, metadata management, classification, and data quality.

However, as they delved deeper into OvalEdge's capabilities, a transformative vision emerged, the creation of a data marketplace. Several of OvalEdge’s key features catalyzed this strategic shift:

• Data Catalog: OvalEdge provided a single, unified view of all data objects, including those residing within their Iceberg data lake. This centralized catalog instantly made data discoverable, transforming the search process from a laborious expedition to a simple point-and-click experience.
  
  

• Certification: The ability to certify data objects, guarantee data quality, establish clear lineage, and ensure proper documentation, quickly became paramount to their data marketplace strategy. Only certified objects would earn the designation of "data products" and be made available for consumption. This certification process provided the assurance that the data was reliable and trustworthy.
  
  

• Access Request Management: OvalEdge's robust workflow capabilities empowered the client to implement a structured and auditable process for users to request access to certified data products. This included built-in approval mechanisms, ensuring that data access was granted judiciously and in accordance with established policies.
  
  

• Unparalleled Customization: Crucially, OvalEdge distinguished itself through its demonstrated willingness and capacity to customize the platform to address the client’s unique and evolving requirements. This flexibility proved to be a decisive factor.
  
  

A particularly critical customization was the development and implementation of a Global Unique Identifier (GUID) solution. This innovative feature generated a unique, 32-digit ID for every data product, effectively eliminating ambiguity and ensuring that each data product, even those sharing similar names, could be easily identified and tracked. 

The GUID was a game-changer, it gave them confidence that they were managing access to the right data, every time. This was especially vital given their intricate organizational structure, encompassing multiple subsidiaries and business units.

The GUID was not only instrumental in managing access requests and permissions but also played a key role in the creation of Active Directory groups, further streamlining access management and significantly reducing the risk of unauthorized data access. This unique identifier solution, a capability not readily offered by other vendors, proved to be a linchpin in the client’s decision to partner with OvalEdge.

OvalEdge offered a comprehensive solution that addressed both the client’s data governance needs and desire to build a data marketplace. The ability to customize the platform to their specific requirements was a huge plus. Other vendors offered pieces of the puzzle, but OvalEdge provided the complete picture. 

SOLUTION

OvalEdge's solution provided the foundation upon which the client could construct a fully functional and thriving data marketplace. The platform facilitated the following essential operations:

• Publishing: Data product owners, armed with the tools provided by OvalEdge, could certify data objects, transforming them into readily available data products within the marketplace. This publishing process ensured that only high-quality, validated data products were offered to business users.
  
  

• Ordering: Business users, empowered by the intuitive interface of the data marketplace, could easily discover certified data products relevant to their needs. They could then initiate access requests through predefined workflows, ensuring a smooth and efficient acquisition process.
  
  

• Managing: OvalEdge's comprehensive suite of features extended beyond publishing and ordering, providing the necessary tools for the ongoing management and governance of data products. This included capabilities for monitoring data quality, tracking usage, and ensuring compliance with data policies.
  
  

The custom-built GUID solution played a central and indispensable role in the entire process. It ensured that access requests were invariably directed to the correct and intended data product, effectively preventing data breaches and maintaining the highest standards of data integrity. The seamless integration with Active Directory further automated and secured the access granting process, eliminating manual intervention and minimizing the potential for human error.

The client has implemented and leveraged the following features of OvalEdge:

• Data Catalog: The previous example highlights that the client’s data was scattered across various systems and lacked a "business layer" for easy access. The OvalEdge Data Catalog became the central hub for all their data assets, including those in their Iceberg data lake.
  
  

• Tags: Given the client’s diverse subsidiaries and data types (passenger information, commercial data, port operations), tags are crucial for efficient searching and filtering. This would allow users to quickly narrow down the list of data products to those relevant to their specific needs.
  
  

• Certification: OvalEdge's certification workflows were utilized to establish a rigorous process for validating data products before they are made available in the marketplace.
  
  

• Workflows: Beyond access requests, OvalEdge's workflow capabilities are used to manage the entire data product lifecycle, from initial creation and certification to eventual deprecation. Workflows are also used to automate data quality checks and other data management tasks.
  
  

• Service Desk Templates & Notifications: Integrating OvalEdge with their service desk system (ServiceNow) allowed the client to streamline the access request process. Service desk templates would have standardized requests, while notifications kept users informed about the status of their requests, improving efficiency and transparency.
  
  

• Custom Fields: The client’s complex organizational structure and diverse data types likely necessitated the use of custom fields to capture additional metadata about their data products. This could include information about data ownership, sensitivity levels, applicable data privacy regulations, or other relevant details, enriching the data product descriptions and aiding in data discovery and governance.
  
  

• Data Quality: OvalEdge's data quality features have also played a role in ensuring the accuracy and reliability of their data products. This involves data profiling, quality rule definition, and automated data quality checks.
  
  

• Business Glossary: Creating a business glossary has helped the client establish a common understanding of business terms and definitions related to their data products. This would bridge the gap between business users and technical teams, ensuring everyone was on the same page when discussing and using data.
  
  

OvalEdge enabled the client to create a self-service data marketplace where business users can easily discover and request access to certified data products. This has significantly improved data accessibility and usability. The integration with the existing service desk system was seamless. It streamlined the access request process and made it much more efficient.

OUTCOMES

The client has been able to transition from a traditional focus on basic data governance to the realization of a sophisticated and highly effective data marketplace. This transformation has enabled them to fully unlock the inherent value of their data, driving business growth, fostering innovation, and solidifying their position as a leader in the European logistics and cargo industry.

• Dramatically Improved Data Discovery: Business users, no longer lost in a sea of data, could effortlessly find and understand the specific data products they required for their work. This newfound ease of discovery unlocked the potential of the client’s data assets.

With OvalEdge, the client transformed their data from a liability into an asset. Business teams now have the data they need to make informed decisions, drive growth, and innovate. They saw a significant improvement in data discovery and access. Business users are now empowered to explore and analyze data on their own, without relying on IT.

• Streamlined and Secure Access Management: The combination of certification and access request workflows, coupled with the innovative GUID solution and seamless Active Directory integration, simplified and secured data access. This significantly reduced the risk of unauthorized access to sensitive information, protecting the client from potential compliance issues and reputational damage.
  
  

• Unlocking the Potential for Data Monetization: By making data easily accessible and readily usable, the client could finally leverage its vast data resources to drive more informed business decisions and explore new and exciting revenue opportunities. The data marketplace became a catalyst for innovation and growth, enabling the client to attract new vendors and forge strategic partnerships.
  
  

• Scalability for Future Growth: The implemented solution was designed with scalability in mind, ensuring that it could seamlessly adapt to the evolving needs of the client’s various business units and subsidiaries as the company continued to expand and diversify.
  
  

• A Distinct Competitive Advantage: The unique combination of features offered by OvalEdge, most notably the bespoke GUID customization, provided the client with a data marketplace solution precisely tailored to their specific requirements. This bespoke solution gave the client a competitive edge, enabling them to leverage their data more effectively than their competitors.