Evaluation Criteria

View the evaluation criteria.

Enterprises should consider both current and likely future requirements

Data exchange platforms are environments that support three constituencies: data sellers, data buyers, and data operators. Thus, when evaluating data exchange platforms, examine features designed to support each constituency.

How to Evaluate and Select Data Sharing and Marketplace Products

The criteria are:


Data Sellers

For data sellers, the platform needs to make it easy to acquire and standardize data, productize and license it, control who can access it, and automatically distribute data to targets in the appropriate format.

Basic considerations are:

  • Can you white label the platform?
  • Does it facilitate e-commerce and transactions outside the platform?
  • Does it support ML models, unstructured data, notebooks, and dashboards?
  • Can sellers define access rights (i.e., whitelist and blacklist)?
  • Does it let sellers tailor licensing terms and payment options?
  • Can sellers charge fees or subscriptions or use tokens for outside purchases?
  • Can it standardize and format data?
  • Does it support multiple methods of distribution, including data sharing, SFTP, and APIs?
  • Does it support clean rooms?
  • Does it impose fees for cross-region or cross-cloud platform data shares?

Data Buyers

For data buyers, the platform needs to make it easy to browse and evaluate products, inspect data quality and schema, negotiate terms and prices, and acquire and integrate the data with minimal setup or effort.

Basic considerations are:

  • Does the marketplace support most of the data you need?
  • How easy it is to browse data?
  • Can an administrator assign purchasing rights and budgets to team members?
  • Does it deliver raw, normalized, and/or derived data?
  • Can you validate the quality, completeness, and compliance of data?
  • Can you run queries and models against the data in a safe space?
  • Can you upload and enrich your data within the marketplace?

Data Operators

For data operators, the platform needs to provide customizable onboarding templates and a rich set of options that enables operators to tailor the marketplace to target buyers and sellers, including choice of languages, licensing terms, payment options, and distribution methods.

Basic considerations are:

  • Does the software run on premises or in the cloud as a SaaS offering?
  • Does it run on one or multiple clouds, regions, and data management systems?
  • Does the platform store data or does it access it where it lies?
  • Does it price the platform by consumption, number of data products or features in the platform or the number of organizations using the platform?