2026 Guide | AI in Financial Services
AI, Data Coverage, Regulatory Compliance, TechnologyArticles

Sustainable Investing: How Data Science can Improve Reliability of Reported Data

Published: February 3, 2022
Modified: February 3, 2022
Key Takeaways

Clarity AI standardizes ESG data to establish a reliable database prior to the implementation of CSRD reporting

Sustainability performance data are still in their early days. The Corporate Sustainability Reporting Directive (CSRD) will eventually make these data part of companies’ annual reports with third- party auditing. However, CSRD will not be fully implemented until 2025, and in the meantime, limited reliability in reported data is to be expected. This limited reliability applies even to broadly used quantitative metrics such as Scope 1 CO2 emissions, which —despite being a highly material metric—can suffer from high variability among data sources. This  due to errors, lack of standardization, and overall poor data quality from provider to provider. This is true even when dealing with data reported by the companies themselves. The higher the variability, the less reliable the data.

Variability among data providers used by Clarity AI

 

Clarity AI leverages three key differentiators to establish the most reliable database available today:

  • Assemble the largest collection of structured and unstructured data sources in a global database.
  • Use in-house and external technical data expertise to aggregate, clean, and standardize this database.
  • Leverage proprietary machine-learning algorithms and data science techniques to detect outliers and automatically select the best source for overlapping data, as well as to obtain accurate estimates for non-reported data.

Data Sources

Clarity AI draws on more than two million data points of various types (for example, quantitative, qualitative, and news). It has proprietary data from machine-learning models that estimate metrics to complement organizations’ non-disclosed information, and exclusive data sources from Clarity AI partnerships with worldwide, recognized data providers (for example, for controversial news) allow deeper and richer insight generation.

How Clarity AI Achieves the Most Reliable Database

Technical Data Expertise

Clarity AI’s data engineering and DevOps teams are experts in data life-cycle management, and they leverage bleeding-edge technology and tools for automated data ingestion, processing, validation, and storage. Our team can expertly clean and standardize a company’s other data, classifying it into peer groups and identifying key operating metrics.

Artificial Intelligence

Confirmed data are great; triple-confirmed data are better. Clarity AI uses its multiple sources, as well as overlapping coverage of key metrics, to ensure data consistency and reliability. To remove potential inconsistencies within this consolidated database, Clarity AI’s proprietary machine-learning algorithms choose the best sources and detect outliers just as an analyst would do based on domain expertise—but at scale and without human bias.

Case Study

The number for Salesforce’s 2019 Scope 1 CO2 emissions was reported inconsistently in a variety of data sources. Two data providers offered a value of 5,800 tons. A third provider said 5,000 tons, and a fourth reported 50,000 tons. Clarity AI’s algorithm concluded that the 5,000-ton value was the most reliable, and this conclusion was then backed up by Salesforce’s own annual report.

Access the full report here

Research and Insights

Latest news and articles

Market Insights

How Investors Are Navigating Geopolitical Risk

Geopolitical risk has always been priced into investment decisions, but rarely has it demanded a rethink of the assumptions beneath them. Today it does. The question facing long-term investors is no longer whether geopolitical events move markets. It is whether the frameworks built over decades to guide portfolio construction, exclusion policy, and asset allocation still…

ESG Risk, Gender Equality

The diversity say-do gap: Two-thirds of companies with discrimination violations also claim diversity initiatives

June is a month when corporate communications are filled with Pride messaging, diversity commitments, and inclusion statements. But beyond the visibility of these declarations, a more complex question remains: do these commitments consistently align with companies’ actual conduct? At Clarity AI, we looked at whether companies with active discrimination controversies in practice also publicly emphasize…

Climate

The physical risk gap: What today’s datasets are missing

Access to physical risk data is no longer the problem. Most asset managers who need it have it. Far fewer have data that holds up when it matters: under regulatory scrutiny, in client reporting, or when trying to act on it. Taking place in the heart of the climate week season, after Zurich and London,…