Indices insights: Do ESG ratings align with the values of large investors?

Indices insights: Do ESG ratings align with the values of large investors?

23-02-2022 | Vision

This is the first article of a new series, Indices insights, in which we focus on some of the flaws of ESG ratings. Compared to the UN SDGs, the use of ESG ratings has some shortfalls. Indeed, it’s possible for firms that typically appear on asset owners’ exclusion lists to have decent ESG ratings.

  • Jan Anton van Zanten
    Jan Anton
    van Zanten
    SDG Strategist
  • Joop  Huij
    Head of Indices
  • Simon Lansdorp
    Portfolio Manager

Speed read

  • There is a weak relationship between firms being on exclusion lists and their ESG ratings
  • There is a much stronger alignment with SDG scores
  • SDGs scores are better suited than ESG ratings for investors seeking to avoid negative impact

Many investors either incorporate sustainability considerations in their portfolios or plan to do so in the future. One of the key motivating factors for this adoption is that it enables investors to align with positive impact, i.e., by allocating capital to companies that are sustainable and which benefit society, while avoiding investments in those that inflict significant harm on it. To achieve this, investors often rely on readily available ESG ratings.

It is, however, important to assess whether these ESG scores appropriately measure societal impact. In our analysis, we scrutinized the ESG ratings of companies that are explicitly earmarked by large institutional asset owners as being bad for society. Surprisingly, we found a weak relationship between the firms that are on exclusion lists and their respective ESG ratings. By contrast, there was a much stronger alignment when we used a measure based on the United Nations Sustainable Development Goals (SDGs).

For example, Figure 1 shows that more than half of the tobacco producers that are excluded from the portfolios of large asset owners receive an average ESG rating or are even considered ESG leaders by MSCI. Similarly, more than half of these companies are assessed as having neutral or even low ESG risk according to Sustainalytics. By contrast, all of these firms receive the lowest Robeco SDG score of -3, in line with the harmful products they produce. Similarly, we find that stocks that are avoided for other reasons that are deemed important by large asset owners have SDG scores that are seemingly more aligned with the negative impact they inflict on society.

Figure 1 | Scores of companies on exclusion lists, using different sustainability measures

Source: Robeco, MSCI, Sustainalytics.

Data and methodology

For our analysis, we started by collecting exclusion lists. Many institutional investors keep a record of the companies they exclude from their investable universes for regulatory or values-based reasons. Large asset owners often publish ESG policies and sometimes their exclusion lists on their websites. Thus, we were able to download the exclusion lists for some the largest sovereign wealth funds and pension funds globally, as well as their criteria for omitting companies.1

For example, the Norges Bank shares a list of firms that are excluded or under observation for the Government Pension Fund Global. It also provides guidelines which contextualize the reasons why certain businesses are not included in their investable universe, such as precluding investments in companies that produce tobacco-related products given their adverse impact on health.2

We then combined the exclusion lists of the various asset owners and categorized the list of companies according to five commonly used exclusion criteria. Since data coverage is relatively low for micro-cap stocks, we restricted our universe to the constituents of the MSCI ACWI Investable Market Index. In total, we analyzed 293 firms. These were based on the five exclusion criteria: tobacco producers; coal miners and/or coal-based energy producers; controversial weapons manufacturers; companies at fault for significant environmental damage; firms responsible for severe violations of human and/or labor rights.

For each of the stocks that met these exclusion criteria, we analyzed their sustainability scores by referring to three data providers, namely the Robeco SDG scores based on our proprietary SDG framework, MSCI ESG ratings, and Sustainalytics ESG risk ratings. Note that these three data providers use different approaches for their scoring methodologies and that their sustainability scores are not directly comparable.

That said, the sustainability scores clearly differentiate between firms that have a negative, neutral or positive impact on society (Robeco SDG scores); companies that are deemed to be ESG laggards, average in terms of ESG, or ESG leaders (MSCI ESG rating); or businesses that have high, neutral, or low ESG risks (Sustainalytics ESG risk rating).

For instance, the Robeco SDG scores and MSCI ESG ratings apply a categorical scale, ranging from -3 to +3, and from CCC to AAA respectively. The Sustainalytics ESG risk ratings assign a quantitative risk score that is used to place a company in one of five risk categories, ranging from severe to negligible. This is summarized in Table 1.

Table 1 | Scoring methodologies

Source: Robeco, MSCI, Sustainalytics.


Based on our analysis, we conclude that ESG ratings may not effectively capture the impact companies have on society, which is a key consideration for large institutional asset owners. An SDG-based approach takes into account how companies impact the SDGs. In our view, such an approach can enable investors to align their portfolios with positive impact, by avoiding investing in firms that contribute negatively to the SDGs.

  Background to sustainability metrics

In defining sustainability, investors have a multitude of dimensions and metrics they could consider. For example:

  • Values-based exclusions
  • ESG integration
  • Impact investing

ESG scores typically put more focus on the operations of a business, whereas SDG scores also incorporate the impact that the business' products and/or services have on society.

We see client sustainability objectives increasingly moving towards avoiding controversial businesses (values-based exclusions) and including those that provide sustainable solutions (impact investing). In the first few articles of our Indices Insights series, we will empirically show how the different sustainability metrics (negative screening/exclusions, ESG, SDG) relate to the increasingly impact-oriented client sustainability objectives.


Les sujets en rapport avec cet article sont :

Information importante

L’information publiée dans les pages de ce site internet est plus particulièrement destinée aux investisseurs professionnels.

Certains fonds mentionnés dans le site peuvent ne pas être autorisés à la commercialisation en France par l’Autorité des Marchés Financiers. Les informations ou opinions exprimées dans les pages de ce site internet ne représentent pas une sollicitation, une offre ou une recommandation à l’achat ou à la vente de titres ou produits financiers. Elles n’ont pas pour objectif d’inciter à des transactions ou de fournir des conseils ou service en investissement. Avant tout investissement dans un produit Robeco, il est nécessaire d’avoir lu au préalable les documents légaux tels que le document d’information clé pour l’investisseur (DICI), le prospectus complet, les rapports annuels et semi-annuels, qui sont disponibles sur ce site internet ou qui peuvent être obtenus gratuitement, sur simple demande auprès de Robeco France.

Nous vous remercions de confirmer que vous êtes un investisseur professionnel et que vous avez lu, compris et accepté les conditions d’utilisation de ce site internet.

Je n’accepte pas