Three tips for breaking through bias and seeing evidence more clearly

iphone 19

(Paul Hanaoka, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Alex Edmans, Professor of Finance, London Business School


Business has lost the public’s trust, on both sides of the Atlantic and Channel. As a result, regulators are implementing overdue reforms to ensure that business works for all of society. These include changes to pay practices and disclosure, new corporate governance and stewardship codes, and potential restrictions on share buybacks.

Advocates for reform aim to base their proposals on evidence. In a world where fake news abounds, surely this attention to evidence should be applauded?

Not necessarily. One of the most dangerous phrases is “research shows that …”. Given the huge range of available studies, you can almost always find research to show whatever you’d like. As I explained in a recent TED talk, What to Trust in a Post-Truth World, this is a particular issue due to confirmation bias – the temptation to accept evidence that supports your opinion, regardless of its quality. Since existing views on business are strong, flimsy studies can become influential if they support these views.

Here’s a few examples. A widely quoted statistic is that 91% of US profits went to share buybacks and dividends. According to the author: “[T]hat left very little for investments in productive capabilities or higher incomes for employees.” This statistic makes no sense. Profits are after deducting wages and intangible investments such as R&D and advertising. That’s like saying “the kids can’t have had much to eat because their plates are empty” – they’ve already eaten, which is why the plates are empty. But despite this basic mistake, this statistic is commonly cited, since it confirms common views on share buybacks.

In the 2016 House of Commons inquiry into corporate governance, a witness quoted a study which “found that firm productivity is negatively correlated with pay disparity between top executive and lower level employees”, referencing a 2010 draft. The finished version had actually been published three years before the inquiry. Having gone through peer review and tightened its methodology, it found the opposite: “Firm value and operating performance both increase with relative pay.” But despite a separate submission highlighting the error, the inquiry’s final report still referred to “clear academic evidence that high wage disparities within companies harm productivity”. The House of Commons Executive Pay report, released this week, quoted another unpublished study that makes a similar claim, but omitted the evidence presented at the prior inquiry.

Last year’s Corporate Governance Code consultation referred to “clear evidence that greater female representation in the boardroom and senior management has a positive impact on performance”. The “clear evidence” cited a single non-peer-reviewed paper, with elementary omissions such as not including dividends when calculating stock returns, controlling for other factors, or checking statistical significance. This does not mean that diversity initiatives are unwarranted, as I’ll shortly stress.

So what should we do? Faced with reams of available evidence, how do we know what to trust? One tip is to draw particularly from studies published in the most stringent peer-reviewed journals, to reduce the risk that a paper is biased or flawed. As the paper on pay disparity shows, peer review isn’t simply a rubber stamp, but can overturn a paper’s conclusions. Now peer review is far from perfect, because there’s a vast range in the quality of reviewing standards. But quality can easily be checked using a list of the most stringent journals, such as the Financial Times Top 50.

Every study starts off unpublished. So the second tip is, for an unpublished paper, to scrutinize the researchers’ credentials. Again, this can be easily done, for example by looking up their institution. This isn’t to be elitist, but to recognise the importance of evidence quality – just as we’d particularly trust the medical opinion of a leading hospital. Often, we latch on to a study because we like the findings, regardless of who wrote it.

The third tip is to place more weight on balanced opinions. There are two sides to almost every issue. But authors have the incentive to present only one and claim “clear evidence”, to give a more convincing message. Such one-sided views are likely misleading, and the reader should be less convinced by an author who isn’t secure enough to acknowledge the other side. The Norwegian Sovereign Wealth Fund’s position papers on corporate governance all include the arguments against their position. This gives confidence that they reached their stance after a careful consideration of both sides.

But evidence doesn’t mean that only one view is right. Even if we all agree on the price and characteristics of different cars, different people may buy different cars given their different preferences on price, fuel efficiency and safety. Similarly, even if higher pay ratios improve firm performance, this doesn’t mean they’re desirable. Some citizens may view income equality as more important than firm performance. Evidence only aims to put the facts on the table so that we can understand the trade-offs behind decisions.

 

And for many reforms, evidence isn’t even necessary. Gender diversity is desirable in its own right, and firms should pursue it even without evidence that it improves performance. It would be a sad world if the only reason firms increased gender diversity was to make money – and might hinder initiatives to promote other forms of diversity where there isn’t any evidence.

So evidence may be neither conclusive nor essential. But if it’s used, it should be of the highest quality.

Advertising

Advertising

Advertising

Advertising

Advertising

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

‘World’s deadliest sea crossing’ claimed six lives a day in 2018: UN refugee agency

EU Commission announces Safe Harbour 2.0 and a wider Data protection reform

These 4 scenarios show how we might be working in the future

What Merkel and Macron are to tell Trump in Davos?

OECD employment rate increases to 68.2% in the first quarter of 2018

Governments urged to put first ever UN global migration pact in motion, post-Marrakech

European Commission statement on the adoption of the new energy lending policy of the European Investment Bank Group

UN highlights importance of skills development on World Youth Skills Day

3 ways business leaders can build digital trust

What is the UN General Assembly and what does it do?

Budget MEPs approve €34m in EU aid to Greece, Poland, Lithuania and Bulgaria

10 reasons why today’s cyber leaders are tomorrow’s world leaders

Across the world, women outlive men. This is why

The consequences of Brexit seen by a European young entrepreneur

UN gears up emergency food aid for hurricane-struck region of Bahamas, as death toll rises

Europe eyes to replace US as China’s prime foreign partner

Draghi left alone with no hope of boosting EU growth as Merkel just focuses on next elections

Collective action now, the only way to meet global challenges, Guterres reaffirms in annual report

FROM THE FIELD: ‘Eco-warriors’ fight climate change in South Africa

Wednesday’s Daily Brief: updates from the Near East and Libya, Ebola in DR Congo, World War remembrance

German political spillovers: ECB’s Draghi resists first attacks by AfD

The von der Leyen Commission: for a Union that strives for more

Countries urged to make ‘digital world’ safer for children

What can stop the ‘too big to fail’ bankers from terrorising the world?

This is how companies are working together to create a world without waste

The relationship between Dengue and the rainfall in Boa Vista, Brazil

We must build resilience to face the future – but will we be fast enough?

Here are five tips to make your message clear in a crowded world

Is “Sustainable Development” a concept that integrates Health Literacy and Health Policy as a global health action?

A geared turbofan at Pratt & Whitney's production hub in West Palm Beach (copyright: Pratt & Whitney - a UTC Company- 2018; Source: Pratt & Whitney's website, media center)

The EU Commission approves UTC’s acquisition of Rockwell Collins under conditions

European Border and Coast Guard: Council adopts revised regulation

3 unexpected consequences of the US-China trade war

Trump fines China with $50 billion a year plus some more…

These chefs are fighting hunger and poverty with gastronomy

Ebola: EU announces new funds to strengthen preparedness in Burundi

Spread of polio still an international public health concern

Taliban-led violence during recent Afghan polls leaves record high numbers of civilians dead – UN

UN peacekeepers warn of increasing global challenges

UN Human Rights Council stands firm on LGBTI violence, Syria detainees and Philippines ‘war on drugs’

EU-U.S. Trade Talks: European Commission presents draft negotiating mandates

Europe bows to Turkey’s rulers, sends Syrian refugees back to chaos

It’s time to switch to a four-day working week, say these two Davos experts

Erasmus+: an expected budget of €3 billion to be invested in young Europeans and to help create European Universities in 2019

Economic sentiment and business climate stagnate in miserable euro area

Mali not fulfilling its ‘sovereign role’ in protecting its people: UN human rights expert

World simply ‘not on track’ to slow climate change this year: UN weather agency

Germany: A grand coalition may trouble employers and bankers

IMF launches a new offensive against Germany

Mobility in 2020: a female perspective

COP25: Support business efforts to tackle climate change, urges Guterres

Trump rejects Europe’s offer for zero car tariffs; he had personally tabled that idea in July

Children of ISIL terrorists likely held in ‘secret detention facilities’, UN human rights office warns

Copyright: MEPs back provisional agreement

Should tech companies pay us for our data?

Facebook and Google to treat Europe as the 51st State of the USA

UN chemical weapons watchdog adds new powers to assign blame, following attacks

Here are three ways blockchain can change refugees’ lives

2016 crisis update: the year of the Red Fire Monkey burns the world’s markets down

EU unveils plan to accelerate Capital Markets Union ahead of London’s departure from the bloc

EU’s tougher privacy rules: WhatsApp and Facebook set to be soon aligned with telcos

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s