How to ensure fair AI throughout the supply chain

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Mark Brayan, Chief Executive Officer, Appen


  • We need to go back to basics as we navigate the hype to make AI fair.
  • Basic fairness applies to all levels of the immense AI development lifecycle.
  • The fair treatment of the people who collect the data is being overlooked.

For some time now, there has been talk about how leaders developing AI applications need to build “fair AI”; this should be unbiased and equitable, ideally improving the quality of life of everyone it touches.

However, most of the thinking around ethical AI has been focused around models, explainability, technical teams and data governance.

But how about considering basic fairness in the AI development lifecycle? This lifecycle is immense. It entails the data collection and annotation contractors, the companies and individuals managing the data, the technology specialists building the AI models, the go-to-market experts building the AI applications, and the businesses and individuals using AI-powered products and services.

Such an approach is the only way we can ensure that technology continues to make the world a better place.

What is fair AI?

When an AI product is deployed in the real world, it must work as expected, deliver equitable results for all intended beneficiaries under all circumstances, and not harm anyone physically, mentally or emotionally. That’s a tall order. And it starts with building an unbiased and comprehensive data set.

While this may seem obvious, it’s easy for development teams to put unbiased data to the bottom of the pile and instead focus on achieving results as quickly as possible. However, doing so creates a long-term responsibility that developers can easily forget to maintain.

When is AI unfair?

Unfairness in the form of bias can appear in AI in multiple ways.

Consider criminal risk assessment algorithms that use behavioural and demographic data to determine the risk of reoffending.

A computer-based annotation system can’t do it alone when it comes to interpreting complex situations and catching subtle errors that could have real-life consequences. —Mark Brayan

One recent study found one such algorithm to be racially biased. For example, an 18-year-old black woman was charged with petty theft, having stolen an $80 bicycle. Despite having only one prior juvenile misdemeanour, she was rated as having a higher risk of reoffending than a 41-year-old white male who was charged with a similar crime but had several prior offenses.

Moving forward in time, the woman committed no other offenses while the male is now serving a prison term for the theft of thousands of dollars of electronics. Clearly, the algorithm was based on poor data.

Image: Proceedings of the National Academy of Sciences of the United States of America

Unfair AI also lives inside everyday technology. If a company sells cars equipped with speech recognition in multiple countries but trains the product using only native male speakers for each language, the system may struggle to understand women or anyone with a different accent.

This could lead to drivers being taken to the wrong destination. Worse still, it could cause distracted driving, leading to accidents. In addition to being unfair to some users, biased data can saddle solution providers with substandard products that can damage their reputation.

Where humans triumph

Developing a comprehensive and unbiased dataset requires data diversity and breadth. This ensures the product is trained in every situation it is likely to encounter in real life, such as all of the accents, voice tones and languages that a car’s speech recognition system may encounter in its target markets.

Achieving this means working with people who resemble the entire customer profile to collect, annotate and validate the AI model training data.

It also means working with a diverse team on the model building itself. A computer-based annotation system can’t do it alone when it comes to interpreting complex situations and catching subtle errors that could have real-life consequences.

For example, a human annotating images or a video for a self-driving car application could interpret that a person with a certain posture walking between two cars may be pushing a buggy that will appear in traffic before the person does.

Even the best computer-based annotation systems would struggle to make this interpretation. Similarly, a human reading a product review is much more likely to detect sarcasm than a machine is.

The people behind the data

Leaders committed to fair AI must include another important link in the AI development lifecycle when building global AI products or services: the millions of people who collect and label the data. Engaging these people in a fair and ethical way is mission-critical and should be part of every organisation’s responsibility charter.

Fair treatment means committing to fair pay, flexible working hours, including people from any and all backgrounds, respecting privacy and confidentiality, and working with people in a way that they feel heard and respected.

Leaders should also inspire their contractors in a way that instils pride in working on the most impactful technology used by the global economy.

Why does fair AI matter, beyond the obvious?

Quite simply, it’s good for society, and it’s good for business. Product teams, for example, are inspired when they’re building products that have a positive impact on their market and the world. But what else do fair products do?

  • They work for the entire target customer base: Products based on representative data will work for all users without bias, and so sell better, reduce frustration and lower returns.
  • They are safer: Comprehensive, unbiased training data will lead to safer, better-quality products, reducing the potential for failure.
  • They build loyalty: Great products and a great reputation are keys to increased customer loyalty.
  • They protect the brand: Products that work as expected often reduce the risk of serious and lasting brand damage.

According to one MIT Sloan study, only about one in ten enterprises currently report obtaining “significant” financial benefits from AI.

In 2021, as boards focus on closing the gap between AI’s potential and its reality, they will increasingly prioritise the adoption of the principles of fair AI. They know it will ensure projects work as designed, deliver expected benefits, and contribute to a better society.

Applications relying on AI are also infiltrating every industry, including the public sector. AI developers therefore have a certain responsibility to ensure their products are built on unbiased and comprehensive data sets that work for everyone.

Business and technology leaders should embrace fair AI as a core tenet to improve their businesses whilst helping society as a whole.

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

New UN rights report paints bleak picture in eastern DR Congo

Rule of Law: Commission launches infringement procedure to protect the independence of the Polish Supreme Court

The key takeaways of G7 Summit in Canada

Cyprus banks under scrutiny

6.1 billion EUR for sustainable fisheries and safeguarding fishing communities

Commission opens first European Innovation Council calls worth €1 billion

Human trafficking cases hit a 13-year record high, new UN report shows

The EU heads of State and Government about the result of the European Elections 2019

As monsoon rains pound Rohingya refugee camps, UN food relief agency steps up aid

Companies need help to overcome rising

Is Europe misjudging its abilities to endure more austerity and unemployment?

EU budget: Commission helps prepare new Cohesion programmes with Regional Competitiveness Index and Eurobarometer

EU investment budget for 2020: A boost for the climate

Darfur: Inter-communal tensions still high despite improved security, Mission head tells Security Council

Impossible Brexit options: WTO or new referendum?

Work and reforms of the UN ‘at risk’, Guterres warns Member States, amidst ‘record-level’ cash crisis

Mergers: Commission approves acquisition of Raytheon by UTC, subject to conditions

This is how AI can help you make sense of the world

Calculators didn’t replace mathematicians, and AI won’t replace humans

What lies ahead for the Korean Peninsula?

The Collapse of the Brazilian Health Care System

UN chief welcomes re-opening of key Gaza border crossing

COVID-19: latest on evaluation and authorisation of vaccines

It’s getting harder to move data abroad. Here’s why it matters and what we can do

To build back better, we must reinvent capitalism. Here’s how

Iraq: UN human rights report voices concern over conduct of ISIL fighter trials

15 years of risk: from economic collapse to planetary devastation

EU should set goal to end homelessness by 2030

These countries are the most peaceful – in 3 charts

European Investment Bank to borrow €70 billion in 2013

What are antibody tests and can they get the world back to work?

What’s everyone talking about at Davos 2020?

Inaction over climate emergency ‘not an option’ says UN Assembly chief

Why nature is the most important stakeholder of the coming decade

The New Year 2016 will not be benevolent to Europe

Brussels wins game and match in Ukraine no matter the electoral results

Charges against Baha’i in Yemen must be dropped: UN experts urge release of detainees

Reusable packaging: 6 benefits beyond sustainability

COP21 Breaking News_03 December: Transport Industry Drive for Improved Energy Efficiency and Electro-Mobility to Stem High Growth of Emissions

How cultural understanding can help in the cultural shock

Why skills are keeping CEOs awake at night

These are America’s most dangerous jobs

EU to give more power to national antitrust authorities in a bid to secure regulatory fines

Does May have enough time in Parliament to table a soft Brexit deal?

Japan’s population is shrinking by a quarter of a million people every year

The beginning of a revolution in healthcare

FROM THE FIELD: Keeping Morocco’s indigenous culture and conservation in balance

‘World has failed’ victims of genocide too often: Guterres

EU prolongs economic sanctions on Russia by six months

The EU Parliament unanimously rejects Commission’s ideas about ‘seeds’

This is how a smart factory actually works

Protecting European consumers: toys and cars on top of the list of dangerous products

‘Severe’ new US asylum restrictions will put vulnerable families at risk, UN refugee agency says

Thousands returning to Nigeria’s restive Borno state ‘at risk’; UN ‘gravely concerned’

‘Stay together and step up’ action to meet Global Goals, ECOSOC President tells development forum

Commission welcomes the political agreement on the Common Provisions Regulation for shared management funds

European Business Summit 2014 Launch Event: “Energising Industrial Growth”

Everything you need to know about the coronavirus

The revenge of the fallen

How communities are dealing with economy, society and education in COVID-19 crisis     

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s