Here’s how to check in on your AI system, as COVID-19 plays havoc

hand robot

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Maxwell Hall, Media Lead, Broadcast and Programming, World Economic Forum


  • COVID-19 has disrupted our behaviours, playing havoc with AI systems.
  • Subject matter experts, who understand the context in which an AI system is operating, should assess how the COVID-19 crisis may have affected it.

MIT Technology Review reported last week that a number of AI systems are breaking down in the context of the COVID-19 pandemic. Systems designed for tasks ranging from inventory management to recommending online content are no longer working as they should.

The impact of the coronavirus crisis reflects a well-known limitation of AI systems: they do not handle novel situations well. Indeed, two months ago I warned of the challenge of using AI during the COVID-19 crisis. At the time I focused on the difficulty of creating new algorithms to address COVID-19 problems, but this same issue also poses problems for pre-existing AI systems.

Now is the time, therefore, to revisit the AI systems currently deployed in your own organization and assess whether they are still viable in this COVID-19 era.

What is the World Economic Forum doing about the coronavirus outbreak?

A new strain of Coronavirus, COVID 19, is spreading around the world, causing deaths and major disruption to the global economy.

Responding to this crisis requires global cooperation among governments, international organizations and the business community, which is at the centre of the World Economic Forum’s mission as the International Organization for Public-Private Cooperation.

The Forum has created the COVID Action Platform, a global platform to convene the business community for collective action, protect people’s livelihoods and facilitate business continuity, and mobilize support for the COVID-19 response. The platform is created with the support of the World Health Organization and is open to all businesses and industry groups, as well as other stakeholders, aiming to integrate and inform joint action.

As an organization, the Forum has a track record of supporting efforts to contain epidemics. In 2017, at our Annual Meeting, the Coalition for Epidemic Preparedness Innovations (CEPI) was launched – bringing together experts from government, business, health, academia and civil society to accelerate the development of vaccines. CEPI is currently supporting the race to develop a vaccine against this strand of the coronavirus.

Why is AI having problems?

Almost all current AI systems use some version of machine learning, which work by examining large amounts of training data, usually past examples of the task it is trying to learn (e.g. past examples of inventory fluctuations, or content streaming behaviour). Machine learning systems look for patterns in the training data, and then once deployed, they draw on those patterns to make predictions for new cases (e.g. what will inventory needs be next week, what will a given new user enjoy).

“Radical disruptions such as the Covid-19 pandemic may mean that completely new factors that are not even part of the algorithm suddenly become important.”

—Matissa Hollister

The machine learning approach works well when these new cases are similar to the examples in the training data. The ability of machine learning algorithms to identify subtle patterns in the training data can allow it to make a faster and possibly better predictions than a human. However, if the new cases are radically different from the training data, and especially if we are playing by a whole new rulebook, then the patterns in the training data will no longer be a useful basis for prediction. Some algorithms are designed to continuously add new training data and therefore update the algorithm, but with large changes this gradual updating will not be sufficient. To learn completely new rules, machine learning algorithms need large amounts of new data.

In addition to lacking relevant examples in the training data, AI systems may falter if new factors become important that were not considered in the original design. AI developers select which pieces of information to include in the training data, anticipating all of the factors relevant to the task. Radical disruptions such as the COVID-19 pandemic may mean that completely new factors that are not even part of the algorithm suddenly become important. Such situations will require redesigning the system itself, ranging from a small tweak to a complete overhaul.

Anticipating AI problems

Not all AI algorithms will face performance problems under COVID-19. Given that, you could simply hope that your system will be unaffected or monitor it for declines in performance. A more proactive approach, though, is to anticipate problems and take strategic action to address them. Anticipating problems does not necessarily require understanding the technical aspects of AI. Indeed, more important is subject matter expertise, someone who understands the context in which the AI system is operating and how the COVID-19 crisis has affected it.

 

The subject matter expert should examine two aspects of the AI system. First, what is the source of the training data? To what extent is that training data still relevant today? Are current situations similar enough to the examples in the training data that the patterns that the algorithm has identified are still relevant?

Second, what factors does the system consider and what assumptions about cause and effect are baked into its design? Are there new factors influencing behaviors today that are missing from the system?

Developing an action plan

If your analysis suggests that the COVID-19 pandemic may cause problems for your AI system, you have a few options.

In the short term, it will likely be necessary to increase human oversight. We humans are also struggling to understand how the world works in this COVID-19 era, but we are better-equipped to deal with novel situations in most cases than AI. It may even be necessary for humans to take a leading role for a while. For example, Facebook is using fact-checking organizations to initially identify cases of COVID-19 misinformation, and then pairing these with an AI system to flag the many variations of each of these cases that would otherwise overwhelm fact-checking capacities. As the AI system is provided with more examples of COVID-19 misinformation, it will learn patterns and increasingly be able recognize new cases on its own.

Similarly, if the lack of relevant training data is the central problem for your system, you can seek to collect new training data that fits current conditions. If you have identified newly relevant factors that are not currently considered in the model, then you would also need to redesign your AI systems to take these factors into account.

These steps, though, may not be worthwhile if you expect the context to change radically again. In the case of identifying fake news, we might reasonably expect that COVID-19 misinformation will, going forward, evolve slowly enough that training an AI system to detect it would be worthwhile. The important impact of this misinformation as well as the large volume of data that is already being generated also make such a redesign worthwhile. In contrast, it is not clear that the abrupt consumption changes that have affected inventory AI systems represent a stable “new normal” that is worth the time and expense to model.

The larger lesson

Despite its reputation as a disruptive technology, AI does not handle disruption well. While the COVID-19 pandemic has highlighted this problem, it is an ongoing weakness. Even slow changes can accumulate to significant drift that threatens AI systems. Regular monitoring and revisiting, therefore, is necessary. Rather than getting lost in the technical details, though, the most important step in monitoring an AI system is understanding the changing landscape. Ensure that the system still fits that landscape, whether it is evolving slowly or shifting with disturbing speed under our feet.

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

These are the world’s most fragile states in 2019

What Keynes can teach us about government debt today

ECB steadily continues monetary easing policy as EU economy gains momentum

IMF’s Lagarde: Estimating Cyber Risk for the Financial Sector

COVID-19 tracing apps: MEPs stress the need to preserve citizens’ privacy

Building an Inclusive ICT Innovation Ecosystem

Malta: Human rights experts call for justice in case of murdered journalist

Wind farms now provide 14% of EU power – these countries are leading the way

EU budget 2019 approved: focus on the young, innovation and migration

Yemen: ‘Living hell’ for all children, says UNICEF; Angelia Jolie calls for ‘lasting ceasefire’

Earthquake: Monte Dei Paschi Di Siena

Summer 2019 Economic Forecast: Growth clouded by external factors

The sad plight of fledging doctors

UN experts decry torture of Rakhine men and boys held incommunicado by Myanmar’s military

MWC 2016 LIVE: Telenor CEO calls on operators to embrace Mobile Connect initiative

Holocaust survivors rebuild lives and traditions in Rio de Janeiro

Does the world have strong enough institutions to handle risks like Trump and Brexit?

‘Air bridge’ vaccination operation begins for Ebola-hit communities in DR Congo

Over 85% of European bathing sites rated as excellent for water quality

Why do medical students need to emigrate to become doctors in 2017?

EU Commission: Growth first then fiscal consolidation

Pay packet inequality growing worldwide, says new UN report

EU job-search aid worth €9.9m for 1,858 former Air France workers

European Agenda on Migration: Still fragile situation gives no cause for complacency

Infringement – Commission takes Italy to Court for its incomplete regime of access to genetic resources

In Finland, speeding tickets are linked to your income

What can Darwin teach the aviation industry about cybersecurity?

EU budget 2021-2027: Commission calls on leaders to set out a roadmap towards an autumn agreement

More efforts needed to boost trust in business and finance

Resolving banks with depositors’ money?

INTERVIEW: ‘Defend the people, not the States’, says outgoing UN human rights chief

COVID-19 has accelerated India’s digital reset

Why cities hold the key to safe, orderly migration

Prevention is key to ‘breaking the cycle of HIV transmission’, UN chief tells General Assembly

UN must bring more women police officers into the fold to be effective – UN peacekeeping official

UN chief lauds Fijians as ‘natural global leaders’ on climate, environment, hails ‘symbiotic relationship’ with land and sea

Getting vaccinated should just be considered a human right?

Tuesday’s Daily Brief: #GlobalGoals progress, essential meds, updates from Cox’s Bazar, Sudan and DR Congo

On European immigration: Europe’s Missing Citizens

Confirmed ‘Blue Line’ tunnels ‘do not appear’ to surface in Israel – UN peacekeeping chief

Burundi: Inclusive dialogue ‘only viable option’ for resolving country’s political crisis says, UN envoy

Military escalation will have ‘serious consequences’ for Yemeni civilians, warns UN Special Envoy

With 10 million Yemenis ‘one step away from famine’, donors pledge $2.6 billion

Eurozone: Sovereign debt decreases for the first time since 2007

‘Champion for multilateralism’ readies to hand over UN General Assembly gavel

How to bring precision medicine into the doctor’s office

How to survive and thrive in our age of uncertainty

These countries are driving global demand for coal

From cheeseburgers to coral reefs, the science of decision-making can change the world

How women in developing countries can harness e-commerce

Governments can fight corruption by joining the digital payment revolution

The megatrend that will shape our working future

African economies sustain progress in domestic resource mobilisation

Vulnerable children face ‘dire and dangerous’ situation on Greek island reception centres, UNICEF warns

World ‘not yet on track’ to ensure children a better future: UN rights chief

MWC 2016 LIVE: Ingenu steps up efforts to build LPWA networks across the globe

Remarks by H.E. Ambassador Zhang Ming At the Reception in Celebration of the 70th Anniversary of the Founding of the People’s Republic of China

Parliament approves €500 million for schooling of refugee children in Turkey

Libya: UN Mission condemns deadly attack against police in country’s south-east

United States: UN chief ‘deeply saddened’ by deadly California wildfires

More Stings?

Advertising

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s