Algorithmic warfare is coming. Humans must retain control

Army UN 2018

MONUSCO/Sylvain Liechti Special intervention brigade forces from Tanzania, part of the UN peacekeeping mission in the Democratic Republic of the Congo – MONUSCO, on duty in Sake, North Kivu (July 2013).

This article is brought to you thanks to the strategic cooperation of The European Sting with the World Economic Forum.

Author: Peter Maurer, President, International Committee of the Red Cross (ICRC)

Humanity is faced with a grave new reality – the rise of autonomous weapons. It may sound like a Hollywood script, but the risk is real: humans so far removed from wartime choices that life-and-death decision making is effectively left to sensors and software.

What sort of future looms if the taking of a human life is relegated to algorithms? Robots and computer systems lack the distinct and unique human ability to understand both the complex environment they’re operating in and the weapons they’re using. Moreover, the more complex weapon systems become – for example incorporating machine learning – and the greater freedom they are given to take action without human intervention, the more unpredictable the consequences in their use.

We at the International Committee of the Red Cross believe that the responsibility for decisions to kill, injure and destroy must remain with humans. It’s the human soldier or fighter – not a machine – who understands the law and the consequences of violating it, and who is responsible for applying it. These obligations cannot be transferred to a computer program. Governments – with the input of civil society and the tech industry – must waste no time in agreeing to limits on autonomy in weapon systems.

Technological advances represent great opportunities. Whether it’s in the fields of medicine, transport, agriculture, commerce, finance or virtually any other domain, robotics, AI and machine learning are having a transformative effect by advancing how we analyze and act upon data from the world around us. It makes sense that this technology be considered for national security and defense purposes, which is why it’s not a surprise that we are seeing many countries invest heavily in AI and in military robotic systems with greater autonomy.

But when it comes to armed conflict, we must not forget that even wars have limits. Governments that must now define the limits for autonomous weapon systems need to ensure compliance with international humanitarian law and be firmly rooted in the principles of humanity and the dictates of public conscience.

The good news is that when the Group of Governmental Experts charged with examining autonomous weapon systems met in April this year in Geneva, Switzerland, there was broad agreement that human control must be retained over weapon systems.

In a sense, though, that’s the easy part. At their next meeting in late August, governments must now build on this agreement to answer the more difficult question: What level of human control is required to ensure both compatibility with our laws and acceptability to our values?

The answer to this matters because some weapon systems with autonomy in their “critical functions” of selecting and attacking targets are already in use in limited circumstances for very specific tasks, such as shooting down incoming missiles or rockets. After activation by a human operator it is the weapon system that selects a target and launches a counterstrike.

However, the scope of possible future AI-powered weapon systems is much broader. It encompasses the full range of armed robotic systems, and potentially builds on the technology of AI “decision-aid” systems already being tested that analyze video feeds and detect possible targets.

With new advances happening at a breakneck pace, governments – with the support of the scientific and technical community – must take urgent action to agree on limits that will preserve the crucial human element, without stifling or slowing the technological progress that brings obvious benefits.

The alternative is the deeply unnerving prospect of a new arms race and a future where wars are fought with algorithms, with uncertain outcomes for civilians and combatants alike.

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

EU Presidents lay out priorities for future of Europe

Depression is the no. 1 cause of ill health and disability worldwide

When is Berlin telling the truth about the EU banking union?

UN chief calls for ‘increased commitment’ to resolution on 10th anniversary of Georgia conflict

Commission reinforces tools to ensure Europe’s interests in international trade

Data and the future of financial services

From social entrepreneurship to systems entrepreneurship: how to create lasting change

How migrants who send money home have become a global economic force

5 things to know about the exploding world of pro gaming

Coronavirus: Commission stands ready to continue supporting EU’s agri-food sector

EP Group leaders on Brexit: “the agreement is not open to renegotiation”

Ecuador: UN ‘stands ready’ to support talks, in bid to end political turmoil

COVID-19 threatens the developing world’s small businesses. This is how to save them

Amazon fires: Health Effects, Near and Far

Brazil must immediately end threats to independence and capacity of law enforcement to fight corruption

IMF: Sorry Greece it was a mistake of 11% of your GDP

EU Summit/Migration: Parliament calls for joint solutions based on solidarity

In Bahrain, Global Forum for Entrepreneurs and Investment examines empowerment of women, youth through innovation

How tomorrow’s buildings will make you – and the planet – healthier

The future of energy in Puerto Rico is renewable

One person dies by suicide every 40 seconds: new UN health agency report

Women outliving men ‘everywhere’, new UN health agency statistics report shows

EU budget: Commission helps prepare new Cohesion programmes with Regional Competitiveness Index and Eurobarometer

Is poverty and exclusion the necessary price for EU’s recovery?

How global tech can drive local healthcare innovation in China

MWC 2016 LIVE: Stripe gives payments leg-up to startups in emerging markets

The cost of housing is tearing our society apart

Release of prize-winning Reuters journalists in Myanmar welcomed by UN

Menu for change: why we have to go towards a Common Food Policy

This is what the UK’s major supermarkets say about plastic packaging and the environment

Environmental Implementation Review: Commission helps Member States to better apply EU environment rules to protect citizens and enhance their quality of life

The Junior Enterprise concept, one of the best ways to develop practical skills

The EU Parliament slams Commission on economic governance

Assault on key Yemeni port would endanger 300,000 children and ‘choke off’ aid for millions more: UNICEF chief

With science ‘held back by a gender gap’, Guterres calls for more empowerment for women and girls

Sign language protects ‘linguistic identity and cultural diversity’ of all users, says UN chief

Further reforms will move Slovakia toward a more innovative and inclusive society

Global economy: ‘we must do everything possible’ to avoid global ‘fracture’ caused by US-China tensions, urges Guterres

The mental domain in times of a pandemic

3 leadership lessons from the age of coronavirus

Ukraine undecided over a strategic partnership with the EU

“As long as we work together through thick and thin, more benefits can be delivered to the people of Eurasia”, China’s Premier Li Keqiang highlights from ASEM in Brussels

Electronic cigarettes, a better alternative or a well-advertised product

Ukraine jet crashes in Iran, killing 176: UN chief offers deepest condolences

The Linde Group Logo (Source: The Linde Group website, Press Services, 2018)

EU starts in-depth investigation of Linde-Praxair merger over competition concerns

This is how a smart factory actually works

Facebook/Cambridge Analytica: MEPs pursue personal data breaches probe

FROM THE FIELD: Keeping Morocco’s indigenous culture and conservation in balance

Uncovered liabilities of €5 billion may render EU insolvent

We must rethink and repurpose cybersecurity for the COVID-19 era

New General Assembly President brings ‘valuable insights’ into key UN challenges

The EU sides with China against the US; but has Germany capitulated to America?

Storms and snow in Lebanon worsen plight for Syrian refugees

Our tourism system is broken – time to customize

Deutsche Bank slammed by the US-based trio of IMF, Fed and Moody’s

Stronger European Border and Coast Guard to secure EU’s borders

DR Congo elections: ‘historic opportunity’ for ‘peaceful transfer of power’ says Security Council

It will take a lot more than free menstrual pads to end period poverty

Summertime Consultation: 84% want Europe to stop changing the clock

Why the foundations of the modern world are costing the earth

More Stings?

Advertising

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s