Algorithmic warfare is coming. Humans must retain control

Army UN 2018

MONUSCO/Sylvain Liechti Special intervention brigade forces from Tanzania, part of the UN peacekeeping mission in the Democratic Republic of the Congo – MONUSCO, on duty in Sake, North Kivu (July 2013).

This article is brought to you thanks to the strategic cooperation of The European Sting with the World Economic Forum.

Author: Peter Maurer, President, International Committee of the Red Cross (ICRC)

Humanity is faced with a grave new reality – the rise of autonomous weapons. It may sound like a Hollywood script, but the risk is real: humans so far removed from wartime choices that life-and-death decision making is effectively left to sensors and software.

What sort of future looms if the taking of a human life is relegated to algorithms? Robots and computer systems lack the distinct and unique human ability to understand both the complex environment they’re operating in and the weapons they’re using. Moreover, the more complex weapon systems become – for example incorporating machine learning – and the greater freedom they are given to take action without human intervention, the more unpredictable the consequences in their use.

We at the International Committee of the Red Cross believe that the responsibility for decisions to kill, injure and destroy must remain with humans. It’s the human soldier or fighter – not a machine – who understands the law and the consequences of violating it, and who is responsible for applying it. These obligations cannot be transferred to a computer program. Governments – with the input of civil society and the tech industry – must waste no time in agreeing to limits on autonomy in weapon systems.

Technological advances represent great opportunities. Whether it’s in the fields of medicine, transport, agriculture, commerce, finance or virtually any other domain, robotics, AI and machine learning are having a transformative effect by advancing how we analyze and act upon data from the world around us. It makes sense that this technology be considered for national security and defense purposes, which is why it’s not a surprise that we are seeing many countries invest heavily in AI and in military robotic systems with greater autonomy.

But when it comes to armed conflict, we must not forget that even wars have limits. Governments that must now define the limits for autonomous weapon systems need to ensure compliance with international humanitarian law and be firmly rooted in the principles of humanity and the dictates of public conscience.

The good news is that when the Group of Governmental Experts charged with examining autonomous weapon systems met in April this year in Geneva, Switzerland, there was broad agreement that human control must be retained over weapon systems.

In a sense, though, that’s the easy part. At their next meeting in late August, governments must now build on this agreement to answer the more difficult question: What level of human control is required to ensure both compatibility with our laws and acceptability to our values?

The answer to this matters because some weapon systems with autonomy in their “critical functions” of selecting and attacking targets are already in use in limited circumstances for very specific tasks, such as shooting down incoming missiles or rockets. After activation by a human operator it is the weapon system that selects a target and launches a counterstrike.

However, the scope of possible future AI-powered weapon systems is much broader. It encompasses the full range of armed robotic systems, and potentially builds on the technology of AI “decision-aid” systems already being tested that analyze video feeds and detect possible targets.

With new advances happening at a breakneck pace, governments – with the support of the scientific and technical community – must take urgent action to agree on limits that will preserve the crucial human element, without stifling or slowing the technological progress that brings obvious benefits.

The alternative is the deeply unnerving prospect of a new arms race and a future where wars are fought with algorithms, with uncertain outcomes for civilians and combatants alike.

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

the European Sting Milestones

Featured Stings

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

“As German Chancellor I want to be able to cope with the merger of the real and digital economy”, Angela Merkel from Switzerland; the Sting reports live from World Economic Forum 2015 in Davos

The EU Commission vies to screen Chinese investment in Europe

European car industry: The Germans want it all

MEPs reject making EU regional funding dependent on economic targets

MEPs approve EU’s spending in 2017

New skills needed for medical students in Industry 4.0

Precision medicine should be accessible to all

Brussels wins game and match in Ukraine no matter the electoral results

3 steps to making multistakeholder partnerships a powerful force

Strength in unity: Commission makes recommendations for the EU’s next strategic agenda 2019-2024

How climate change exacerbates the refugee crisis – and what can be done about it

EU-wide rules for safety of drones approved by European Parliament

Libya: ‘Substantial civilian casualties’ in Derna, UN humanitarian chief ‘deeply concerned’

WHO reports ‘very strong progress’ in battling DR Congo Ebola outbreak

Earth already has a perfect recycling system. So why not use it?

In Japan, if you’re 76 you’re biologically 65

European Commission: the LED lights of your Audi A6 shall save our planet

Former Chilean President Bachelet put forward by UN chief as next High Commissioner for Human Rights

Women’s voices must be heard in the battle to save the ocean

Autumn 2018 Economic Forecast: sustained but less dynamic growth amid high uncertainty

Why Eurozone urgently needs the ECB to print and distribute at least €500 billion

A new kind of company is revolutionising Africa’s gig economy

This Danish scheme is offering free kayak rides… for picking up trash

Donor countries need to reform development finance to meet 2030 pledge

The Parliament paves the way for the creation of the European Banking Union

Nigeria: UN chief ‘appalled’ by killing of aid worker; calls for release of remaining hostages

Hiring is broken. Here’s how to fix it

Governments should renew efforts to reform support to agriculture

Resiliency is the key to strong investments in a chaotic world

EU and China in search of a win-win agreement through strategic cooperation ahead of the EU-China summit

EU to give more power to national antitrust authorities in a bid to secure regulatory fines

‘Business as usual’ will not achieve global education goals

Protectionism doesn’t stand a chance in the age of connectivity

Three tips for breaking through bias and seeing evidence more clearly

How the EU sees its own and Russia’s role in Ukraine

The Eurogroup+ is born to govern the EU Banking Union

European Citizens’ Initiative: A game of much publicity and one big lie

Lithuania vs Parliament over 2014 EU budget

EU elections update: Can the EU voters vote unaffected from fake news and online disinformation?

Can North Korea and the U.S. strike a nuclear deal?

MEPs urge the EU to lead the way to net-zero emissions by 2050

A Sting Exclusive: “Paris is indeed our best bet for a secure climate future”, EU Commissioner for Environment Karmenu Vella cries out from Brussels

Pedal power makes ‘positive impact on climate’, urges UN on World Bicycle Day

Let your fingers do the walking

Free trade agreement between EU and India?

The power of trust and values in the Fourth Industrial Revolution

UN highlights need to solve growing burden of forcibly displaced Africans

These are the countries where it’s still illegal to get an abortion

MWC 2016 LIVE: T-Mobile US reveals 5G trial plans

New Zealand can improve well-being through better policymaking and reforms to housing and migration policy

Don’t let smoking steal life’s breathtaking moments, urges UN health agency

To tackle climate change, we need city diplomacy

EU Parliament: It takes real banks to fight unemployment and recession

Obese people more likely to smoke, says new gene research: WHO

UN rights chief denounces Burundi for ‘belligerent and defamatory’ attack on inquiry team

Saudi Arabia, China, among 14 nations under UN human rights spotlight: what you need to know

Electronic Cigarettes: Are they really as safe as we think?

The sad plight of fledging doctors

Newly displaced fleeing attacks in northeast Nigeria, top 2,000

Why the 33,000 staff European Commission did not have a real contingency plan for the refugee crisis?

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s