What to know about the EU’s facial recognition regulation – and how to comply

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Sébastien Louradour, Fellow, Artifical Intelligence and Machine Learning, World Economic Forum


  • Facial Recognition Technology (FRT) is a central concern of the European Commission’s proposed AI regulation.
  • To successfully comply, tech providers will need to build tailored approaches to risk management and quality processes.
  • In partnership with industry, government and civil society, the World Economic Forum has developed an audit framework and certification scheme for tech providers.

The European Commission’s (EC) proposed Artificial Intelligence (AI) regulation – a much-awaited piece of legislation – is out. While this text must still go through consultations within the EU before its adoption, the proposal already provides a good sense of how the EU considers the development of AI within the years to come: by following a risk-based approach to regulation.

Among the identified risks, remote biometric systems, which include Facial Recognition Technology (FRT), are a central concern of the drafted proposal:

  • AI systems intended to be used for the ‘real-time’ and ‘post’ remote biometric identification of natural persons are considered a high-level risk system and would require an ex-ante evaluation of the technology provider to attest its compliance before getting access to the EU market, and an ex-post evaluation of the technology provider (detailed below).
  • In addition, “real-time” remote biometric identification systems in publicly accessible spaces for the purpose of law enforcement are mostly prohibited unless they serve very limited exceptions related to public safety such as the targeted search of missing persons or the prevention of imminent terrorist threats (detailed in Chapter 2, Article 5, p.43-44). Additional requirements for this use-case would include an ex-ante evaluation to grant authorisation to law enforcement agencies, i.e. each individual use should be granted by a “judicial authority or by an independent administrative authority of the Member State”, unless it is operated in a “duly justified situation of urgency”. Finally, national laws could determine whether they fully or partially authorize the use of FRT for this specific use-case.

Other use-cases such as FRT for authentication processes are not part of the list of high-level risks and thus should require a lighter level of regulation.

Ex-ante and ex-post evaluations required by use-case in the EU's facial recognition regulation
Ex-ante and ex-post evaluations required by use-case

Ex-ante and ex-post evaluation of technology providers

The ex-ante evaluation (conformity assessment of providers) would include:

  • A review of the compliance with the requirements of Chapter 2;
  • An assessment of the quality management system, which includes the risk management procedures, and the post-market monitoring system; and,
  • The assessment of the technical documentation of the designated AI system.

Certifying the quality of the processes rather than the algorithm performance

While technology providers have to maintain the highest level of performance and accuracy of their systems, this necessary step isn’t the most critical to prevent harm. The EC doesn’t detail any threshold of accuracy to meet, but rather requires a robust and documented risk-mitigation process designed to prevent harm. The deployment of a quality-management system is an important step as it will require providers to design adequate internal processes and procedures for the active mitigation of potential risks.

A focus on risk management and processes

While it will be up to the technology providers to set up their own quality processes, third-party notified bodies will have the responsibility of attesting providers’ compliance with the new EU legislation.

To succeed, tech providers will need to build tailored approaches to design, implement and run these adequate processes. Providers will also have to work closely with the user of the system to anticipate potential risks and propose mitigation processes to prevent them.

How to anticipate the coming regulation

Over the past two years, the World Economic Forum has partnered with industry players, government agencies and civil society to draft a proposed policy framework for responsible limits on FRT.

Among our proposed oversight strategies, we have detailed a self-assessment questionnaire, a third-party audit and a certification scheme. The EU’s proposed concept of third-party audit (i.e. conformity assessment) suggests the same model of oversight and allows for rapid scale-up and deployment of certification bodies (i.e. notified bodies) to run the third-party audits across the EU.

The proposed conformity assessment procedure – which reviews the control of the compliance of the requirements stated in Title III of the proposed regulation – will first require notified bodies to draft dedicated audit frameworks and certification schemes. These two documents will be used to detail to audited organizations how the certification will play out.

In this regard, we encourage providers to consider the audit framework and certification scheme for the quality management system we’ve detailed in the white paper published in December 2020 in collaboration with the French accredited certification body AFNOR Certification.

Steps of the certification scheme detailed in the white paper - World Economic Forum, Responsible Limits on Facial Recognition Use Case: Flow Management, December 2020
Steps of the certification scheme detailed in the World Economic Forum white paper

Among the requirements of Title III, providers will need to put in place a risk management system focused on the analysis, anticipation and mitigation processes of potential risks. (We go over a similar structured approach in sections 2 and 3 of our audit framework to build the right risk assessment processes and prevent the occurrence of biases and discrimination.)

The post-market monitoring system defined in Article 61 is a mechanism to ensure that compliance with the requirements is met when the system is in operation. This critical point is defined in the audit framework we’ve designed. We’ve considered three stages of analysis when the third-party audit is carried out:

1. Ensuring the right design of the quality management processes to comply with the requirements;

2. Controlling correct implementation of the processes; and,

3. Validating that the system operates in accordance with the requirements.

Notified bodies will use certification schemes to conduct conformity assessments. These certification schemes will provide clarity and transparency to providers on how the assessment will be conducted. We have dedicated a chapter of our white paper (Part 4) to explain how to conduct certification of FRT systems, from the preparation phase to the certification phase and the issuance of certificate.

An additional way of preparing for a third-party audit is organizing an internal self-assessment prior to the audit. This activity will provide materials to attest if the system is audit-ready or requires further remediation. For the pilot phase of our policy project, we partnered with Narita Airport to draft and test a self-assessment questionnaire for the responsible use of FRT in airports. (The responses from Narita are publicly accessible in the appendix of our white paper.) AI, machine learning, technology

How is the Forum helping governments to responsibly adopt AI technology?

The World Economic Forum’s Centre for the Fourth Industrial Revolution, in partnership with the UK government, has developed guidelines for more ethical and efficient government procurement of artificial intelligence (AI) technology. Governments across Europe, Latin America and the Middle East are piloting these guidelines to improve their AI procurement processes.

Our guidelines not only serve as a handy reference tool for governments looking to adopt AI technology, but also set baseline standards for effective, responsible public procurement and deployment of AI – standards that can be eventually adopted by industries.

We invite organizations that are interested in the future of AI and machine learning to get involved in this initiative. Read more about our impact.

While the certification scheme and the audit framework we have detailed will have to evolve to comply with this legislation, they already provide good examples to follow.

When it comes to the use of FRT for identification purposes, maximum precaution should be taken. The proposed EU legislation is, in this sense, ambitious – and will help build trust and transparency among EU citizens and allow for the benefits of this technology to be safely deployed.


Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

© UN News/Laura Quinones Ambition the cat.

COP31: Ambition goes missing as fossil fuel language drops from draft deal

This article is published in association with United Nations. A cat named Ambition went missing again at COP31 on Thursday. While activists delivered the message with humour, it reflected a serious concern: explicit references to moving away from fossil fuels had disappeared from the latest draft climate agreement. On the eve of the summit’s scheduled […]
This article is published in association with European Investment Bank.

‘Losing the battle’: AI hands predators new ways to target children

This article is published in association with United Nations. Artificial intelligence (AI) is handing predators and criminal groups new ways to groom, extort and exploit children, while efforts to protect them are failing to keep pace, senior UN officials warned on Thursday. “We lost the battle on social media because we were lagging behind, and […]
© UN News/Laura Quinones UN Climate Conference in Antalya, Türkiye.

COP31 deadlock persists as countries launch new ‘climate reality check’

This article is published in association with United Nations. With the clock running down at COP31 in Antalya, countries on Wednesday launched a new global check on whether climate promises are being kept, even as ministers remained deadlocked over some of the summit’s toughest questions: who pays, how fast the world moves away from fossil […]
© UNOCHA/Viktoriia Andriievska A man enters a bombed building in Kyiv, Ukraine.

Ukraine: Civilian casualties in 2026 already far exceed previous years’ tolls

This article is published in association with United Nations. This year has seen dramatically higher civilian casualties in Ukraine than any other year since the full-scale invasion of the eastern European country by Russia in February 2022, the UN Human Rights Monitoring Mission in Ukraine (HRMMU) said on Tuesday. In October 2026, the number of […]
© UN Climate Change/Kubilay Citfci UN Climate Conference in Antalya, Türkiye.

COP31 enters decisive week as climate talks face political test and AI initiatives gather pace

This article is published in association with United Nations. New international initiatives on artificial intelligence and green industrialization showcased technology’s growing role in climate action, even as negotiators remained deadlocked on finance, fossil fuels and adaptation ahead of the final stretch of the UN talks. Today at COP31 As COP31 entered its second and final […]
UN Social Media/ María Fernández del Moral COP31 press conference to launch the Priorities for Action on AI for Climate Information Integrity.

COP31: New initiative targets AI and reliable climate change information

This article is published in association with United Nations. New guidance has been issued to ensure that people everywhere can obtain credible climate change information from artificial intelligence (AI) and understand how the technology impacts the environment. The Priorities for Action on AI and Climate Information Integrity were launched at the COP31 climate conference in […]
UN News A partially collapsed residential building in the city of Deir al-Balah, Gaza, after residents were evacuated amid heavy rain and strong winds.

Six killed in Israeli airstrike on Gaza’s Nasser Hospital

This article is published in association with United Nations. An Israeli airstrike on Gaza’s Nasser Hospital on Wednesday night killed six people, injured 27 others and caused extensive damage. Ramiz Alakbarov, the UN Special Coordinator for the Middle East Peace Process ad interim, on Thursday said he was deeply alarmed by the attack.” The strike […]
© UN News/Laura Quinones Sunrise over COP31 as participants arrived as early as 5am to avoid traffic closures.

‘Make or bake time’: Guterres urges climate justice pact as leaders gather at COP31

This article is published in association with United Nations. UN chief António Guterres called for a new global climate justice agreement at COP31 on Wednesday, urging governments to tax fossil fuel companies to help countries bearing the brunt of a crisis they did little to cause. His appeal came as world leaders gathered in Antalya […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Gaza winter aid: ‘No more delay’, Fletcher tells governments stalling on support

© UNRWA Children play outside tents in Gaza. This article is published in association with United Nations. The UN’s Emergency Relief Coordinator, Tom Fletcher, expressed deep concern about the deteriorating humanitarian situation in Gaza, as UN member states and partners have been repeatedly delaying sending their support to the Strip. “Foreign Ministers and partners have […]
This article is published in association with United Nations.l student with a strong interest in research and global health.

COP31: Energy transition takes centre stage as countries map path beyond fossil fuels

This article is published in association with United Nations. The global energy transition took centre stage on the second day of COP31, as countries explored how to move away from fossil fuels, accelerate clean energy and overcome financial and infrastructure barriers standing in the way. Today at COP31 Energy and Transport Day at COP31 got […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Children among the dead as heavy rains flood tents and shelters in Gaza

This article is published in association with United Nations. An infant reportedly drowned and five Gazans were killed – including three children – when a sand dune collapsed on their tents as the first heavy rains swept across the enclave at the weekend, according to the UN aid coordination office (OCHA). Thousands of families lost […]
© EducAid “Before [this], the difference was huge – I used to carry Anas, and he had to crawl on his hands,” said Anas’s mother.

‘For the first time I have my own chair’: Gaza siblings find new freedom

This article is published in association with United Nations. In Gaza, 10-year-old Anas is one of three siblings born without legs and with only two fingers on each of their hands. They struggle to move around and perform daily activities like eating and writing independently. With funding from the UN’s aid coordination office (OCHA), and […]
© UNICEF A child looks out from a makeshift shelter in Rafah, in the south of the Gaza Strip.

Gunfire damages tents at Rafah displacement site in Gaza, as aid teams prepare for winter storms

This article is published in association with United Nations. Gunfire hit and damaged multiple tents at a displacement site in Gaza’s northern Rafah region on Tuesday, reportedly causing injuries and forcing a humanitarian partner to leave the area, the UN aid coordination office (OCHA) has said. The NGO had been working on flood control ahead […]
© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon..

UN peacekeeping chief warns of ‘security vacuum’ as Blue Helmets leave Lebanon and Western Sahara

© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon.. This article is published in association with United Nations. The UN’s peacekeeping chief warned on Wednesday that the withdrawal of “Blue Helmets” from Lebanon and Western Sahara risks leaving a dangerous security vacuum, while the Security Council remains divided over what, if anything, should […]
© IOM/Haithm Abdulbaqi Young people in Yemen play football on a sandy pitch.

15 years of ‘almost no progress’ in getting young people moving: WHO

This article is published in association with United Nations. One in four adolescents worldwide reported not getting at least 60 minutes of physical activity on any day in the previous week, according to new global estimates released by the World Health Organization (WHO) on Wednesday. That amounts to some 240 million young people aged 11 […]
© UNICEF/Sultan Mahmu A mother and daughter wade through floodwaters in Feni, southeastern Bangladesh.

COP31 explained: What’s at stake at this year’s UN climate summit?

This article is published in association with United Nations. The world has more tools than ever to tackle climate change, yet millions remain unable to benefit from them. As clean energy technologies advance faster than ever, the challenge facing countries at COP31 is no longer just finding solutions – but making sure everyone can afford […]
© UNICEF/Christina Pashkina A school in Chuhuiv, Ukraine, lies in ruins after being hit by a missile.

Air raid alerts and attacks on schools: the devastating face of education in Ukraine

This article is published in association with United Nations. Ukraine has sustained almost 2,000 attacks on education since the full-scale Russian invasion in 2022, with some 270 this year alone, the UN Children’s Fund (UNICEF) said on Tuesday, a day after a strike at a school being used to distribute aid. Tweet URL Since the […]
© UNICEF/Oleksii Filippov People walk past a war-damaged building in Ukraine.

Ukraine: WFP provides hot meals to Oleshky evacuees as UN pushes to restore power before winter

This article is published in association with United Nations. The UN World Food Programme (WFP) is providing emergency food assistance to more than 400 people who were able to leave the Russian-occupied city of Oleshky, in Ukraine’s Kherson region, during a brief local ceasefire. Many arrived in worrying condition at medical facilities in Kyiv on […]

COP17: Nations chart ‘Yerevan Pathway’ to speed up action for nature

This article is published in association with United Nations. At the halfway mark to 2030, countries meeting in Armenia have agreed a roadmap to accelerate action for nature, after a global review found the world off track to meet its biodiversity targets. Agreement was formalised through the Yerevan Pathway as the UN Biodiversity Conference (COP17) […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com