Trust in facial recognition technology can be achieved. Here’s how

face recognitions

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum. Author: Kay Firth-Butterfield, Head, Artificial Intelligence and Machine Learning, World Economic Forum & Lofred Madzou, Project Lead, AI & Machine Learning, World Economic Forum & Sébastien Louradour, Fellow, Artifical Intelligence and Machine Learning, World Economic Forum
  • The potential to misuse facial recognition software (FRS) has raised fundamental questions around ethical use, privacy and accessibility.
  • Those developing facial recognition software can develop standards to help ensure ethical and responsible technology design.
Facial recognition software (FRS) has hit the headlines of late and rightly so. Its potential for misuse has raised fundamental questions around ethical use, privacy and accessibility. In some cases, major companies have even halted development and some NGOs have called for total bans.
Such moves have moved some to push for more standardization in the development of facial recognition technology as many realize that it can be used to conduct unacceptable infringement of liberties. The chief of police in one major US city even pointed out that FRS’ low level of accuracy could lead authorities to misidentify someone 96% of the time if officers were to leverage the technology just by itself.
To help mitigate these fears, those developing facial recognition software can develop standards to help ensure ethical and responsible technology design. Such human-centered standards can help forge trust and protect against bias or misapplication.
Artificial Intelligence

What is algorithm bias?

Algorithm bias, also called machine learning bias, is a phenomenon in which algorithms can act in a discriminatory or prejudiced manner due to misplaced assumptions during the learning phase of their development.
Unconscious biases regarding gender, race and social class can make their way into the training data fed by programmers into “machine-learning algorithms”, systems which constantly improve their own performance by including new data into an existing model.
These biases can be observed in the algorithm’s output: erroneous reflected assumptions that can result in embarrassing news coverage.
Some recent stories about accidental algorithm bias include:
Over the past year, the World Economic Forum Artificial Intelligence team found that responsible limits can be set on facial recognition technology. Its AI team worked alongside public and private sectors to develop a unique FRS framework anchored in responsible development for engineers and deployment for policymakers.
The framework is the first to go beyond general principles and to operationalize commercial use cases under the banner of ethical and responsible AI. It comprises four simple steps:
1. Draft principles that define responsible use.
Facial recognition has gained special importance as COVID-19 has pushed contactless services as a safe way to verify identities. While touchless and passwordless technology is the path ahead, companies can pick the direction of travel.
To guide that journey – and prevent misuse – companies can draft a set of ‘Principles for Action’ that define what constitutes responsible facial recognition technology. These principles should focus on 7 key areas to protect users from any misuse of the technology and be developed in consultation with industry players, policymakers, advocacy groups and academics with the goal of reaching a high level of consensus between these stakeholders. These areas include:
  • Privacy: Protecting end user’s personal data
  • Risk assessment: Building processes to mitigate risks of errors and its consequences
  • Proportional use of technology: Assessing the trade-off between usage risks and opportunities
  • Accountability: Defining the responsibility of platform providers and organizations using the technology
  • Consent: Naming the rules for free consent by end-users
  • Accessibility: Making sure the technology accommodates differently-abled people
  • Adaptability: Offering fallback options as situations change and having humans on deck for oversight
To ensure the effective adoption of these Principles for Action, they must be embedded at the core of business operations through internal processes and oversight to lessen potential risks.
Taking these points into consideration can ensure a high level of security and respect of data privacy. Their application could manifest mechanisms such as autodeleting biometric data after 24 hours, conducting impact assessments among designers to identify any potential bias, or designing public signage so passers know when an FRS system is running.
“Human-centered standards can help forge trust and protect against bias or misapplication.”
2. Design systems to support product teams.
In developing ‘responsible by design’ technologies, product teams will need special support, best practices, and systems for testing or quality control. Factors to consider when designing systems to provide this support will include:
  • Facial recognition justification
  • A data plan matching end-user characteristics
  • Bias risk mitigation
  • Methods to inform end-users
To take each factor into account, strong collaborations between the organization using the technology and the platform provider will help ease any risks. For example, in bias risk mitigation, algorithms provided by platform providers must be trained with data that will truly represent the users of the service and the system tested to ensure it acts properly before release. To do so, organizations should assess the diversity of its end-users and share it with the platform provider to train the algorithm accordingly.
 
While acknowledging that biases may still occur, organizations should anticipate this risk by building fallback systems that are robust enough to provide the same level of service to anyone and thus diminish any form of discrimination due to algorithm biases.
3. Auto-assess your work.
Best practices and principles cannot exist in a vacuum. Auto-assessing is a necessary step to check the Principles of Action are being respected and to identify potential blind spots. To that end, an assessment questionnaire can help groups test how well the systems they designed matched the standards they’d set.
For example, when it comes to assessing their proportional use, organizations can check if they have considered alternatives to FRS and documented the reasons they have rejected them. They can also analyse the level of false negatives and false positives and determine if this level is suitable for the use case they deploy. They can also compare their results between skin tones to attest that the system doesn’t produce any form of discrimination.
When gaps are found, the assessment process can drive teams to refer to their best practices to take internal actions to bridge gaps and improve their level of accountability and trustworthiness for their customers.
4. Validate compliance through a third-party audit.
Too often, companies only rely on home-made labels to build transparency among users. The quality of those labels can sometimes be questionable, and also pose a systemic risk of mistrust for the industry that could consequently undermine wider efforts to build transparency.
Being audited by a third and independent party to deliver certification in line with the Principles for Action could be one path forward. Lessons from the accounting industry can be applied, adding additional transparency and safety through independent and accredited agencies. [For example, to draft our FRS framework, the World Economic Forum Artificial Intelligence team partnered with AFNOR Certification, the French leader of certification and assessment services.]
These evaluations should occur right after the deployment of systems for end-users and be conducted regularly to attest to the respect of standards over time. By doing so, certified organizations will be able to communicate among their customers to show their compliance across a range of requirements.
While certification is widely used in many industries and services, facial recognition, despite its high level of scrutiny, is still deployed without any existing certification. We believe that transparency and trust in this field can only be achieved with such mechanisms.
Looking ahead These four steps can help inform the design of responsible systems for flow management use cases in FRS. They can also ensure that their designers and users are effectively compliant with these achievable principles.
Certification is a reachable step towards the regulation of FRS. The cooperation between industry actors, policymakers, academics and civil society on this policy project has shown a strong willingness for standards for the commercial use of FRS.
Yet, Governments have to step in to adopt bills that will ensure a sustainable regulation of FRS along with international standards defining what a responsible use of the technology should be. They also need to address the thorny question of FRS for law enforcement and determine the right levels of oversight and accountability for its related use-cases.
The recent call for regulation by organizations such as IBM, Microsoft and Amazon should be followed by new regulations or guidance or we’ll likely see a deployment of FRS that will lead to mistrust and consumer avoidance.

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

© UN News/Laura Quinones Ambition the cat.

COP31: Ambition goes missing as fossil fuel language drops from draft deal

This article is published in association with United Nations. A cat named Ambition went missing again at COP31 on Thursday. While activists delivered the message with humour, it reflected a serious concern: explicit references to moving away from fossil fuels had disappeared from the latest draft climate agreement. On the eve of the summit’s scheduled […]
This article is published in association with European Investment Bank.

‘Losing the battle’: AI hands predators new ways to target children

This article is published in association with United Nations. Artificial intelligence (AI) is handing predators and criminal groups new ways to groom, extort and exploit children, while efforts to protect them are failing to keep pace, senior UN officials warned on Thursday. “We lost the battle on social media because we were lagging behind, and […]
© UN News/Laura Quinones UN Climate Conference in Antalya, Türkiye.

COP31 deadlock persists as countries launch new ‘climate reality check’

This article is published in association with United Nations. With the clock running down at COP31 in Antalya, countries on Wednesday launched a new global check on whether climate promises are being kept, even as ministers remained deadlocked over some of the summit’s toughest questions: who pays, how fast the world moves away from fossil […]
© UNOCHA/Viktoriia Andriievska A man enters a bombed building in Kyiv, Ukraine.

Ukraine: Civilian casualties in 2026 already far exceed previous years’ tolls

This article is published in association with United Nations. This year has seen dramatically higher civilian casualties in Ukraine than any other year since the full-scale invasion of the eastern European country by Russia in February 2022, the UN Human Rights Monitoring Mission in Ukraine (HRMMU) said on Tuesday. In October 2026, the number of […]
© UN Climate Change/Kubilay Citfci UN Climate Conference in Antalya, Türkiye.

COP31 enters decisive week as climate talks face political test and AI initiatives gather pace

This article is published in association with United Nations. New international initiatives on artificial intelligence and green industrialization showcased technology’s growing role in climate action, even as negotiators remained deadlocked on finance, fossil fuels and adaptation ahead of the final stretch of the UN talks. Today at COP31 As COP31 entered its second and final […]
UN Social Media/ María Fernández del Moral COP31 press conference to launch the Priorities for Action on AI for Climate Information Integrity.

COP31: New initiative targets AI and reliable climate change information

This article is published in association with United Nations. New guidance has been issued to ensure that people everywhere can obtain credible climate change information from artificial intelligence (AI) and understand how the technology impacts the environment. The Priorities for Action on AI and Climate Information Integrity were launched at the COP31 climate conference in […]
UN News A partially collapsed residential building in the city of Deir al-Balah, Gaza, after residents were evacuated amid heavy rain and strong winds.

Six killed in Israeli airstrike on Gaza’s Nasser Hospital

This article is published in association with United Nations. An Israeli airstrike on Gaza’s Nasser Hospital on Wednesday night killed six people, injured 27 others and caused extensive damage. Ramiz Alakbarov, the UN Special Coordinator for the Middle East Peace Process ad interim, on Thursday said he was deeply alarmed by the attack.” The strike […]
© UN News/Laura Quinones Sunrise over COP31 as participants arrived as early as 5am to avoid traffic closures.

‘Make or bake time’: Guterres urges climate justice pact as leaders gather at COP31

This article is published in association with United Nations. UN chief António Guterres called for a new global climate justice agreement at COP31 on Wednesday, urging governments to tax fossil fuel companies to help countries bearing the brunt of a crisis they did little to cause. His appeal came as world leaders gathered in Antalya […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Gaza winter aid: ‘No more delay’, Fletcher tells governments stalling on support

© UNRWA Children play outside tents in Gaza. This article is published in association with United Nations. The UN’s Emergency Relief Coordinator, Tom Fletcher, expressed deep concern about the deteriorating humanitarian situation in Gaza, as UN member states and partners have been repeatedly delaying sending their support to the Strip. “Foreign Ministers and partners have […]
This article is published in association with United Nations.l student with a strong interest in research and global health.

COP31: Energy transition takes centre stage as countries map path beyond fossil fuels

This article is published in association with United Nations. The global energy transition took centre stage on the second day of COP31, as countries explored how to move away from fossil fuels, accelerate clean energy and overcome financial and infrastructure barriers standing in the way. Today at COP31 Energy and Transport Day at COP31 got […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Children among the dead as heavy rains flood tents and shelters in Gaza

This article is published in association with United Nations. An infant reportedly drowned and five Gazans were killed – including three children – when a sand dune collapsed on their tents as the first heavy rains swept across the enclave at the weekend, according to the UN aid coordination office (OCHA). Thousands of families lost […]
© EducAid “Before [this], the difference was huge – I used to carry Anas, and he had to crawl on his hands,” said Anas’s mother.

‘For the first time I have my own chair’: Gaza siblings find new freedom

This article is published in association with United Nations. In Gaza, 10-year-old Anas is one of three siblings born without legs and with only two fingers on each of their hands. They struggle to move around and perform daily activities like eating and writing independently. With funding from the UN’s aid coordination office (OCHA), and […]
© UNICEF A child looks out from a makeshift shelter in Rafah, in the south of the Gaza Strip.

Gunfire damages tents at Rafah displacement site in Gaza, as aid teams prepare for winter storms

This article is published in association with United Nations. Gunfire hit and damaged multiple tents at a displacement site in Gaza’s northern Rafah region on Tuesday, reportedly causing injuries and forcing a humanitarian partner to leave the area, the UN aid coordination office (OCHA) has said. The NGO had been working on flood control ahead […]
© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon..

UN peacekeeping chief warns of ‘security vacuum’ as Blue Helmets leave Lebanon and Western Sahara

© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon.. This article is published in association with United Nations. The UN’s peacekeeping chief warned on Wednesday that the withdrawal of “Blue Helmets” from Lebanon and Western Sahara risks leaving a dangerous security vacuum, while the Security Council remains divided over what, if anything, should […]
© IOM/Haithm Abdulbaqi Young people in Yemen play football on a sandy pitch.

15 years of ‘almost no progress’ in getting young people moving: WHO

This article is published in association with United Nations. One in four adolescents worldwide reported not getting at least 60 minutes of physical activity on any day in the previous week, according to new global estimates released by the World Health Organization (WHO) on Wednesday. That amounts to some 240 million young people aged 11 […]
© UNICEF/Sultan Mahmu A mother and daughter wade through floodwaters in Feni, southeastern Bangladesh.

COP31 explained: What’s at stake at this year’s UN climate summit?

This article is published in association with United Nations. The world has more tools than ever to tackle climate change, yet millions remain unable to benefit from them. As clean energy technologies advance faster than ever, the challenge facing countries at COP31 is no longer just finding solutions – but making sure everyone can afford […]
© UNICEF/Christina Pashkina A school in Chuhuiv, Ukraine, lies in ruins after being hit by a missile.

Air raid alerts and attacks on schools: the devastating face of education in Ukraine

This article is published in association with United Nations. Ukraine has sustained almost 2,000 attacks on education since the full-scale Russian invasion in 2022, with some 270 this year alone, the UN Children’s Fund (UNICEF) said on Tuesday, a day after a strike at a school being used to distribute aid. Tweet URL Since the […]
© UNICEF/Oleksii Filippov People walk past a war-damaged building in Ukraine.

Ukraine: WFP provides hot meals to Oleshky evacuees as UN pushes to restore power before winter

This article is published in association with United Nations. The UN World Food Programme (WFP) is providing emergency food assistance to more than 400 people who were able to leave the Russian-occupied city of Oleshky, in Ukraine’s Kherson region, during a brief local ceasefire. Many arrived in worrying condition at medical facilities in Kyiv on […]

COP17: Nations chart ‘Yerevan Pathway’ to speed up action for nature

This article is published in association with United Nations. At the halfway mark to 2030, countries meeting in Armenia have agreed a roadmap to accelerate action for nature, after a global review found the world off track to meet its biodiversity targets. Agreement was formalised through the Yerevan Pathway as the UN Biodiversity Conference (COP17) […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com