How can we best navigate the frontier of AI regulation?

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Kay Firth-Butterfield, CEO, Good Tech Advisory, Satwik Mishra, Vice President (Content), Centre for Trustworthy Technology


/

  • In March 2023, over 33,000 people in the AI industry signed the Future of Life Institute open letter asking for “all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”The aim was to bring the huge concerns about generative AI into the mainstream and it has succeeded.Steps are being taken to ensure that AI is only used as a force for good, but there are concerns about whether the resulting AI regulation will be enough.

In March 2023, over 33,000 individuals involved with the design development and use of AI signed the Future of Life Institute open letter asking for “all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.” This was never expected to happen, but the aim was to bring the huge concerns about generative AI into the mainstream. In July, the White House unveiled a framework of voluntary commitments for regulating AI. Evidently, American policymakers are paying attention. Central to these safeguards are the principles of promoting ‘safety, security and trust.’ Seven prominent AI companies have consented – Amazon, Anthropic, Google, Inflection, Meta, Microsoft, and OpenAI.They have agreed upon: Internal and external independent security testing of AI systems before public release; sharing of best practices; investing in cybersecurity; watermarking generative AI content; publicly sharing capabilities and limitations and investing in mitigating societal risks, such as bias and misinformation.

Discover

How is the World Economic Forum creating guardrails for Artificial Intelligence?

In response to the uncertainties surrounding generative AI and the need for robust AI governance frameworks to ensure responsible and beneficial outcomes for all, the Forum’s Centre for the Fourth Industrial Revolution (C4IR) has launched the AI Governance Alliance. The Alliance will unite industry leaders, governments, academic institutions, and civil society organizations to champion responsible global design and release of transparent and inclusive AI systems.

The positive takeaways

This announcement sends a resounding message to the market that AI development shouldn’t harm the social fabric. It follows through on demands from civil society groups, leading AI experts and some AI companies emphasizing the need for regulation. It reveals an upcoming executive order and legislation on AI regulation. Finally, it highlights ongoing international-level consultation, both bilaterally with several countries and at the UN, the G7 and the Global Partnership on AI led by India. This paved the way for meaningful outcomes at recent and upcoming international summits, including the upcoming G20 summit in India this week and the AI Safety summit in the UK in November.However, can we afford to be complacent? The White House announcement demands an unwavering follow-through. It shouldn’t be an eloquent proclamation of ideals, failing to drive any significant change in the status quo.

The concerns

These are voluntary safeguards. They don’t enforce accountability on the companies for all purposes, but merely request action. There is very little that can be done if a company doesn’t or only reluctantly enforces these safeguards. Further, many of the safeguards, enlisted in the announcement are found in documents published by these companies. For instance, security testing or what is called ‘red teaming’ is carried out by Open AI before it releases its models to the public and yet we see the problems writ large.These seven companies do not encompass the entire industry landscape, for example, Apple and IBM are missing. To ensure a collective and effective approach, mechanisms should hold every actor, especially potentially bad actors, accountable and incentivize broader industry compliance. Adhering to the voluntary safeguards doesn’t comprehensively address the varied challenges that AI models present. For instance, one of the voluntary safeguards announced by the White House is “investing in cybersecurity and insider threat safeguards to protect proprietary and unreleased model weights.” Model weights are the core components determining functionality. Access to them is considered a proxy for being able to reconstruct the model with threshold compute and data. This is just one source of vulnerability, however. Models trained on biased or incorrect data, for instance, can still lead to vulnerabilities and malfunctioning systems when released to the public. Additional safeguards need to be designed and implemented to tackle these intricate issues effectively.

Urging companies to invest in trust and safety is ambiguous. AI safety research at companies substantially pales in comparison to development research. For example, of all the AI articles published till May 2023, a mere 2% focus on AI safety. Within this limited body of AI safety research, only 11% originates from private companies. In this context, it is difficult to anticipate that voluntary guidelines alone will be enough to alter this pattern.

Finally, AI models are rapidly being developed and deployed globally. Disinformation, misinformation and fraud, amongst other harms, perpetuated by unregulated AI models in foreign countries have far-reaching repercussions, even within the US. Merely creating a haven in the US might not be enough to shield against the harms caused by unregulated AI models from other nations.Hence, more comprehensive and substantive steps are needed within the US and in collaboration with global partners to address the varied risks. Firstly, an agreement on a standard for testing AI model safety before its deployment anywhere in the world would be a great start. The G20 summit and UK summit on AI safety are critical forums in this regard.Secondly, we need enforceability of any conceived standards via national legislation/executive action as deemed fit by different countries. The AI Act in Europe can be a great model for this endeavour. Thirdly, we need more than a call to principles and ethics to make these models safe. We need engineering safeguards. Watermarking generative AI content assuring information integrity is a good example of this urgent requirement. Implementing identity assurance mechanisms on social media platforms and AI services, which can help identify and address the presence of AI bots, enhancing user trust and security could be another formidable venture. Finally, national governments must develop strategies to fund, incentivize and encourage AI safety research in the public and private sectors. The White House’s intervention marks a significant initial action. It can be the catalyst for responsible AI development and deployment within the US and beyond, provided, this announcement is a springboard to push forth more tangible regulatory measures. As the announcement emphasizes,

implementing carefully curated “binding obligations” would be crucial for ensuring a safe, secure and trustworthy AI regime.

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

This article is published in association with European Investment Bank.

EU provides €61 million in humanitarian aid amidst rapidly deteriorating situation in Ethiopia

This article is brought to you in association with the European Commission. Amid fears of renewed conflict in Northern Ethiopia, the European Union is providing €61 million in humanitarian funding to help the most vulnerable people in Ethiopia affected by conflict, displacement, disease outbreaks and climate-related hazards, including the impact of El Niño. The European Union […]
© UNDP A worker installs solar panels in Lanao del Sur in the Philippines.

From energy crisis to energy transition: How renewables are reshaping energy security

This article is published in association with United Nations. The continuing conflict in the Middle East is disrupting global energy markets and pushing up fuel prices, with knock-on effects far beyond the region. For Francesco La Camera, Director-General of the International Renewable Energy Agency (IRENA), the crisis is also reshaping how the world understands the phrase […]
Countries adopted on Saturday a new global blueprint for tackling rapidly evolving forms of crime, as the UN’s largest gathering on crime prevention and criminal justice opened in Abu Dhabi with a call for stronger international cooperation. The Abu Dhabi Declaration was adopted by acclamation at the opening of the 15th United Nations Congress on Crime Prevention and Criminal Justice, bringing governments together around challenges ranging from cybercrime and fraud to the growing criminal exploitation of digital technology. The Declaration highlights an increasingly complex landscape in which services, infrastructure and technology can be exploited by criminals, including emerging trends described as “crime as a service” and “violence as a service”. At the same time, countries committed to making greater use of technology themselves, including by digitalizing justice systems and harnessing artificial intelligence in criminal justice responses. The Declaration stresses that safeguards must accompany those changes, including human oversight, transparency, due process and data protection. ‘Justice cannot be a privilege’ In a video message to the Congress, UN Deputy Secretary-General Amina Mohammed said the meeting was taking place at a time of profound change. “Justice cannot be a privilege. It must protect every person, uphold every person’s rights and leave no one behind,” said Ms. Mohamed. “This Congress is an opportunity to renew our shared commitment to justice and the rule of law, and to translate that commitment into action.” Countries are already being encouraged to put the Declaration into practice through the voluntary Pledge4Justice initiative, under which participating governments are announcing concrete, time-bound actions on crime prevention and criminal justice through 2031. The Abu Dhabi National Exhibition Centre with its curved glass tower and surrounding buildings reflected in calm water at dusk. UNODC The Abu Dhabi National Exhibition Centre where the 15th UN Crime Congress is set to take place. From Kyoto to Abu Dhabi Opening the Congress, UN Office on Drugs and Crime (UNODC) Executive Director Monica Juma framed the gathering as both a response to a changing criminal landscape and a test of international cooperation. “Today, the world convenes in Abu Dhabi to reaffirm that the rule of law and criminal justice are essential to the safety and security of people and the planet,” said Ms. Juma. “At a time when confidence in multilateralism is faltering, let Abu Dhabi be a testament to international cooperation.” Five years after the previous Congress in Kyoto, Japan, Ms. Juma said the world had reached another “inflection point”, with technology and artificial intelligence advancing at extraordinary speed. The same platforms connecting billions of people can also connect criminals, she warned, while digital currencies can conceal illicit profits and digital tools can be used to deceive, manipulate and exploit. Technology, she argued, is not simply accelerating crime but changing its character, while organized criminal networks increasingly exploit weaknesses across borders and institutions. Tweet URL Protecting people as the ‘north star’ Behind those broad trends, Ms. Juma urged delegates to focus on the people most exposed to harm, including children recruited by gangs, women facing violence at home or online, people unable to obtain legal assistance and young people lured into scam networks with promises of a better future. “Protecting these people must be the measure against which we judge our efforts over the coming week,” she said. “It must be our north star.” She called for laws and institutions capable of keeping pace with changing threats, greater access to justice and legal aid, and technology that serves as “a force for good” rather than an accelerator of harm. And while welcoming the Abu Dhabi Declaration as a starting point, Ms. Juma stressed that its impact would ultimately depend on implementation. A week focused on justice Hosted by the United Arab Emirates, the Congress runs through 1 October under the theme Protecting People and Planet in the Digital Age. Some 119 countries are represented, alongside more than 40 justice ministers and other senior officials, with over 5,100 participants from governments, civil society, academia and the private sector. Plenary meetings, workshops, side events and exhibitions will run throughout the session. Organizers are also billing this as the most youth-inclusive Crime Congress yet. Young people are participating in workshops, contributing to follow-up efforts and taking part in a dedicated Youth Lab and art exhibition, following a Youth Forum held ahead of the Congress on 24 and 25 September. UNODC serves as secretariat of the Congress and will support implementation of the Abu Dhabi Declaration.

Countries adopt global blueprint to tackle fast-evolving crime in digital age

This article is published in association with United Nations. Countries adopted on Saturday a new global blueprint for tackling rapidly evolving forms of crime, as the UN’s largest gathering on crime prevention and criminal justice opened in Abu Dhabi with a call for stronger international cooperation. The Abu Dhabi Declaration was adopted by acclamation at the […]
United Nations President Mahmoud Abbas of the State of Palestine addresses the General Debate of the UN General Assembly’s 81st session.

Palestinian existence under threat, Abbas tells UN, warning of ‘another Nakba’

This article is published in association with United Nations. Israeli policies now threaten “the very life and existence of the Palestinian people on their homeland”, Palestinian President Mahmoud Abbas told the UN General Assembly on Thursday, urging the world not to allow “another Nakba”.  Mr. Abbas addressed the Assembly’s annual debate via pre-recorded video after his […]
© UNICEF/Oleksii Filippov A rescue worker stands outside a residential building in Kyiv’s Solomianskyi district that was severely damaged during a massive overnight attack on the city.

World News in Brief: ‘New intensity’ to Russian attacks on Ukraine, Yemen, Gaza and Colombia updates

This article is published in association with United Nations. Russian armed forces have carried out repeated attacks across Ukraine over the past several days, killing and injuring civilians and damaging homes, hospitals, shops and workplaces, UN human rights monitors said on Thursday. The attacks have involved ballistic and cruise missiles, drones and guided aerial bombs. Between […]
UN Photo/Loey Felipe President Volodymyr Zelenskyy of Ukraine addresses the General Debate of the UN General Assembly’s 81st session.

Zelenskyy urges stronger pressure on Russia, warns war’s impact is spreading beyond Ukraine

This article is published in association with United Nations. Ukrainian President Volodymyr Zelenskyy on Wednesday called for intensified pressure on Russia to end its war against Ukraine, arguing that Moscow continues to incur massive losses while prolonging a conflict whose consequences are increasingly being felt far beyond the battlefield. Addressing the UN General Assembly’s annual debate, […]
UN Photo/Loey Felipe President Donald Trump of the United States addresses the General Debate of the UN General Assembly’s 81st session.

Trump defends military action against Iran, Venezuela, and calls for rebrand of AI

This article is published in association with United Nations. US President Donald Trump used his address to the UN General Assembly on Tuesday to defend recent military action against Iran, urging countries to maintain economic pressure on Tehran – and declaring that he now faces a choice between making a deal, or taking far more drastic […]
© UNICEF/Oleksii Filippov An injured girl climbs the partially collapsed stairwell of a building in Boryspil, Ukraine, following a missile strike.

‘Nowhere is safe’: UN experts detail Ukraine war’s toll and Russia’s reach beyond its borders

This article is published in association with United Nations. UN Human Rights Council-appointed experts on Monday laid out a grim picture of the human cost of Russia’s invasion of Ukraine, with a spotlight on civilians facing a third wartime winter as well as the intimidation of Russians who have fled abroad. The Independent International Commission of Inquiry […]
© UNICEF/Robic Upadhayay Aid workers transport supplies past a flood-damaged house in Nepal.

Nepal floods: ‘Apocalyptic’ destruction signals wider climate threat across Himalayas

This article is published in association with United Nations. The catastrophic flooding that swept away entire villages in northern Nepal could occur again in the country or elsewhere in the Himalayas due to climate change. The warning comes from Sara Netzer, regional director with UN field operations office UNOPS, which provides infrastructure, procurement and project management […]
This article is published in association with United Nations.

World News in Brief: Winter aid for Gaza, West Bank; Haiti food production; migrant deaths at sea; human rights funding

The UN Children’s Fund (UNICEF) is seeking to raise $97.5 million to protect 540,000 children and their families in Gaza and the West Bank from harsh winter conditions in the coming months. Nearly 84 per cent of Gaza’s population – more than 1.76 million people – live in overcrowded displacement sites or damaged shelters, leaving […]
© UNRWA Search-and-rescue operations continue following the collapse of a war-damaged building in Gaza city.

Gaza: At least 20 killed in deadly building collapse, search for survivors continues

This article is published in association with United Nations. Search and rescue operations continued in Gaza City on Wednesday following the collapse of a bombed-out building that killed at least 20 people, according to reports. The incident has highlighted the precarious situation of displaced Palestinians across the Gaza Strip who shelter wherever they can, including in […]
UN News/Nargiz Shekinskaya The UN HQ (Secretariat) building in Manhattan.

The world comes to New York: What’s at stake at UN General Assembly high-level week

This article is published in association with United Nations. Each September, New York becomes the centre of global diplomacy as presidents, prime ministers, ministers and diplomats from around the world gather at United Nations Headquarters. At a time of mounting geopolitical tensions and overlapping global crises, leaders will tackle a packed agenda that includes conflicts and […]

Six UN staff killed in Gaza school strike; Lebanon violations mount

This article is published in association with United Nations. Israeli strikes killed six UN workers and civilians at a school sheltering displaced families in Gaza as needs grow, according to the UN agency for Palestine refugees, UNRWA. At least 220 agency staff have been killed in Gaza since the Hamas-Israel war began in October 2023. UNRWA Acting […]
This article is published in association with United Nations.

‘Where do we go?’: How Israel’s ‘yellow line’ is closing in on Palestinians

This article is published in association with United Nations. Ola Ishtiwi sits with her children in front of the remains of her home in the Al-Tuffah neighbourhood in eastern Gaza City, a few metres away from a series of painted cement blocks Israel has placed to mark what has become known as the “yellow line”. Initially set up following the announcement of the Israel-Hamas ceasefire […]
© UNDP/Oleksandr Ratushniak A substation in Ukraine damaged during ongoing strikes in the war with Russia.

Ukraine: Drone attacks on Chornobyl are ‘gambling with the safety of millions of people’

This article is published in association with United Nations. A drone strike on the protective structure at the Chornobyl Nuclear Power Plant could have endangered the safety of millions of people, UN Development Programme (UNDP) Administrator Alexander De Croo told reporters via video link from Kyiv on Thursday. He is visiting Ukraine, with his mission focused […]
© UNHCR/Dar Al Mussawir Smoke rises above residential neighborhoods in Tyre, southern Lebanon, following an Israeli airstrike. (file)

UN chief demands Israeli withdrawal from Lebanon amid Nabatieh escalation

This article is published in association with United Nations. The Secretary-General has condemned mounting civilian casualties in southern Lebanon and called on Israel to withdraw its forces from Lebanese territory, as fighting intensifies in and around Nabatieh. Key points In a statement issued by his Spokesperson, Stéphane Dujarric, the Secretary-General said he was “deeply concerned” by […]
© UNHCR/Dar Al Mussawir Smoke rises above residential neighborhoods in Tyre, southern Lebanon, following an Israeli airstrike. (file)

UN chief demands Israeli withdrawal from Lebanon amid Nabatieh escalation

This article is published in association with United Nations. The Secretary-General has condemned mounting civilian casualties in southern Lebanon and called on Israel to withdraw its forces from Lebanese territory, as fighting intensifies in and around Nabatieh. Key points In a statement issued by his Spokesperson, Stéphane Dujarric, the Secretary-General said he was “deeply concerned” by […]
© UNOCHA/Viktoriia Andriievska The aftermath of a drone strike in Kyiv, Ukraine (file). UN High Commissioner for Human Rights Volker Türk (file) said on Monday that he was "horrified" by the thought of fully autonomous weapons being used in battle.

AI: Türk urges action before it becomes an ‘existential risk to humanity’

This article is published in association with United Nations. UN human rights chief Volker Türk added his voice on Monday to growing calls for greater AI controls, warning that the revolutionary technology could become an “existential risk to humanity” if left unchecked. Without binding rules, independent oversight and clear limits, the technology could become impossible to […]
This article is published in association with United Nations.

As wildfires spread north, UN agencies race to help Europe adapt

This article is published in association with United Nations. As the climate warms, the threat of wildfires is spreading in Europe. How can historically cooler and wetter countries prepare? Human activity causes most of the wildfires breaking out across Europe, but their spread, speed and intensity are strongly affected by the warmer, drier conditions associated with […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com