How can we best navigate the frontier of AI regulation?

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Kay Firth-Butterfield, CEO, Good Tech Advisory, Satwik Mishra, Vice President (Content), Centre for Trustworthy Technology


/

  • In March 2023, over 33,000 people in the AI industry signed the Future of Life Institute open letter asking for “all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.”The aim was to bring the huge concerns about generative AI into the mainstream and it has succeeded.Steps are being taken to ensure that AI is only used as a force for good, but there are concerns about whether the resulting AI regulation will be enough.

In March 2023, over 33,000 individuals involved with the design development and use of AI signed the Future of Life Institute open letter asking for “all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4.” This was never expected to happen, but the aim was to bring the huge concerns about generative AI into the mainstream. In July, the White House unveiled a framework of voluntary commitments for regulating AI. Evidently, American policymakers are paying attention. Central to these safeguards are the principles of promoting ‘safety, security and trust.’ Seven prominent AI companies have consented – Amazon, Anthropic, Google, Inflection, Meta, Microsoft, and OpenAI.They have agreed upon: Internal and external independent security testing of AI systems before public release; sharing of best practices; investing in cybersecurity; watermarking generative AI content; publicly sharing capabilities and limitations and investing in mitigating societal risks, such as bias and misinformation.

Discover

How is the World Economic Forum creating guardrails for Artificial Intelligence?

In response to the uncertainties surrounding generative AI and the need for robust AI governance frameworks to ensure responsible and beneficial outcomes for all, the Forum’s Centre for the Fourth Industrial Revolution (C4IR) has launched the AI Governance Alliance. The Alliance will unite industry leaders, governments, academic institutions, and civil society organizations to champion responsible global design and release of transparent and inclusive AI systems.

The positive takeaways

This announcement sends a resounding message to the market that AI development shouldn’t harm the social fabric. It follows through on demands from civil society groups, leading AI experts and some AI companies emphasizing the need for regulation. It reveals an upcoming executive order and legislation on AI regulation. Finally, it highlights ongoing international-level consultation, both bilaterally with several countries and at the UN, the G7 and the Global Partnership on AI led by India. This paved the way for meaningful outcomes at recent and upcoming international summits, including the upcoming G20 summit in India this week and the AI Safety summit in the UK in November.However, can we afford to be complacent? The White House announcement demands an unwavering follow-through. It shouldn’t be an eloquent proclamation of ideals, failing to drive any significant change in the status quo.

The concerns

These are voluntary safeguards. They don’t enforce accountability on the companies for all purposes, but merely request action. There is very little that can be done if a company doesn’t or only reluctantly enforces these safeguards. Further, many of the safeguards, enlisted in the announcement are found in documents published by these companies. For instance, security testing or what is called ‘red teaming’ is carried out by Open AI before it releases its models to the public and yet we see the problems writ large.These seven companies do not encompass the entire industry landscape, for example, Apple and IBM are missing. To ensure a collective and effective approach, mechanisms should hold every actor, especially potentially bad actors, accountable and incentivize broader industry compliance. Adhering to the voluntary safeguards doesn’t comprehensively address the varied challenges that AI models present. For instance, one of the voluntary safeguards announced by the White House is “investing in cybersecurity and insider threat safeguards to protect proprietary and unreleased model weights.” Model weights are the core components determining functionality. Access to them is considered a proxy for being able to reconstruct the model with threshold compute and data. This is just one source of vulnerability, however. Models trained on biased or incorrect data, for instance, can still lead to vulnerabilities and malfunctioning systems when released to the public. Additional safeguards need to be designed and implemented to tackle these intricate issues effectively.

Urging companies to invest in trust and safety is ambiguous. AI safety research at companies substantially pales in comparison to development research. For example, of all the AI articles published till May 2023, a mere 2% focus on AI safety. Within this limited body of AI safety research, only 11% originates from private companies. In this context, it is difficult to anticipate that voluntary guidelines alone will be enough to alter this pattern.

Finally, AI models are rapidly being developed and deployed globally. Disinformation, misinformation and fraud, amongst other harms, perpetuated by unregulated AI models in foreign countries have far-reaching repercussions, even within the US. Merely creating a haven in the US might not be enough to shield against the harms caused by unregulated AI models from other nations.Hence, more comprehensive and substantive steps are needed within the US and in collaboration with global partners to address the varied risks. Firstly, an agreement on a standard for testing AI model safety before its deployment anywhere in the world would be a great start. The G20 summit and UK summit on AI safety are critical forums in this regard.Secondly, we need enforceability of any conceived standards via national legislation/executive action as deemed fit by different countries. The AI Act in Europe can be a great model for this endeavour. Thirdly, we need more than a call to principles and ethics to make these models safe. We need engineering safeguards. Watermarking generative AI content assuring information integrity is a good example of this urgent requirement. Implementing identity assurance mechanisms on social media platforms and AI services, which can help identify and address the presence of AI bots, enhancing user trust and security could be another formidable venture. Finally, national governments must develop strategies to fund, incentivize and encourage AI safety research in the public and private sectors. The White House’s intervention marks a significant initial action. It can be the catalyst for responsible AI development and deployment within the US and beyond, provided, this announcement is a springboard to push forth more tangible regulatory measures. As the announcement emphasizes,

implementing carefully curated “binding obligations” would be crucial for ensuring a safe, secure and trustworthy AI regime.

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

This article is published in association with United Nations.

Middle East war shockwaves ripple through Asia-Pacific fuel and supply chains

This article is published in association with United Nations. The fallout from the war in the Middle East is rippling far beyond the Gulf, disrupting fuel supplies, shipping routes and supply chains across Asia and the Pacific, with some of the region’s most vulnerable economies already feeling the strain through rising prices, rationing and threats to […]
© WFP/Jaber Badwan A woman carries food rations distributed by the World Food Programme in Almaghazi, Gaza.

Humanitarian needs in Gaza deepen as aid access remains constrained

This article is published in association with United Nations. Humanitarian needs are continuing to grow again across Gaza, the UN agency assisting Palestine refugees (UNRWA) said on Wednesday, amid mounting pressures on aid delivery and the ongoing conflict in the Middle East.  “Families face ongoing hardship” as access to essential aid remains limited and many continue […]
© WFP/Khadija Dia Food is distributed to displaced families sheltering in a school in Tariq Jdide, Beirut.

Middle East war risks pushing 45 million more people into acute hunger

This article is published in association with United Nations. The Middle East war could cause the worst disruption to lifesaving humanitarian work since COVID, the UN World Food Programme (WFP) warned on Tuesday, as the UN chief again demanded an end to the widening conflict. “The Secretary-General asserts once more that the war in the Middle […]
© World Vision Smoke rises in Beit Mery, close to the Lebanese capital, Beirut, following an airstrike.

Middle East war’s ‘spiral of conflict’ drives mounting civilian toll

This article is published in association with United Nations. The widening war in the Middle East and its growing impact on civilians came under scrutiny at the UN in Geneva on Monday, as independent experts briefing the Human Rights Council warned of escalating violence following the onset of Israeli and US strikes on Iran and counterstrikes […]
© Mousawat A mother and child displaced by the conflict in Lebanon receiving care at a clinic.

Middle East war: Women in Lebanon forced to give birth on roadside

This article is published in association with United Nations. As the UN Secretary-General touched down in Beirut on Friday in solidarity with the people of Lebanon, UN agencies highlighted the dangers for civilians and particularly pregnant women and migrant workers, amid ongoing airstrikes and rocket fire between Hezbollah fighters and Israel.  “There’s 11,600 pregnant women who […]
© WFP/Arete/Ali Yunes Some residents of Beirut who have been displaced by the conflict are now living on the streets of the Lebanese capital.

‘Perfect storm’: Lebanon crisis deepens as civilians bear the brunt

This article is published in association with United Nations. Lebanon is facing a “perfect storm of unpredictable challenges” as conflict, mass displacement and dwindling humanitarian resources converge, the UN’s Resident and Humanitarian Coordinator in Lebanon, Imran Riza, has warned. The current escalation began on 2 March, when outgoing fire by Hezbollah drew a strong retaliation from […]
© WFP/Maxime Le Lijour People living in Gaza have received humanitarian aid from the UN throughout the conflict with Israel.

UN relief chief condemns ‘$1 billion-a-day’ cost of war in Middle East

This article is published in association with United Nations. The UN’s emergency relief chief on Wednesday condemned the “$1 billion-a-day” cost of the war in the Middle East, at a time when humanitarian needs are soaring and aid funding is falling dangerously short. “We’re seeing the consequences spread faster than we can respond”, warned the UN emergency […]
© UNICEF/Azizullah Karimi Afghan returnees from Iran gather at the Islam-Border, near Herat in western Afghanistan (file).

‘Toxic rain’ warning from oil depot strikes amid ongoing Middle East war

This article is published in association with United Nations. Toxic “black rain” linked to strikes on oil depots, mass displacement and continuing disruption to aid supply chains are upending lives across the Middle East and beyond after 10 days of war in the region, UN humanitarians said on Tuesday.  Speaking to reporters in Geneva, UN Human […]
© UNHCR People gather at the Masnaa border point in Lebanon as they wait to cross into Syria.

Nearly 700,000 displaced in Lebanon as Middle East crisis escalates

This article is published in association with United Nations. On day 10 of the war engulfing the Middle East, UN agencies on Monday reported massive displacement across the region, along with surging food and fuel prices that risk increasing hunger and suffering for the most vulnerable. In Lebanon alone, nearly 700,000 people including around 200,000 children […]
UN Photo/Pasqual Gorriz Smoke rises in Beirut, Lebanon, following the outbreak of hostilities across the Middle East.

Lebanon ‘dragged back into turmoil’, UN envoy warns

This article is published in association with United Nations. Lebanon has been “dragged back into a state of turmoil and violence”, the UN’s top envoy in the country warned on Saturday, after the latest round of regional strikes triggered a fast‑escalating crisis along the Blue Line. What had been fragile but real momentum, she said, has […]
UNHCR Smoke rises after an airstrike in Beirut, Lebanon.

MIDDLE EAST LIVE: Strikes continue across Middle East as humanitarian concerns grow

This article is published in association with United Nations. Highlights Production team: Vibhu Mishra with Daniel Johnson in GenevaToday 12:15 μ.μ. UN rights office warns displacement orders in Lebanon affecting hundreds of thousands The UN human rights office has warned that large-scale displacement orders and ongoing airstrikes in Lebanon are worsening the suffering of civilians already affected […]
© UNICEF/Ramzi Haidar Destroyed buildings and debris in the southern suburbs of Beirut, Lebanon, following airstrikes.

MIDDLE EAST LIVE: Further escalation drives uncertainty and suffering

This article is published in association with United Nations. On day six of the war in the Middle East, there’s been no let-up in bombs, drones and rockets targeting Iran, Israel, Lebanon and many Gulf States, while NATO forces reportedly intercepted a missile fired at Türkiye by Iran, a claim denied by Tehran. We’ll bring you […]
UN Photo/Pasqual Gorriz Smoke rises in Beirut, Lebanon, following the outbreak of hostilities across the Middle East.

MIDDLE EAST LIVE: Conflict continues across region amid US, Israeli and Iranian strikes

This article is published in association with United Nations. Violence in the Middle East is continuing into a fifth day, with US and Israeli strikes against Iran and Iranian missile and drone attacks reported across several countries in the region. The escalating confrontation is disrupting airspace, transport and daily life while raising fears of a wider […]
© IAEA/Paolo Contri The Bushehr Nuclear Power Plant in Iran.

Iran crisis: Schoolgirls killed, thousands displaced and aid compromised

This article is published in association with United Nations. On the fourth day of Israeli and United States airstrikes against Iran and amid growing violence and instability in the Middle East, the UN urgently called for protection of civilians and warned of growing displacement and humanitarian needs. UN human rights office spokesperson Ravina Shamdasani also recalled […]
© Unsplash/Kamran Gholami Tehran, the capital of Iran. (file photo)

MIDDLE EAST LIVE: Strikes continue from US, Israel and Iran as UN urges restraint

This article is published in association with United Nations. Violent escalation in the Middle East has entered a third day as coordinated US and Israeli strikes against Iran aimed at regime change continue to cause loss of life and damage across the region, prompting Iranian missile and drone counter-strikes hitting targets in multiple countries. Explosions, airspace […]
Iran attacks

Deadly bombing of Iran primary school ‘a grave violation of humanitarian law’: UNESCO

This article is published in association with United Nations. The UN education agency, UNESCO, says that the bombing of a primary school during the US and Israeli military attacks on Iran on Saturday constitutes a grave violation of humanitarian law. The missiles reportedly destroyed a girl’s primary school in Minab, southern Iran, killing around 150 and […]
© UNRCO Iran Tehran, the capital of Iran.

Attacks on Iran and retaliatory strikes ‘undermine international peace and security’

This article is published in association with United Nations. UN Secretary-General António Guterres and the heads of UN agencies have condemned Saturday’s joint Israeli and US attacks on Iran and the Iranian retaliatory strikes on Israel and the Gulf Regions. The attack on Iran reportedly targeted military sites as well as the leadership of the Iranian […]
© WFP/Maxime Le Lijour A woman holds a child as a storm approaches Khan Younis in Gaza.

Palestine: UN rights chief highlights suffering, atrocity crimes ‘that remain unpunished

This article is published in association with United Nations. The UN rights chief Volker Türk on Thursday highlighted the “human-made disaster” across the Occupied Palestinian Territory stemming from Israel’s disregard for human rights norms and serious violations also committed by Hamas and other Palestinian armed groups. Citing a new report from his office (OHCHR) covering the […]
Ángela Soria Pitarch was born on March 28, 2003. She is currently a fifth-year medical student at the University of Valencia.

Not the Future, the Present: Young Voices Shaping Global Health in 2026

This article was exclusively written for The European Sting by Ms. Ángela Soria Pitarch was born on March 28, 2003. She is currently a fifth-year medical student at the University of Valencia. She is affiliated with the International Federation of Medical Students Associations (IFMSA), cordial partner of The Sting. The opinions expressed in this piece belong strictly to […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com