How to address digital safety in the metaverse

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Cathy Li, Entertainment and Sport Industries, World Economic Forum & Farah Lalani, Global Coalition for Digital Safety, World Economic Forum


  • With digital risks already being high, especially for vulnerable groups, safety risks could be more prevalent in the metaverse.
  • There are numerous ways such risks could be exacerbated in the metaverse. Unwanted contact could become more intrusive. The rise of virtual currencies is another challenge.
  • Finding ways to incentivize better behaviors and reward positive interactions may need to become a bigger part of a safer digital future.

As buzz around the metaverse increases, many are raising concerns about the potential risks in an environment where the boundaries between the physical and virtual worlds continue to blur.

The metaverse is a virtual reality world characterized by a three-dimensional, multi-sensory experience (as compared to the current two-dimensional internet – text and images on flat screens). According to some experts, the closest thing to the metaverse today can be seen in games like Fortnite and experiences on Roblox.

Constructing ecosystems of trust

Addressing the necessity of constructing trusted ecosystems within the technologies developed for the metaverse is a critical consideration. These trusted ecosystems will constitute building in algorithms, structures, frameworks, regulations and policies within hardware and software development cycles to address the distinct elements of safety, privacy, and security within the DNA of the technology.

How data is shared within virtual worlds will need to be considered more carefully to ensure privacy. A second dimension to be considered within the privacy considerations of the metaverse’s development is eliminating biases that will lead to a non-inclusive or malicious adaptation of the real world. Engaging in the metaverse will constitute of a utilization of integrative emerging technologies. This calls for a global thorough open-box security validation process of the protection provided within the environments against breach of confidentiality, integrity, or other aspects of security.

These ecosystems of trust will contribute to creating a stable, inclusive and purposeful existence of a virtual and immersive existence.

How might these risks unfold in the metaverse?

To understand how risks to safety could become more prevalent in the metaverse, a key construct of this digital future should be shared: “Central to the concept of the metaverse is the idea that virtual, 3D environments that are accessible and interactive in real time will become the transformative medium for human engagement. If they are to become practical, these environments will be dependent on widespread adoption of extended reality.”

Even if not a fully immersive existence, it is likely that many people spend more time blending offline and virtual interactions, moving towards a mixed reality (MR). Privacy and security breaches are pathways that can compromise the safety of interactions and users. For example, this could take the form of someone masquerading as a medical doctor to gain access to surgical theatre technology for digitally-performed surgeries.

A good sense of the potential risks can be found in some existing applications that create “virtual worlds” such as on many gaming platforms. It is clear that there are significant safety challenges that have already presented themselves in these environments. For example, recreations of the 2019 Christchurch mosque shooting aimed at very young children have been found multiple times on the Roblox platform despite significant efforts on the company’s part to stem the tide of such content.

Violent extremist and terrorist content isn’t the only harm in such virtual worlds. Recently, on Facebook’s Oculus Quest VR Headset an employee experienced a racist tirade that lasted several minutes whilst playing Rec Room and was unable to identify or report the user. Groping has also been a problem that has emerged in the metaverse, for a variety of reasons.

Where do we stand on digital risks today?

Taking a step back and looking at the current digital context, the risks of harm are already growing. According to the latest Global Threats Assessment Report by the WEProtect Global Alliance, 1 in 3 (34%) respondents to their Economist Impact global survey, were asked to do something sexually explicit online they were uncomfortable with during childhood. In addition, The Internet Watch Foundation saw a 77% rise in child ‘self-generated’ sexual material from 2019 to 2020.

In order to address safety in a comprehensive way as the metaverse emerges, we need to partner with others in government, industry, academia and civil society.—Antigone Davis, Global Head of Safety, Meta

Even before COVID-19, more than half of girls and young women had experienced online abuse, according to a global poll last year by the Web Foundation, an organization cofounded by the inventor of the web, Tim Berners-Lee. Sharing images, videos or private information without consent – known as doxxing – was the most concerning issue for girls and young women globally, according to the Web Foundation poll. One in four Black Americans and one in 10 Hispanic Americans have faced discrimination online as a result of their race or ethnicity, compared to only three percent of white Americans. The risks are already high, especially for vulnerable groups.

“Contributing to the metaverse in a responsible manner will require research, collaboration, and investment in safety as it relates to XR,” Antigone Davis, Global Head of Safety at Meta explains. ” For example, we are investing in controls that allow users to manage and report problematic content and conduct as well as safety tooling designed for immersive experiences. But we cannot do this alone. In order to address safety in a comprehensive way as the metaverse emerges, we need to partner with others in government, industry, academia and civil society.”

This matters significantly given that digital risks in the metaverse will feel more real based on how our brains interpret immersive experience; Mary Anne Franks, president of the Cyber Civil Rights Initiative, noted in her paper on virtual and augmented reality that research indicates abuse in VR is “far more traumatic than in other digital worlds.”

How might the risks be exacerbated in the metaverse?

There are numerous ways that current risks could be exacerbated in the metaverse. Firstly, depending on how these digital spaces are governed, there are risks of unwanted contact in a more intrusive multimodal environment. Today, if someone who we don’t know or don’t want to engage with, reaches out by messaging, friending, or otherwise trying to contact us on platforms such as Instagram, Facebook, etc. their ability to contact is mostly limited to extending text-based messages, photos, emojis, etc.

However, imagine an unwanted individual being able to come into someone’s virtual space and “get up close” with that person in the metaverse. Without robust mechanisms to report, prevent, and act on this this in real-time, this could lead to unwanted conduct. With haptic technology, the risks that harms in the metaverse will feel more “real” are not far-fetched given that many companies are working to incorporate touch as an additional sensation in an immersive reality.

For example, haptic gloves being developed by many organizations aim to provide tactile feedback to provide more precise and realistic feel to any motion. While of course, this can create a better sense of reality and increase connectedness in a virtual environment, this can also potentially be abused by bad actors in ways that may not be fully understood just yet.

The harmful content that proliferates all too quickly in our current digital lives, may also translate in the metaverse to more graphic, 3D, and auditory unwanted content that feels more intrusive and has a greater impact due to the multisensory nature of the environment in which it is propagated.

The rise of virtual currencies can often be another challenge in the proliferation of harmful content and activities online. For example, it is purported that kids are using their avatars to provide lap dances in virtual strip clubs in return for the virtual currency, “Robux”. Cryptocurrencies are a popular option for those purchasing Child Sexual Abuse Material (CSAM), as their decentralized control and independence from financial institutions also ensure anonymity, according to a report by ActiveFence.

Given the role that digital currencies are expected to play in the metaverse, the financial incentive and payment structures that lead to the proliferation of harmful content are likely to increase in size and complexity with the move to this web 3.0.

There is an additional risk from the tracking and retention of biometric data, providing platforms with “a new quality of information that is comprised of your real identity combined with stimuli – indicating what you uniquely may think and like and want.”, according to technology and human rights expert Brittan Heller; in her paper Reimagining Reality: Human Rights and Immersive Technology, she coins the term “biometric psychography” and discusses the potential implications of new data collection with immersive technologies for human rights, privacy, and self censorship.

So, what can be done about it?

Many companies, academic and civil society experts, regulators, are advocating for laws and new regulation so that things which aren’t allowed in the real-world are similarly criminalized in online spaces. For example, Bumble is pushing to criminalize cyberflashing. Their CEO, Whitney Wolfe Herd has asked lawmakers: “If indecent exposure is a crime on the streets, then why is it not on your phone or computer?”

Human rights lawyer Akhila Kolisetty said India, Canada, England, Pakistan and Germany were among a small number of countries that have outlawed image-based sexual abuse, where private pictures are shared without consent. Many countries lack laws for emerging forms of digital abuse like “deepfakes”, where a woman’s face can be superimposed onto a porn video and shared on messaging platforms.

Australia eSafety Commissioner provides support to those experiencing such abuse, but many other countries are lagging behind in such mechanisms and regulatory functions. The same applies in protecting kids online. “Our society says we’re going to protect kids in the physical world, but we’ve yet to see that in the same way on the digital side,” said Steven J. Grocki, who leads the child exploitation and obscenity section at the Justice Department. Updating laws to apply in a digital context will be a key component of governing the metaverse.

Hoda Alkhzaimi, Research Assistant Professor, Computer Engineering; Director, Center of Cyber Security at NYU Abu Dhabi added, that there is a constant evolution to the means we build attack mechanisms on a virtual platform. This is never a fixed development cycle. We should be mindful to how we build the software and hardware elements of the technology to include indigenous elements of security consideration to protect the integrity of the content developed, the interactions created the users within the environment and holistically the stability of the presented virtual world. There is not a single factor to be considered here as confidentiality, integrity, authenticity, accessibility, privacy and safety aspects all need to be developed. Attacks on virtual devices have been built in the past through an open source platforms such as OpenVR platform by Valve.

How can we make sure that this will not be a recurring fact within a critical virtual infrastructure?

Civil society organizations such as Access Now and EFF are calling for governments and other stakeholders to address human rights in the context of virtual and augmented reality.

The other major area that can be improved are the policies, enforcement, and overall moderation mechanisms that platforms adopt.

“VR and AR platforms need specific terms of service for immersive environments, based in how this technology interacts with our brains. We cannot simply apply rules from existing social media to the Metaverse,” says technology and human rights expert Heller. “This is important,” Heller stresses, “because platform governance in digital worlds must regulate behavior, in addition to content.”

Right now, one of the most common forms of governance in virtual worlds is a reactive and punitive form of moderation. This does not prevent harms from occurring in the first place and often consequences can be circumvented as bad actors become more sophisticated in how they toe the line of policies. Finding ways to incentivize better behaviors and perhaps reward positive interactions may need to become a bigger part of a safer digital future, especially given increased safety risks in the metaverse.


Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

© UN News/Laura Quinones Sunrise over COP31 as participants arrived as early as 5am to avoid traffic closures.

‘Make or bake time’: Guterres urges climate justice pact as leaders gather at COP31

This article is published in association with United Nations. UN chief António Guterres called for a new global climate justice agreement at COP31 on Wednesday, urging governments to tax fossil fuel companies to help countries bearing the brunt of a crisis they did little to cause. His appeal came as world leaders gathered in Antalya […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Gaza winter aid: ‘No more delay’, Fletcher tells governments stalling on support

© UNRWA Children play outside tents in Gaza. This article is published in association with United Nations. The UN’s Emergency Relief Coordinator, Tom Fletcher, expressed deep concern about the deteriorating humanitarian situation in Gaza, as UN member states and partners have been repeatedly delaying sending their support to the Strip. “Foreign Ministers and partners have […]
This article is published in association with United Nations.l student with a strong interest in research and global health.

COP31: Energy transition takes centre stage as countries map path beyond fossil fuels

This article is published in association with United Nations. The global energy transition took centre stage on the second day of COP31, as countries explored how to move away from fossil fuels, accelerate clean energy and overcome financial and infrastructure barriers standing in the way. Today at COP31 Energy and Transport Day at COP31 got […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Children among the dead as heavy rains flood tents and shelters in Gaza

This article is published in association with United Nations. An infant reportedly drowned and five Gazans were killed – including three children – when a sand dune collapsed on their tents as the first heavy rains swept across the enclave at the weekend, according to the UN aid coordination office (OCHA). Thousands of families lost […]
© EducAid “Before [this], the difference was huge – I used to carry Anas, and he had to crawl on his hands,” said Anas’s mother.

‘For the first time I have my own chair’: Gaza siblings find new freedom

This article is published in association with United Nations. In Gaza, 10-year-old Anas is one of three siblings born without legs and with only two fingers on each of their hands. They struggle to move around and perform daily activities like eating and writing independently. With funding from the UN’s aid coordination office (OCHA), and […]
© UNICEF A child looks out from a makeshift shelter in Rafah, in the south of the Gaza Strip.

Gunfire damages tents at Rafah displacement site in Gaza, as aid teams prepare for winter storms

This article is published in association with United Nations. Gunfire hit and damaged multiple tents at a displacement site in Gaza’s northern Rafah region on Tuesday, reportedly causing injuries and forcing a humanitarian partner to leave the area, the UN aid coordination office (OCHA) has said. The NGO had been working on flood control ahead […]
© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon..

UN peacekeeping chief warns of ‘security vacuum’ as Blue Helmets leave Lebanon and Western Sahara

© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon.. This article is published in association with United Nations. The UN’s peacekeeping chief warned on Wednesday that the withdrawal of “Blue Helmets” from Lebanon and Western Sahara risks leaving a dangerous security vacuum, while the Security Council remains divided over what, if anything, should […]
© IOM/Haithm Abdulbaqi Young people in Yemen play football on a sandy pitch.

15 years of ‘almost no progress’ in getting young people moving: WHO

This article is published in association with United Nations. One in four adolescents worldwide reported not getting at least 60 minutes of physical activity on any day in the previous week, according to new global estimates released by the World Health Organization (WHO) on Wednesday. That amounts to some 240 million young people aged 11 […]
© UNICEF/Sultan Mahmu A mother and daughter wade through floodwaters in Feni, southeastern Bangladesh.

COP31 explained: What’s at stake at this year’s UN climate summit?

This article is published in association with United Nations. The world has more tools than ever to tackle climate change, yet millions remain unable to benefit from them. As clean energy technologies advance faster than ever, the challenge facing countries at COP31 is no longer just finding solutions – but making sure everyone can afford […]
© UNICEF/Christina Pashkina A school in Chuhuiv, Ukraine, lies in ruins after being hit by a missile.

Air raid alerts and attacks on schools: the devastating face of education in Ukraine

This article is published in association with United Nations. Ukraine has sustained almost 2,000 attacks on education since the full-scale Russian invasion in 2022, with some 270 this year alone, the UN Children’s Fund (UNICEF) said on Tuesday, a day after a strike at a school being used to distribute aid. Tweet URL Since the […]
© UNICEF/Oleksii Filippov People walk past a war-damaged building in Ukraine.

Ukraine: WFP provides hot meals to Oleshky evacuees as UN pushes to restore power before winter

This article is published in association with United Nations. The UN World Food Programme (WFP) is providing emergency food assistance to more than 400 people who were able to leave the Russian-occupied city of Oleshky, in Ukraine’s Kherson region, during a brief local ceasefire. Many arrived in worrying condition at medical facilities in Kyiv on […]

COP17: Nations chart ‘Yerevan Pathway’ to speed up action for nature

This article is published in association with United Nations. At the halfway mark to 2030, countries meeting in Armenia have agreed a roadmap to accelerate action for nature, after a global review found the world off track to meet its biodiversity targets. Agreement was formalised through the Yerevan Pathway as the UN Biodiversity Conference (COP17) […]
This article is published in association with United Nations.

AI is changing the way we think. The question is whether we’ll notice in time

This article is published in association with United Nations. Artificial intelligence promises to make life easier. With a few keystrokes, it can write emails, summarize reports, generate ideas and answer complex questions in seconds. For many people, it feels like a technological leap on par with the arrival of the internet itself. But according to […]
© NYCDDC Flood defences are built on the east side of Manhattan Island by the East River in New York City.

Higher Ground: How New York is raising a park to hold back the sea

This article is published in association with United Nations. On 29 October 2012, Hurricane Sandy slammed into New York City, unleashing a devastating storm surge that flooded homes, subways and tunnels, knocked out power and sparked deadly fires. In just 48 hours, 44 people were killed, nearly two million New Yorkers lost power, and 6,500 […]
This article is brought to you in association with the European Commission.

World News in Brief: ‘No safe place in Ukraine’, IAEA calls for Iran nuclear inspections, Kenya hosts thousands of Ethiopians fleeing clashes

This article is published in association with United Nations. The UN refugee agency (UNHCR) on Tuesday urged continued international support for Ukraine’s population as Russian airstrikes intensify and humanitarian needs grow in advance of another bitterly cold winter. The “relentless” attacks are targeting critical energy infrastructure, leaving millions without heat and electricity, and limited access to […]
This article is published in association with United Nations.

Four in five domestic workers lack formal job protections, UN finds

This article is published in association with United Nations. An estimated 66.5 million domestic workers – representing more than four out of five domestic workers worldwide – were informally employed in 2025, a new report by the UN’s labour organisation has found. This makes them more than twice as likely as other employees to lack […]
© WFP/Mohamed Hinnawi An elderly woman in Al Saraya, Gaza, looks after young children after losing three sons, her husband, and home during the war.

Gaza: Families brace for fourth winter in tents as aid operations remain stymied

This article is published in association with United Nations. Families in Gaza are bracing for a fourth winter in tents and makeshift shelters as UN aid operations face mounting obstacles, with transport suspended on Tuesday due to Israel’s closure of the key Kerem Shalom crossing for election day. The UN project services agency in the […]

West Bank: Hebron crackdown displaces thousands, Türk warns of ethnic cleansing

This article is published in association with United Nations. Israel’s “aggressive operation” in the West Bank city of Hebron raises serious concerns of ethnic cleansing, UN human rights chief Volker Türk warned on Monday, as the number of Palestinians forced from their homes passed 3,000 on the eve of Israeli elections. The UN aid coordination […]
© UNICEF/Rawan Eleyan A mother and her children go through their belongings after a room in their home was burned in a settler attack in southern Hebron, West Bank. (July 2025)

West Bank: Guterres alarmed as Israel imposes sweeping closures after deadly Hebron attack

This article is published in association with United Nations. The UN said on Friday it was “extremely alarmed” by intensifying violence in the occupied West Bank, as Israel moved to seal off the territory following a deadly attack on its soldiers in Hebron. Two Israeli soldiers were killed and at least five injured when gunmen […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com