Are we at a turning point for tackling online extremism?

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: John Letzing, Digital Editor, Strategic Intelligence, World Economic Forum


  • A growing body of evidence illustrates the ways social media has radicalized users and resulted in violence.
  • There is growing debate about the need to check extremism and a desire to enable freedom of expression.

What do TV show predictions have to do with far-right conspiracy theories? On TikTok, an app popular with children younger than 14, there’s a very short path from one to the other.

According to a pair of reports published recently by a media watchdog, TikTok can swiftly channel young users from relatively benign interests to more troubling topics – and even into the arms of some of the extremist movements involved the deadly attack on the US Capitol in January.

A steadily-building body of evidence that becoming radicalized by way of the internet is a very real and dangerous phenomenon appears to be reaching a critical mass. So, what should be done about it?

Twitter CEO Jack Dorsey acknowledged during a congressional hearing last month that the social media service played a role in the white supremacist attack on the US Capitol. Dorsey told lawmakers that Twitter is working to address extremism and misinformation.

Earlier this month, YouTube made its first public disclosure of the percentage of views coming from videos later removed for rules violations including promoting violent extremism. But it stopped short of sharing what would likely be the “eye-popping” total number of views these videos garner before they disappear.

As our digital and physical worlds continue to collide, our online safety – based on the content we create, see, and share – will become our personal safety, full stop. —Farah Lalani, Community Curator, Media, Entertainment and Information Industries, World Economic Forum, and Cathy Li, Head of Media, Entertainment and Sport Industries, World Economic Forum

Social media’s algorithmic tentacles require surprisingly few prompts to pull people into a cascade of xenophobic, racist, anti-Semitic, and religious extremist messaging. The real-world results have piled up, and while some content has only had an indirect impact it’s been no less deadly, like the anti-science propaganda blamed for killing thousands.

According to a report published in December, social media platforms including YouTube helped radicalize the perpetrator of a 2019 terrorist attack on mosques in Christchurch, New Zealand that left 51 people dead. The report noted the assailant’s belief in the “Great Replacement” theory, which holds that white populations are being disempowered and replaced by people of colour – a theory also popular among rioters at the US Capitol.

A French writer is credited with popularizing the Great Replacement theory roughly a decade ago. Since then it has been heavily promoted online by groups like Generation Identity (Génération identitaire), which was banned by the French government last month.

Image: World Economic Forum

In India, Facebook has struggled with its response to violent religious extremists; it refrained from banning them due to a fear of endangering the company’s staff and business prospects. In Australia, a government official recently drew a parallel between ways right-wing extremists there are recruiting online, and methods used by the Islamic State.

(While the Islamic State has suffered defeats in the Middle East, recent efforts to bolster its profile online have involved talk on forums of establishing a new caliphate in Africa.)

In Germany, one study found a direct link between anti-refugee sentiment online and violent attacks. It suggested that a right-wing political party’s social media posts have likely pushed “some potential perpetrators over the edge.”

One way to try to curb online extremism is by deplatforming the most popular and troublesome instigators. However, they can often simply migrate to seedier corners of the internet and bring their followers with them.

Stiffer rules and regulations may therefore be in the works for an industry that’s mostly been left to its own devices. One American lawmaker opened last month’s congressional hearing on social media’s role in promoting extremism by declaring that, “self-regulation has come to the end of its road.”

Image: World Economic Forum

The Global Alliance for Responsible Media, in partnership with the World Economic Forum, is working to improve the safety of digital environments, address harmful and misleading media and protect consumers and brands.

For more context, here are links to further reading from the World Economic Forum’s Strategic Intelligence platform:

  • This US study based on interviews with white supremacists and Islamic extremists showed that in more than two-thirds of cases, exposure to propaganda via the internet and other media played a role in their radicalization. (RAND)
  • Pakistan’s Shia community is being targeted, according to this report; between August and September 2020 nearly half of all social media mentions of Shias in the country were negative, and the most frequently used term was the Urdu word for “infidel.” (The Diplomat)
  • We’re going to have to create a vocabulary to talk about how friends fell down the wrong YouTube hole and came out speaking another language, according to this piece – which argues for more explanation of how social networks prey on hopelessness and fear. (NiemanLab)
  • India has banned dozens of Chinese apps amid tensions between the countries, and launched indigenously-developed alternatives. According to this piece, it’s unclear whether these services are equipped to resist co-opting by extremist groups. (Observer Research Foundation)
  • “No one wants to believe that they’ve created something terrible.” A reporter covering online disinformation and conspiracies delves into tech companies’ lack of accountability for amplifying our worst instincts. (NiemanLab)
  • COVID-19 has left young Australians isolated and vulnerable to far-right hate messaging, according to this piece. It notes that all of the country’s “Five Eyes” intelligence-sharing partners have sought to list right-wing extremist organizations as terrorist groups, and argues that Australia should follow suit with the same rigour. (ASPI)
  • When government efforts to clamp down draw criticism: India’s “draconian” new rules about what can be said online, ostensibly designed to combat misinformation, will have profound implications for privacy and freedom of expression, according to this analysis. (EFF)

On the Strategic Intelligence platform, you can find feeds of expert analysis related to Internet Governance, Peace and Resilience and hundreds of additional topics. You’ll need to register to view.

Image: World Economic Forum

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

UN chief welcomes South Sudan’s Unity government, lauds parties for ‘significant achievement’

With lifelong learning, you too can join the digital workplace

Legendary Harlem Globetrotters slam-dunk at the UN, with message that brings families, nations together

German stock market is not affected by the Greek debt revolution while Athens is running out of time

A Europe that delivers: EU citizens expect more EU level action in future

Ukraine: Temperatures plunge amid rising humanitarian needs

How to talk about climate change: 5 tips from the front lines

This Canadian start-up turns millions of chopsticks into sustainable furniture

OECD Secretary-General Gurría welcomes announcement of new trade agreement between the US, Mexico and Canada

How tech is helping the agriculture sector curb carbon emissions

2019 data on official development aid & online discussion of ODA’s role in the Covid-19 crisis

Spanish vote – bad luck for Greece: Does Iphigenia need to be sacrificed for favourable winds to blow in Eurozone?

How three US cities are using data to end homelessness

MEPs want to ensure sufficient funding for Connecting Europe’s future

Post-Brexit muddled times: the resignation of UK’s top ambassador and Theresa May’s vague plans

Re-open EU: Commission launches a website to safely resume travelling and tourism in the EU

How to make primary healthcare a favourable career choice for medical students: strategies and reflections

Eastern Partnership: Commission proposes new policy objectives for beyond 2020

What if big-tech companies became non-profits?

South Sudan: UN rights experts see little headway on peace deal amid spike in local-level violence

UN official sees ‘unprecedented opportunities’ to make progress on peace in Afghanistan

Commission supports reform projects in Member States for more jobs and sustainable growth

Polish de facto ban on abortion puts women’s lives at risk, says Parliament

Mobile health technology: Advances, Facilitations and Promotion of Autonomy

Road injuries leading cause of death for the young, despite safety gains: UN report

State aid: Commission approves up to €4 billion French measure to recapitalise Air France

Iran: UN rights chief ‘deeply disturbed’ by continuing executions of juvenile offenders

This afternoon Britain will be once more isolated from mainland Europe

MEPs want ambitious funding for cross-border projects to connect people

EU’s guidelines on net neutrality see the light although grey areas do remain

Why South Africa is on a path of economic renewal

Built by a woman: supporting the dreams of mum entrepreneurs

Texting is a daily source of stress for 1/3 of people – are you one of them?

Pandemic versus fear

A breath of fresh air: How three disused industrial areas became beautiful parks

Will the French let Macron destroy their party political system?

Pro-EU forces won a 70% triumph in the European elections

Norway has successfully enforced its foreign bribery laws but faces potential obstacles

EU is not only obsessed with Facebook but also blaims now innocent websites using social plugins to serve democratic dialogues?

Right-wing “sovranism” harm national identity

EU revengefully shows no mercy to Cameron by demanding a fast and sloppy Brexit now

What wealth managers can learn from family dynamics

How global food safety protects the planet and begins on the farm

OECD: Mind the financial gap that lies ahead

Why collaboration will be key to creating the workforce of the future

Green Deal: How MEPs wish to channel EU investment to sustainable activities

VW emissions scandal: While U.S. car owners are vindicated, Europe still unable to change its laws and protect its consumers

If on a summer’s night: is UK businesses’ “new deal” the only key to the “best of all worlds”?

The needs, challenges and power dynamics of refugee resettlement

A jingoistic Spanish ‘war’ from the past

Euro celebrates its 20th birthday

Students & Allies Unite Globally To Launch #Students_Against_COVID

This team of Saudi women designed an award-winning app to make the Hajj safer

Here’s how we get businesses to harmonize on climate change

Forty-two countries adopt new OECD Principles on Artificial Intelligence

No more lead in PVC to protect public health, say MEPs

‘Multiplicity’ of rights violations in Ukraine as fifth winter of conflict bites

5G: How a ‘legion of robots’ could help save the rhino

It’s Trump’s anti-globalization and inward-looking rhetoric that perturbs GOP and US

‘No shortcuts to a healthier world’: WHO chief sets out health priorities for the decade

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s