Are we at a turning point for tackling online extremism?

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: John Letzing, Digital Editor, Strategic Intelligence, World Economic Forum


  • A growing body of evidence illustrates the ways social media has radicalized users and resulted in violence.
  • There is growing debate about the need to check extremism and a desire to enable freedom of expression.

What do TV show predictions have to do with far-right conspiracy theories? On TikTok, an app popular with children younger than 14, there’s a very short path from one to the other.

According to a pair of reports published recently by a media watchdog, TikTok can swiftly channel young users from relatively benign interests to more troubling topics – and even into the arms of some of the extremist movements involved the deadly attack on the US Capitol in January.

A steadily-building body of evidence that becoming radicalized by way of the internet is a very real and dangerous phenomenon appears to be reaching a critical mass. So, what should be done about it?

Twitter CEO Jack Dorsey acknowledged during a congressional hearing last month that the social media service played a role in the white supremacist attack on the US Capitol. Dorsey told lawmakers that Twitter is working to address extremism and misinformation.

Earlier this month, YouTube made its first public disclosure of the percentage of views coming from videos later removed for rules violations including promoting violent extremism. But it stopped short of sharing what would likely be the “eye-popping” total number of views these videos garner before they disappear.

As our digital and physical worlds continue to collide, our online safety – based on the content we create, see, and share – will become our personal safety, full stop. —Farah Lalani, Community Curator, Media, Entertainment and Information Industries, World Economic Forum, and Cathy Li, Head of Media, Entertainment and Sport Industries, World Economic Forum

Social media’s algorithmic tentacles require surprisingly few prompts to pull people into a cascade of xenophobic, racist, anti-Semitic, and religious extremist messaging. The real-world results have piled up, and while some content has only had an indirect impact it’s been no less deadly, like the anti-science propaganda blamed for killing thousands.

According to a report published in December, social media platforms including YouTube helped radicalize the perpetrator of a 2019 terrorist attack on mosques in Christchurch, New Zealand that left 51 people dead. The report noted the assailant’s belief in the “Great Replacement” theory, which holds that white populations are being disempowered and replaced by people of colour – a theory also popular among rioters at the US Capitol.

A French writer is credited with popularizing the Great Replacement theory roughly a decade ago. Since then it has been heavily promoted online by groups like Generation Identity (Génération identitaire), which was banned by the French government last month.

Image: World Economic Forum

In India, Facebook has struggled with its response to violent religious extremists; it refrained from banning them due to a fear of endangering the company’s staff and business prospects. In Australia, a government official recently drew a parallel between ways right-wing extremists there are recruiting online, and methods used by the Islamic State.

(While the Islamic State has suffered defeats in the Middle East, recent efforts to bolster its profile online have involved talk on forums of establishing a new caliphate in Africa.)

In Germany, one study found a direct link between anti-refugee sentiment online and violent attacks. It suggested that a right-wing political party’s social media posts have likely pushed “some potential perpetrators over the edge.”

One way to try to curb online extremism is by deplatforming the most popular and troublesome instigators. However, they can often simply migrate to seedier corners of the internet and bring their followers with them.

Stiffer rules and regulations may therefore be in the works for an industry that’s mostly been left to its own devices. One American lawmaker opened last month’s congressional hearing on social media’s role in promoting extremism by declaring that, “self-regulation has come to the end of its road.”

Image: World Economic Forum

The Global Alliance for Responsible Media, in partnership with the World Economic Forum, is working to improve the safety of digital environments, address harmful and misleading media and protect consumers and brands.

For more context, here are links to further reading from the World Economic Forum’s Strategic Intelligence platform:

  • This US study based on interviews with white supremacists and Islamic extremists showed that in more than two-thirds of cases, exposure to propaganda via the internet and other media played a role in their radicalization. (RAND)
  • Pakistan’s Shia community is being targeted, according to this report; between August and September 2020 nearly half of all social media mentions of Shias in the country were negative, and the most frequently used term was the Urdu word for “infidel.” (The Diplomat)
  • We’re going to have to create a vocabulary to talk about how friends fell down the wrong YouTube hole and came out speaking another language, according to this piece – which argues for more explanation of how social networks prey on hopelessness and fear. (NiemanLab)
  • India has banned dozens of Chinese apps amid tensions between the countries, and launched indigenously-developed alternatives. According to this piece, it’s unclear whether these services are equipped to resist co-opting by extremist groups. (Observer Research Foundation)
  • “No one wants to believe that they’ve created something terrible.” A reporter covering online disinformation and conspiracies delves into tech companies’ lack of accountability for amplifying our worst instincts. (NiemanLab)
  • COVID-19 has left young Australians isolated and vulnerable to far-right hate messaging, according to this piece. It notes that all of the country’s “Five Eyes” intelligence-sharing partners have sought to list right-wing extremist organizations as terrorist groups, and argues that Australia should follow suit with the same rigour. (ASPI)
  • When government efforts to clamp down draw criticism: India’s “draconian” new rules about what can be said online, ostensibly designed to combat misinformation, will have profound implications for privacy and freedom of expression, according to this analysis. (EFF)

On the Strategic Intelligence platform, you can find feeds of expert analysis related to Internet Governance, Peace and Resilience and hundreds of additional topics. You’ll need to register to view.

Image: World Economic Forum

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

How private investment can boost education access and quality in the digital economy

5 amazing people fighting to save the oceans

European Commission adopts new tools for safe exchanges of personal data

Banks must take bold action to fight climate change. This is how they can do it

A Sting Exclusive: Healthy oceans amidst COVID-19, written by the United Nations Under-Secretary General

Here’s how to close the $176 billion health financing gap

Vulnerable young people must not be blamed & stigmatised for violent radicalisation

Why business schools can’t “return to normal” after the COVID-19 pandemic

State aid: Commission approves €500 million Greek scheme to support the self-employed affected by coronavirus outbreak

Countries urged to make ‘digital world’ safer for children

The European Youth explains the age gap in European business in the 21st century

African cooperation on peace ‘increasingly strong’, Security Council told

There is no recipe for a healthy mental state

MasterCard @ MWC14: Innovation in times of regulatory uncertainty

FROM THE FIELD: Gaza men advocate for an end to early marriage

The Great Reset needs great leaders to help the most vulnerable

The global suicide rate is growing – what can we do?

EP Group leaders on Brexit: “the agreement is not open to renegotiation”

China, forever new adventures

The ethics of the Medical Technology Civilisation era

Who is responsible for public health? The tendencies and its benefits –or not– on Health Education around the world

‘Antagonistic gestures and accusations’ drown out Kosovo dialogue hopes, Security Council hears

Teenage girl’s death sentence spotlights Sudan’s failure to tackle forced marriage, gender-based violence – UN rights office

Ambition, transformation, active citizenship: COP24 looks to next year’s big UN Climate Change Summit

COVID-19 shows why we must build trust in digital financial services

With lifelong learning, you too can join the digital workplace

Mergers: Commission fines Sigma-Aldrich €7.5 million for providing misleading information during Merck takeover investigation

Recognize, celebrate and ‘stand in solidarity’ with persons with albinism

Happy workers are more productive, research shows

Financing fossil fuels risks a repeat of the 2008 crash. Here’s why

The different ways of care: Is there a general rule to follow?

Safety fits into our palms: The role of mobile technology in healthcare systems and life saving

Closing the data gap: a cost-effective way to improve air quality

Fostering global citizenship in medical students through exchanges

Sexual abuse of elderly likely to ‘grow dramatically’, UN expert says

Praising Roma’s contributions in Europe, UN expert urges end to rising intolerance and hate speech

UN Convention that promotes mediation to resolve trade disputes moves closer to entry into force

Superbugs: MEPs advocate further measures to curb use of antimicrobials

UN’s AIDS agency ‘greatly encouraged’ by latest scientific breakthrough showing cure is possible

Scientists have created the world’s ‘first psychopath AI’

How multistakeholder platforms can strengthen our multilateral system

How the powerful science of behaviour change can make us healthier

Soil erosion must be stopped ‘to save our future’, says UN agriculture agency

The Internet of Bodies is here. This is how it could change our lives.

The US + Britain trivialize mainland Europe, NATO and the EU

Cyclone Fani hits India, UN moves to protect vulnerable refugees in Bangladesh

6 data policy issues experts are tracking right now

Blockchain is not a magic bullet for security. Can it be trusted?

Only one in five countries has a healthcare strategy to deal with climate change

At least half of people who have a job fear they’ll lose it in the next 12 months

Trump to run America to the tune of his business affairs

Forest fires: Commission adds planes to rescEU fleet to prepare for summer

Here’s how data can shine a light on financial crime

Security Council must ‘come together’ to address the plight of children trapped in armed conflict, says UN envoy

Commission presents review of EU economic governance and launches debate on its future

Why democratizing skills is the key to the post-pandemic economy

How smart farming is helping Brazil feed the world

Black babies more likely to survive when cared for by Black doctors, suggests new study

Belarus, climate action, COVID-19: MEPs assess EU summit results

Why Eurozone urgently needs the ECB to print and distribute at least €500 billion

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s