Are we at a turning point for tackling online extremism?

(Credit: Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: John Letzing, Digital Editor, Strategic Intelligence, World Economic Forum

  • A growing body of evidence illustrates the ways social media has radicalized users and resulted in violence.
  • There is growing debate about the need to check extremism and a desire to enable freedom of expression.

What do TV show predictions have to do with far-right conspiracy theories? On TikTok, an app popular with children younger than 14, there’s a very short path from one to the other.

According to a pair of reports published recently by a media watchdog, TikTok can swiftly channel young users from relatively benign interests to more troubling topics – and even into the arms of some of the extremist movements involved the deadly attack on the US Capitol in January.

A steadily-building body of evidence that becoming radicalized by way of the internet is a very real and dangerous phenomenon appears to be reaching a critical mass. So, what should be done about it?

Twitter CEO Jack Dorsey acknowledged during a congressional hearing last month that the social media service played a role in the white supremacist attack on the US Capitol. Dorsey told lawmakers that Twitter is working to address extremism and misinformation.

Earlier this month, YouTube made its first public disclosure of the percentage of views coming from videos later removed for rules violations including promoting violent extremism. But it stopped short of sharing what would likely be the “eye-popping” total number of views these videos garner before they disappear.

As our digital and physical worlds continue to collide, our online safety – based on the content we create, see, and share – will become our personal safety, full stop. —Farah Lalani, Community Curator, Media, Entertainment and Information Industries, World Economic Forum, and Cathy Li, Head of Media, Entertainment and Sport Industries, World Economic Forum

Social media’s algorithmic tentacles require surprisingly few prompts to pull people into a cascade of xenophobic, racist, anti-Semitic, and religious extremist messaging. The real-world results have piled up, and while some content has only had an indirect impact it’s been no less deadly, like the anti-science propaganda blamed for killing thousands.

According to a report published in December, social media platforms including YouTube helped radicalize the perpetrator of a 2019 terrorist attack on mosques in Christchurch, New Zealand that left 51 people dead. The report noted the assailant’s belief in the “Great Replacement” theory, which holds that white populations are being disempowered and replaced by people of colour – a theory also popular among rioters at the US Capitol.

A French writer is credited with popularizing the Great Replacement theory roughly a decade ago. Since then it has been heavily promoted online by groups like Generation Identity (Génération identitaire), which was banned by the French government last month.

Image: World Economic Forum

In India, Facebook has struggled with its response to violent religious extremists; it refrained from banning them due to a fear of endangering the company’s staff and business prospects. In Australia, a government official recently drew a parallel between ways right-wing extremists there are recruiting online, and methods used by the Islamic State.

(While the Islamic State has suffered defeats in the Middle East, recent efforts to bolster its profile online have involved talk on forums of establishing a new caliphate in Africa.)

In Germany, one study found a direct link between anti-refugee sentiment online and violent attacks. It suggested that a right-wing political party’s social media posts have likely pushed “some potential perpetrators over the edge.”

One way to try to curb online extremism is by deplatforming the most popular and troublesome instigators. However, they can often simply migrate to seedier corners of the internet and bring their followers with them.

Stiffer rules and regulations may therefore be in the works for an industry that’s mostly been left to its own devices. One American lawmaker opened last month’s congressional hearing on social media’s role in promoting extremism by declaring that, “self-regulation has come to the end of its road.”

Image: World Economic Forum

The Global Alliance for Responsible Media, in partnership with the World Economic Forum, is working to improve the safety of digital environments, address harmful and misleading media and protect consumers and brands.

For more context, here are links to further reading from the World Economic Forum’s Strategic Intelligence platform:

  • This US study based on interviews with white supremacists and Islamic extremists showed that in more than two-thirds of cases, exposure to propaganda via the internet and other media played a role in their radicalization. (RAND)
  • Pakistan’s Shia community is being targeted, according to this report; between August and September 2020 nearly half of all social media mentions of Shias in the country were negative, and the most frequently used term was the Urdu word for “infidel.” (The Diplomat)
  • We’re going to have to create a vocabulary to talk about how friends fell down the wrong YouTube hole and came out speaking another language, according to this piece – which argues for more explanation of how social networks prey on hopelessness and fear. (NiemanLab)
  • India has banned dozens of Chinese apps amid tensions between the countries, and launched indigenously-developed alternatives. According to this piece, it’s unclear whether these services are equipped to resist co-opting by extremist groups. (Observer Research Foundation)
  • “No one wants to believe that they’ve created something terrible.” A reporter covering online disinformation and conspiracies delves into tech companies’ lack of accountability for amplifying our worst instincts. (NiemanLab)
  • COVID-19 has left young Australians isolated and vulnerable to far-right hate messaging, according to this piece. It notes that all of the country’s “Five Eyes” intelligence-sharing partners have sought to list right-wing extremist organizations as terrorist groups, and argues that Australia should follow suit with the same rigour. (ASPI)
  • When government efforts to clamp down draw criticism: India’s “draconian” new rules about what can be said online, ostensibly designed to combat misinformation, will have profound implications for privacy and freedom of expression, according to this analysis. (EFF)

On the Strategic Intelligence platform, you can find feeds of expert analysis related to Internet Governance, Peace and Resilience and hundreds of additional topics. You’ll need to register to view.

Image: World Economic Forum

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

EU Budget 2020 conciliation talks suspended

Eurozone’s north-south growth gap to become structural

Air pollution: Most EU Member States not on track to reduce air pollution and its related health impacts by 2030

New Disability Inclusion Strategy is ‘transformative change we need’, says Guterres

These are the countries best prepared for the fight against cancer

Prospect of lasting peace ‘fading by the day’ in Gaza and West Bank, senior UN envoy warns

Security Council approves ‘historic’ political Haiti mission, ending UN peacekeeping role in the country

Learning lessons from across Europe – the hidden costs of COVID-19 on lung cancer

Why ‘video call fatigue’ might be making you tired during lockdown – and how to beat it

What is tuberculosis and why are deaths rising?

Mergers: Commission waives the commitments made by Takeda to obtain clearance of its acquisition of Shire

10 ways COVID-19 could reshape offices

The US calls off globalization, targets Germany. Paris offer to Berlin comes at a cost

4 lessons on human cooperation from the fight against Ebola

Collaboration and connectivity at ITU Telecom World 2019

‘Revved up climate action’ needed to counter ‘prolonged’ and deadly storms like Cyclone Idai: Guterres

Here’s how data can shine a light on financial crime

What does artificial intelligence do in medicine?

Parliament to ask for the suspension of EU-US deal on bank data

Progress made at COP25, despite lack of agreement to increase climate ambition

UN ‘prioritizing needs’, ramping up aid, as Hurricane Dorian continues to batter the Bahamas

Countries must invest at least 1% more of GDP on primary healthcare to eliminate glaring coverage gaps

Brexit: the time has come for the UK to clarify its position

Starbucks and FIAT again under Commission’s microscope: is Europe ready to kick multinationals out of the house?

Why we need a blockchain bill of rights

India vs Virus: voices from the COVID front line

How the tech sector can power the shift to a sustainable economy

UN chief welcomes G20 commitment to fight climate change

Are we at risk of a financial crisis? Our new report takes a look

Antitrust: Commission sends Statement of Objections to Conserve Italia for participation in canned vegetables cartel

iSting: a reader’s thoughts on the UN Environment Assembly 2017

With 5 billion set to miss out on health care, UN holds landmark summit to boost coverage

Antitrust: Commission fines Google €1.49 billion for abusive practices in online advertising

Essential services on verge of shutdown in Gaza as emergency fuel set to run out

Here are three technology trends changing the way you travel

The EU Parliament sidesteps the real issues about banks, while the US target the Eurozone lenders

5 crises that could worsen under COVID-19

How can we make enough vaccine for 2 billion people?

China, forever new adventures

Quality Internships: Towards a Toolkit for Employers

Who cares about the unity of Ukraine?

YouTube stars get creative at UN, to promote tolerance

These Dutch tomatoes can teach the world about sustainable agriculture


A Sting Exclusive: “Education in Europe, fostering skills development inside and outside the school system”

How the mobile industry is driving climate progress on the scale of a major economy

EU defence gets a boost as the European Defence Fund becomes a reality

How the Belt and Road Initiative could support an ageing population

Better understanding the psychological impact caused by the COVID-19 Pandemic

Our poisonous air is harming our children’s brains

EU legislation protecting home buyers approved in Parliament

Does the West play the Syrian game in Egypt?

Normal reactions to the abnormality of the pandemic

How climate change sparks innovation for fragile communities

Thai cave boys spared thundershowers, highlighting extreme climate disruption: UN weather agency

Batteries included: how better storage can transform renewable energy

Eurozone stagnates after exporting its recession to trading partners

Why the euro may rise with the dollar even at lower interest rates

New Eurobarometer survey shows: The majority of Europeans think the EU should propose additional measures to address air quality problems

We must stop turning a blind eye to the world’s health crises

Living in a pandemic: what are the effects of COVID-19 on the mental health of the youth?

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: