The end of the 404? Why we need to repair the internet’s crumbling infrastructure

Gutteres ITU Internet 2018

(ITU, 2018)

This article is brought to you thanks to the strategic cooperation of The European Sting with the World Economic Forum.

Author: Shirley Chen, Founder and CEO, Narrativ

The internet is nearly 30, and it’s starting to show signs of age. Links, the foundation of the internet, are in crisis. The pages plagued by dead links are not obscure Wikipedia entries or repositories of cat memes – 49% of hyperlinks in Supreme Court cases don’t work. During President Obama’s first term in office, 83% of PDFs across .gov domains vanished. Across the Harvard Law Review, 70% of links are defunct, a 2014 study found.

Thirty per cent of all links on the web redirect to dead 404 pages or out-of-date information. The problem is proliferating as more websites create transient pages with a half-life sometimes as low as 72 hours. Much like how previous generations faced the environmental waste caused by rapid post-industrial growth, how we address digital waste will determine whether our generation realizes the fundamental promise of the internet.

For publishers, a key pillar to establishing a sustainable revenue model is increasing the lifetime value of content. An outstanding feature piece or profile has an incredibly long shelf life, as long as the links in the story are kept up to date. In the frantic race to restore declining ad revenues, publishers have seemingly forgotten that their greatest asset is the long tail of articles that reporters and editors spend weeks to get just right. For most prominent publishers, 60% of traffic comes to articles that are more than two months old.

Since the advent of the internet, many scholars have treated link rot as a self-fulfilling prophecy, and an accepted externality of internet growth. But this is now a fixable problem. Instead of focusing solely on the creation of new content, the internet environment of the future will prioritize sustainability and renewal – and with that, editorial independence.

While technology has historically been the barrier to fixing link decay at scale, the obstacle now is incomplete knowledge – both of the economic potential of repairing broken links, and of the solutions to do it.

Previous attempts to address the problem have focused solely on manually fixing dead links, which while admirable, will never provide enough scale to address link rot meaningfully. We will never keep pace with the internet without a solution that proactively repairs links as they break. The good news is that current innovations in technology and machine learning can solve these problems, if publishers and technologists appreciate the impact of investing in a solution for ending the 404.

While the ephemeral nature of online commerce is inevitable, a trail of broken links is not. A classic case of link erosion online comes from publishers linking to retailers in shopping editorial. Products are constantly fluctuating in and out of stock and being replaced on retailer sites. This leads to a graveyard of 404 pages which are linked to from many corners of the internet.

Since the mass adoption of digital media, there has often been an inverse relationship between the tactics publishers have used to monetize, and their relationship to the reader experience. The proliferation of advertising technology has done little to replace lost print revenues, while the meteoric rise of sketchy “around the web” ads (which at some point have been implemented by almost every major global organization) has deeply eroded consumer trust by openly promoting false information. Repairing links presents a unique opportunity to simultaneously boost revenue by providing a better media product.

At Narrativ, we have restored more than one billion links in just two years. We have seen first-hand the commercial and UX impact, particularly for media entities. When pages break or are removed, Narrativ redirects users to the same content hosted elsewhere or relevant fallback destinations, preserving the integrity of a digital experience. We are proud to partner with a coalition of publishers and technologists committed to creating renewable links across the internet. Increasingly, forward-thinking companies understand that constructing a renewable web is simply good business.

Fixing broken links is essential to building a business model that supports the independence of journalism. We need a technology infrastructure that maintains the integrity of the fourth estate and its service to our democracy.

In the realm of innovation, repairing dead links often takes a backseat to advances in artificial intelligence, blockchain and IoT, among others. But all of these advances are dependent on a single variable: access to data. As the fundamental connectors of data, links are essential to providing the open and accurate information that underpins technological progress. Our future depends on repairing the internet’s decaying infrastructure. Let’s end the 404.






the European Sting Milestones

Featured Stings

Stopping antimicrobial resistance would cost just USD 2 per person a year

These countries spend the most on education

Visa liberalisation: Commission reports on fulfilment of visa-free requirements by Western Balkans and Eastern Partnership countries

Migration crisis: how big a security threat it is?

Financial inclusion in India is soaring. Here’s what must happen next

Eurozone and Britain heading in different directions

The US-Mexico trade deal a threat for others, Trump to single out China, Europe

The future of crypto-assets, from opportunities to policy implications

Is it true that the G20 wants to arrest tax evasion of multinationals?

EU unveils plan to accelerate Capital Markets Union ahead of London’s departure from the bloc

Is continuous sanctioning the way to resolve the Ukrainian crisis?

Migration crisis update: Greece could probably say goodbye to Schengen really soon

A Sting Exclusive: “The Digital Economy and Industry are no longer opposing terms”, Commissioner Oettinger underlines live from European Business Summit 2015

New book honours UN women who made HERstory

London, Berlin, Paris to fight over EU budget

New EU rules to boost crowdfunding platforms and protect investors

South Africa still hasn’t won LGBTQ+ equality. Here are 5 reasons why

Towards a zero tobacco public space in Cameroon

90% of fish stocks are used up – fisheries subsidies must stop

Students in Milan are moving in with the elderly to fight loneliness and save money

“A divided Europe is not in China’s interests”, Ambassador Zhang of the Chinese Mission to EU welcomes Brussels

Maduro ‘brings the truth’ about Venezuela to UN Assembly; says he is ready to meet US President Trump

This is how travel hotspots are fighting back against overtourism

Eurogroup: IMF proposes Germany disposes

These countries have some of the highest voter turnout in the world

How microfinance develops decent work

Every bite of burger boosts harmful greenhouse gases: UN Environment Agency

Girls hold the key to Zambia’s future

Health Committee MEPs back plans to boost joint assessment of medicines

ILO: Unemployment to increase by 8.1 million in 2013-2014

ECB to people: Not responsible if you lose money on Bitcoin, your governments are

China’s impact as a global investor; the Sting reports live from World Economic Forum 2015 in Davos

Dreaming of China

Central America: drought, resulting crop losses threaten food security of two million people, UN warns

Rohingya cannot become ‘forgotten victims,’ says UN chief urging world to step up support

We don’t need to ban plastic. We just need to start using it properly

A ‘charismatic leader’ dedicated to making the world a better place for all: officials bid farewell to former UN chief Kofi Annan

Pharmaceuticals conceal drug side effects with the EU’s Court blessing

Hopes for Palestinian State hit by ‘facts on the ground’ : senior UN official

MEPs reject making EU regional funding dependent on economic targets

The cost of healthcare is rising in ASEAN. How can nations get the most for their money?

Peacekeeping chief highlights challenges facing UN Police

Central African Republic militia leader and football executive, transferred to ICC

Who cares more about taxpayers? The US by being harsh on major banks or the EU still caressing them?

Brands can be a force for good and for growth. Here’s how

How trade wars pose a threat to the global economy

Eurozone stuck in a high risk deflation area; Draghi expects further price plunge

Opening Remarks by H.E. Ambassador Yang Yanyi, Head of the Chinese Mission to the EU at the Chinese Fashion Night

The role of public affairs in student NGOs

If this is Globalization 4.0, what were the other three?

Access still an obstacle to reaching stricken communities on Indonesian island: UN agencies

UN welcomes Angola’s repeal of anti-gay law, and ban on discrimination based on sexual orientation

‘We cannot lose momentum’ on the road to peace in Yemen, UN envoy warns

Marco Polo’s Dream

Parliament ready to fight for a different EU budget

What if Trump wins the November election and Renzi loses the December referendum?

On youth unemployment: unemployment is even bleaker for youth with disabilities

UN chief urges peaceful, free and fair elections in Cameroon

Myanmar: New UN envoy offers to serve ‘as a bridge’, recognizes ‘positive steps’ over Rakhine state

The next EU President will first have to drink his tea at Downing Street

Eurozone: Black economy loves the South

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s