How the future of computing can make or break the AI revolution

AI robot

(Owen Beard, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Ghida Ibrahim, Data Scientist, Infrastructure Engineering, Facebook


When it comes to technology trends, AI has been undeniably leading the way in recent years and is expected to continue to do so for decades to come.

From self-driving cars to predictive medicine and personalized learning, AI is increasingly shaping both practical and intimate aspects of our everyday lives, including matching us to our better halves. When talking about AI, we often are interested in the application use cases: what is AI going to enable next? In the race towards building powerful AI systems and applications, the public, including tech-domain experts, often dismisses the close interconnection between AI and computing. However, the AI revolution that we are witnessing could not have happened without the evolution of the computing hardware and of the computing ecosystem.

The relationship between AI and computing

AI in a nutshell aims at allowing computers to mimic human intelligence. One way to do so is machine learning (ML), consisting of a set of statistical techniques that allow machines to learn from data, instead of being explicitly programmed to perform certain tasks. The most famous ML techniques include regression models, decision trees and neural networks, consisting of adaptive systems of interconnected nodes modeling relationship patterns between input and output data. Multilayered neural networks are particularly relevant for performing complex tasks such as image recognition and text synthesis. These form a subset of machine learning referred to as deep learning (DL), due to the depth of the underlying neural networks. ML techniques in general, and DL techniques in particular, are data- and computing-heavy. A basic deep neural network classifying animal pictures into dogs and cats needs hundreds of thousands of classified animal pictures in training data and billions of iterative computations in order to mimic a four year’s old ability to discern cats from dogs. Data and computing represent in this sense the pillars for building high-performance AI systems.

• Moore’s law: Named after Intel co-founder Gordon Moore, Moore’s law states that the number of transistors per square inch in an integrated circuit (IC) has doubled every 18 months to two years since the mid-1960s. Thanks to Moore’s law, computers have become smaller and faster at an exponential rate, reducing computing costs by ~30% per year, allowing the execution of complex mathematical operations on small ICs, and paving the way towards embedded and ubiquitous computing.

• The internet of things (IoT): With more than 40 billion (mini)-computers expected to be connected to the internet by 2020, the IoT is enabling the collection of exabytes of text, voice, image and other forms of training data, feeding into ML and DL models, and increasing the accuracy and precision of these models.

• The rise of application (and AI) specific computing hardware: A computer is composed of many processing units, each of which contains one or many cores or ICs. A CPU (central processing unit) represents the most standardized and general-purpose microprocessor that can be programmed and used for almost any purpose. Recent years have seen the emergence of new types of processing units including GPUs (graphics processing units) and TPUs (tensor processing units). A GPU or TPU ideally contains more cores than a CPU and also presents a different transistors topology at an integrated circuit (IC) level. Due to their specialized architecture, GPUs and TPUs are particularly suited for computing-intensive deep learning applications such as images processing and voice recognition, as well as unstructured text mining.

• The era of exascale computing: Along with data explosion, the evolution of the computing hardware and of the computing needs of applications such as AI and blockchain have driven computing giants such as HPE to start building super-computers. Placed in centralized data centers, super computers are capable of at least one exaFLOPS, or a billion billion (i.e. a quintillion) calculations per second. Such capacity represents a thousand-fold increase over the first petascale computer that came into operation in 2008. China and the EU are also investing millions in the race towards exascale computing.

Challenges of the computing status quo

Due to the high availability and declining costs of in-house and on-demand cloud computing, computing has rarely been considered as a scarce resource when it comes to enabling the AI revolution. However, computer systems are facing many limitations that can slow the development of AI applications built on top. The main challenges include:

• The end of Moore’s law: Due to physical limitations, transistors cannot go in size below a certain level, which is likely to invalid Moore’s law sooner than we expect and limit the ability to infinitely shrink microprocessors.

• Increasing data regulation: A speedy exascale processing of data in centralized super-computers requires the data to be stored close to the processors. The increasing appetite for data regulation worldwide, including the recent adoption of GDPR in Europe, is likely to make centralized data placement more difficult and to challenge the purpose of building super-computers in the first place.

• The costs (and feasibility) of data transfer and storage: Building on the last point, the high volume of training data and the bandwidth costs associated with data transfer closer to centralized processors invite a redesign of computer memory and of underlying I/O (input/output) operations, as well as significant investments in the network capacity. Running centralized supercomputers also comes with OPEX and environmental costs, particularly in terms of power consumption and generating CO2 emissions.

• Lack of a computing-supportive ecosystem: As more IT talent goes into tech giants or launches AI startups, the appetite for working for traditional computer manufacturers or for launching startups focused on developing new computing hardware is on the decline. Despite accelerating the prototyping of AI products, the emergence of high-level programming languages, APIs and libraries is contributing to a less nuanced understanding of computing architectures and basic computing operations, even among computer scientists.

The way forward

The regulatory constraints and the energy and bandwidth costs associated with centralized super-computing are likely to drive data storage and computing to the edge. Intel has already developed a USB stick that allows users to effectively carry out computer vision and image recognition on edge network devices; like smart cameras and augmented reality hardware.

The imminent end of Moore’s law is likely to drive the emergence of more specialized computing architectures, focused on changing the way processing units and individual circuits are structured, in order to achieve performance gains without further shrinking the size of transistors or processors.

On the other hand, a new form of computing, quantum computing, is progressively gaining more ground, although its practical implementation remains a challenge. Quantum computers rethink computing by leveraging the strange laws of quantum mechanics. Instead of using transistors designed around binary units that classical computers use, quantum computers employ “quantum bits” or “qubits”. Unlike bits, which are limited to being either 1 or 0 at all times, qubits can exist in “superposition”, this enables them to simulate multiple states at the same time. Another property of matter at quantum level, “entanglement”, means that multiple qubits can be connected through logic gates. The “superposition” and “entanglement” properties of quantum computing makes it possible to carry many operation streams in parallel both at the level of one “qbit” and many “qbits”, thus making a quantum computer more suited to tackle complex computational problems, when compared to a classical computer. This being said, physically building a “universal” quantum computer remains extremely difficult in engineering terms. Creating and maintaining qubits requires stable systems under extreme conditions – for example, maintaining component temperatures very close to absolute zero.

Encouraging more people to go into STEM and retaining tech talent will provide the computer manufacturing industry with the talent that it needs to disrupt itself and keep up with the needs of the AI revolution.

 

Finally, when building ML models and writing algorithms, data scientists, computer scientists, ML engineers and AI practitioners should consider the least complex way to solve the problem at hand. Going for a complex neural network when a regression could have provided a good accuracy or running data pipelines on a daily basis when a weekly data update could have been enough are real examples of how tech talent is wasting a scarce resource such as computing on a daily basis. Promoting computing-friendly practices within the tech ecosystem has become a necessity for the tech industry to sustain its own growth, namely on the AI front.

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

MWC 2016: IoT experts fret over fragmentation

What paleoecology can teach us about fires in the Amazon

3 ways to fight short-termism and relaunch Europe

EU Parliament semi worried over democratic deficit

These are the countries where most adults still don’t have a smartphone

Scoring for the environment: what Mathieu Flamini’s top-flight football career taught him about leadership

We can decide to live within the limits of our planet

Eurozone economy desperately needs internally driven growth

Guterres calls for ‘maximum restraint’ following drone assault on key Saudi oil facility

New Zealand will have a new ‘well-being budget,’ says Jacinda Ardern

The business case for investing in sustainable plastics

Deaths from far-right terrorism have more than tripled in the West

Why is Grexit again in the news? Who is to pay for Eurozone’s banking problems?

Merkel had it her way with the refugees & immigrants but can Greece and Turkey deliver?

Turkey presents a new strategy for EU accession but foreign policy could be the lucky card

The latest emoji are more inclusive – but who approves them?

Thursday’s Daily Brief: Climate emergency, call to support breastfeeding, rising political heat and new investigation board for Syria

German banks suffer of nausea amidst rough seas

The strong version of the EU banking union gains momentum

‘No steps taken’ so far to end Israel’s illegal settlement activity on Palestinian land – UN envoy

GSMA Announces New Keynote Speakers, Event Updates for 2019 “MWC Los Angeles, in Partnership with CTIA”

Study: Trade supports over 36 million jobs across the EU

UN Security Council welcomes results of Mali’s presidential elections

Companies can help solve water scarcity. Here’s how

‘Virtual Biopsy’ device detects skin tumours in 15 minutes

UN chief condemns suspected Boko Haram attacks targeting Eid al-Fitr celebrations in Nigeria

UN agencies call for more resettlement and end to detention of asylum seekers in Libya

How distorted is the EU labour market by this crisis?

Monday’s Daily Brief: human rights in the Near East and a Forum for Refugees

EU finally agreed to cut roaming charges in 2017 but criticism is always there

Millions of young lives at risk due to humanitarian funding shortfall: UNICEF

This is why mountains matter more than you think

Further reforms in Japan needed to meet the challenges of population ageing and high public debt

These are the countries that eat the most meat

Advocate General ‘outlaws’ Data Retention Directive

Central African Republic: Guterres says UN mission committed to protecting civilians, helping stabilize country, as violence flares

EU Commission: Growth first then fiscal consolidation

5 ways blockchain can transform the world of impact investing

The Eurogroup offered a cold reception to IMF’s director for Europe

A Sting Exclusive: EU Commission’s Vice President Šefčovič accentuates the importance of innovation to EU’s Energy Union

WEF Davos 2016 LIVE: “European unity and cooperation is being called on question”, Vice President Joe Biden criticizes from Davos

Will the EU reconsider Frontex’s role in light of accusations about violations of migrants’ human rights?

UN condemns attack on Ebola treatment centre in DR Congo which left doctor dead, two others injured

‘No-deal’ Brexit preparedness: European Commission takes stock of preparations and provides practical guidance to ensure coordinated EU approach

The US bugged Europe: Is this news?

World Television Day celebrates an integral part of modern life

Chart of the day: This is what violence does to a nation’s GDP

Here are 3 ways venture capital can fund a better future

There are now four competing visions of the internet. How should they be governed?

The world needs a grand coalition to tackle climate change

Who cares about the unity of Ukraine?

Civilians ‘must never be a target,’ says UN in Afghanistan, amid troubling number of casualties during Ramadan

What UK and EU risk if Brexit “wins” these elections

French full-body veil ban, violated women’s freedom of religion: UN Human Rights Committee

OECD and European Commission join forces to further support structural reforms in European countries

Much more than a ‘lifeline’ for millions of households, remittances can spur global growth, says UN agency

Libya detention centre airstrike could amount to a war crime says UN, as Guterres calls for independent investigation

The Sichuan Province of China presents its cultural treasure to the EU

Terrorist content online should be removed within one hour, says EP

Wednesday’s Daily Brief: Syrian detainees, Zimbabwe hunger crisis, Kabul attack, Mexico disappearances, new tech to feed the world

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s