Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

Greater transparency, fairer prices for medicines ‘a global human rights issue’, says UN health agency

A Europe that Protects: Commission calls for more efforts to ensure adoption of security proposals

7 ways for businesses to capture the youth dividend

The AI doctor won’t see you now

UN condemns deadly simultaneous terrorist attacks on military camps in Mali

EU Commission: Germany can make Eurozone grow again just by helping itself

The different ways of care: Is there a general rule to follow?

1 in 7 people would choose not to fly because of climate change

Thousands flee fresh violence in South Sudan, many ‘suffering from trauma’

Lack of basic water facilities risks millions of lives globally: UN health agency

As people return to work, here’s how we can make commuting more inclusive and sustainable

Food safety critical to development and ending poverty: FAO deputy chief

Data is the oil of the digital world. What if tech giants had to buy it from us?

Essential services on verge of shutdown in Gaza as emergency fuel set to run out

Oleg Sentsov awarded the 2018 Sakharov Prize

Europe should make voice ‘more heard’ in today’s ‘dangerous world,’ says UN chief

Refugees now make up 1% of the world’s population

Sustainable fishing staying afloat in developed world, sinking in poorer regions

270 million people are migrants, who send home a staggering $689 billion

Statelessness for terrorists’ families, never an acceptable option, urges UN rights chief

Why vaccines are not just for children

Top UN official urges Russia and Ukraine to step away from further confrontation at sea

The end of the 404? Why we need to repair the internet’s crumbling infrastructure

Is this the way to finally beat corruption?

MEPs Anti-fraud votes for more votes?

Constitution of the 9th legislature of the European Parliament

Euro-Mediterranean Assembly fixes its permanent seat in Rome

Camino de Santiago – a global community on our doorstep

Brexit: European Commission recommends the European Council (Article 50) to endorse the agreement reached on the revised Protocol on Ireland / Northern Ireland and revised Political Declaration

Students & Allies Unite Globally To Launch #Students_Against_COVID

The world has made spectacular progress in every measure of well-being. So why does almost no one know about it?

OECD warns global economy remains weak as subdued trade drags down growth

Financing economic recovery, written by United Nations Under-Secretary-General

As inequality grows, the UN fights for a fairer world

UN health emergency committee to re-convene on global threat posed by China coronavirus

A ‘charismatic leader’ dedicated to making the world a better place for all: officials bid farewell to former UN chief Kofi Annan

Welcome to the COVID-19 era of world sport

Varna (Bulgaria) awarded European Youth Capital 2017

JADE Spring Conference 2018 is on its way: Young entrepreneurs gather in Brussels to shape Europe

Gas pipeline in the European Union. (Copyright: EU, 2012 / Source: EC - Audiovisual Service / Photo: Ferenc Isza)

EU Investment Bank approves € 1.5bn loan for Trans Adriatic Pipeline (TAP)

New UN forestry project bids to help countries meet climate change commitments

FROM THE FIELD: Free tutorials in Mali, ‘a life-saver’ for Fatouma

Is South Korea set to lose from its FTA with the EU?

It’s Trump’s anti-globalization and inward-looking rhetoric that perturbs GOP and US

UN chief welcomes G20 commitment to fight climate change

Czech PM should resolve his conflict of interest as a matter of urgency say MEPs

Bram in Colombia

Warmer months ahead for many parts of the planet: UN weather agency

UN rights chief urges ‘immediate dialogue’ to end Chile unrest

3 natural mysteries that could be explained by quantum physics

UN agency chiefs issue ‘call to action’ on behalf of refugee children

A third of world’s out-of-school youth live in conflict, disaster-affected countries: UNICEF report

MEPs call for decisive action to fight inequalities in the EU

EU finally agrees on target for 40% greenhouse emission cuts ahead of Paris climate talks

Sexual education in a school at the Brazilian Amazon

Writing a greener story in Asia and the Pacific amidst COVID-19 outbreak

Do we judge robots on their colour? This study says we do

Parliament pushes for cleaner cars on EU roads by 2030

In Bali, UN chief Guterres outlines importance of international financial cooperation for sustainable development

For resilient, sustainable city mobility after COVID-19, these trends must continue

More Stings?

Advertising

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s