Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

Advertising

the European Sting Milestones

Featured Stings

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

Human rights breaches in Iran, Egypt and Tanzania

Not faith, ‘but those who manipulate the faithful’ driving wedge between religions, UN-backed forum in Baku told

European Commission increases support for the EU’s beekeeping sector

Civil society groups matter for Cambodia’s sustainable development: UN expert

Portugal: Budget MEPs back €4.66 m in job-search aid for 730 redundant workers

UN agency chiefs issue ‘call to action’ on behalf of refugee children

‘InvestEU’ programme: big boost for jobs, growth and investment

A Sting Exclusive: “Junior Enterprises themselves carry out projects focusing on the environment”, JADE President Daniela Runchi highlights from Brussels

Berlin’s governing elite leads Eurozone to recession to win the September election in Germany

Tobacco in Pakistan: is it worth to burn your money?

End fossil fuel subsidies, and stop using taxpayers’ money to destroy the world: Guterres

Our idea of what makes a company successful needs to change. And it starts with making waste expensive

Deadly violence at Israel-Gaza border escalates dangerously: UN chief condemns in strongest terms

UN chief calls for ‘solidarity, compassion and action’ on World Refugee Day

Supermarket supply chains are driving poverty and inequality. We can do better

Could a Digital Silk Road solve the Belt and Road’s sustainability problem?

UN ceasefire monitoring chief tours Yemeni port of Hudaydah

The fatal consequences of troika’s blind austerity policy

The Banking Union divides deeply the European Union

COP24: green, gender focus, as UN’s crucial climate change conference gets underway

Economic sentiment and business climate stagnate in miserable euro area

Back to the basics for the EU: Investment equals Growth

Reforms in Lithuania are reinforcing economic growth but boosting productivity is still a challenge

Tackling ‘deeply worrying’ global rise in anti-Semitism is a job for all societies everywhere, says UN chief

Tackle ‘tsunami of hatred’ across the world urges Guterres, to counter anti-Semitism, racism and intolerance

‘Still time’ to stop a ‘bloody battle’ for Libya’s capital, insists Guterres

These charts show where the world’s refugees came from in 2017 – and where they’re heading

Costa Rica has doubled its tropical rainforests in just a few decades. Here’s how

The next Google in biotech: will it be Chinese?

Yemen update: UNICEF chief condemns attack in Taiz that claims lives of seven children

Illegal fishing: EU lifts Taiwan’s yellow card following reforms

The European Sting Cookie Policy

Eurozone: How safe are our deposits? Which banks will survive?

We have to learn to trust Artificial Intelligence. Here’s how

Towards a climate-neutral Europe: EU invests over €10bn in innovative clean technologies

Stable growth momentum in the OECD area

Encouraging progress made in 2018, in ‘zero tolerance’ effort to end sexual exploitation and abuse across UN

Politics needs to “Youth UP” in order the ensure the future of our democracies

“Joining forces to #BeatPollution”, a Sting Exclusive by the Head of UNEP in Brussels

EU and China seize momentum to enhance trade agreements in response to Trump’s administration

Explained, the economic ties between Europe and Asia

Here are four ways ASEAN can help entrepreneurs thrive – especially women

Security spillovers from Trump’s trade wars: China, Germany prepare for global disorder

Following the World Cup? Then you’re watching high-performing migrants at work

The Shifting Rhythms of Harmonious China: Ancient, Modern & Eternal

In Sweden you can roam anywhere you like, without the landowner’s permission

5 ways to net a sustainable future for aquaculture

MEPs back update of rail passenger rights across EU

Summer JADE Meeting 2015: We came curious, we left inspired

Russia can no longer be considered a ‘strategic partner’, say MEPs

UN affirms ‘historic’ global compact to support world’s refugees

Women’s empowerment ‘essential to global progress’ says Guterres, marking International Day

Global climate change: consequences for human health in Brazilian cities

Microplastics have spread right to the sea bed, study finds

‘Bicycle Kingdom’ makes a comeback, as China seeks solutions to tackle air pollution crisis

Foreign direct investments the success secrete of Eurozone

The strong version of the EU banking union gains momentum

3 ways AI will change the nature of cyber attacks

UN’s Guterres condemns ongoing airstrikes on Syria’s hospitals, medical workers

Lagarde’s metamorphoses, not a laughing matter

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s