Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

the sting Milestone

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

No great discovery was made without a bold guess – Isaac Newton

Ocean life faces ‘onslaught of threats’ from human activity, but tools exist to save it

How technology is driving a fourth wave of environmentalism

Sweden is fighting loneliness by housing older and younger generations together

Japan must urgently address long-standing concerns over foreign bribery enforcement

EU@UNGA 74: Working towards a more peaceful, secure and prosperous world

Do men and women really have different leadership styles?

INTERVIEW: Advancing human rights, a ‘never ending process’ says new UN rights chief

How regenerative agroforestry could solve the climate crisis

How has policy affected employment in small businesses in the US?

Young people demand a transparent job market: new campaign launches on international interns day

Brexit: Is there anybody supporting a non-violent separation?

Spring 2019 Standard Eurobarometer: Europeans upbeat about the state of the European Union – best results in 5 years

Mental health in the times of coronavirus

Juncker’s Investment Plan in desperate need for trust and funds from public and private investors

Parliament gives green light to EU-Singapore trade and investment protection deals

COVID-19 will hit the developing world’s cities hardest. Here’s why

Countering illegal hate speech online – EU Code of Conduct ensures swift response

Syrian Refugees in Germany face distinctly different challenges than those in Lebanon

Somalia: UN congratulates Puntland region’s newly-elected President

Reflections on the the biggest refugee crisis since World War II

FROM THE FIELD: Hardy seeds bear fruit to protect Colombia’s environment

UN health agency welcomes Facebook pledge to stop vaccine misinformation from going viral

European Elections: “Web giants” are urging users to vote

Huge areas of the Arctic are on fire – here’s what that means for the planet

Commission presents first reflections on building a strong social Europe for just transitions

Hostilities in Syria’s southwest, mean cuts in vital aid across Jordanian border: Senior UN official

These 4 skills can make the world better after COVID-19

3 leaders on creating a pipeline for female talent in business

Commission deepens criticism on German economic policies

EU deserves the title of the Syrian affair merchandiser

Erdogan’s electoral win on a ‘me or chaos’ dilemma means trouble for everybody

This is what happens when a school swaps french fries for quinoa

Who is to pay for Trump’s trade war against China?

COVID-19: MEPs urge quick action to prevent “huge recession”

Turkey to let EU alone struggle with the migrant crisis while enhancing its economic ties with Russia instead?

Universal Health Coverage in the EU: Are we really leaving no one behind?

Topic: Mental Health in times of pandemic: What can each individual do to lessen the burden?

Antitrust: Aspen proposes 73% price reduction for six off-patent cancer medicines to remove Commission’s excessive pricing concerns

Trump declares emergency and WHO urges speed – latest coronavirus updates

It’s ‘time for concrete action’ says UN chief, welcoming inter-Korean agreement

European Commission launches global coalition for biodiversity

Coronavirus: 23 new research projects to receive €128 million in EU funding

Climate change: won or lost in cities or by cities?

Ending extreme poverty crucial to sustainable future for all: UN chief

How Japan and Singapore are reinventing old age

Simple Technology Saving Lives: Remote Auscultation

A Sting Exclusive: Towards better business opportunities for the EU and its neighbours, Commissioner Hahn live from European Business Summit 2015

UN chief welcomes South Sudan’s Unity government, lauds parties for ‘significant achievement’

Spring 2020 Economic Forecast: A deep and uneven recession, an uncertain recovery

Migration: Commission steps up emergency assistance to Spain and Greece

Nuclear test ban treaty critical to global collective security – UN chief

Protecting Health Workers’ Safety Around the World

Human traffickers in Libya are posing as UN staff, says Refugee Agency

“If the job market doesn’t exist, then even the most brilliant Youth Guarantee cannot ensure a job to these young people”, European Youth Forum Secretary General Giuseppe Porcaro on another Sting Exclusive

A new generation of women leaders is making waves in the Arab world

Do the EU policies on agro-food smell?

EU and China seize momentum to enhance trade agreements in response to Trump’s administration

Businesses succeed internationally

International Women’s Day 2019: more equality, but change is too slow

More Stings?

Advertising

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s