Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

Advertising

the sting Milestone

Featured Stings

Stopping antimicrobial resistance would cost just USD 2 per person a year

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

How the media can be a meaningful stakeholder in the quest to meet the SDGs

Migration: Better travel safe than sorry

Release of prize-winning Reuters journalists in Myanmar welcomed by UN

How distorted is the EU labour market by this crisis?

What if Trump wins the November election and Renzi loses the December referendum?

Why is the World Health Organisation so much needed?

Stop violence against women: Statement by the European Commission and the High Representative

After Brexit and Grexit, Brussels to deal with Poloust

EU Youth Conference concludes in Luxembourg with concrete plans on how to create real youth participation

De-escalate now, to steer Yemen off ‘precarious path’, UN Security Council hears

JADE Spring Meeting 2017 – day 3: JADE Academy trainings, networking session and gala dinner – Excellence Awards winners revealed

It’s time to ‘eliminate the scourge of conflict-related sexual violence’, urges UN chief

South Korea: A cherished partner for the EU

Costa Rica is one of the world’s happiest countries. Here’s what it does differently

UN Security Council condemns Taliban offensive as a blow against ‘sustainable peace’

Cum-ex tax fraud scandal: MEPs call for inquiry, justice, and stronger tax authorities

Barcelona’s ‘superblocks’ could save lives and cut pollution, says report

The European Sting @ European Business Summit 2014 – the preview

Mergers: Commission opens in-depth investigation into joint ventures proposed by Boeing and Embraer

AI will drive the societies of the future. Will the governed consent?

Trade in fake Italian goods costs economy billions of euros

Diversity training doesn’t change people’s behaviour. We need to find out what does

UN Security Council welcomes results of Mali’s presidential elections

The Stray

Syria: A bloody tracer of Trump – Putin rapprochement

Drought in Europe: Commission presents additional measures to support farmers

World cannot be transformed without ‘ingenuity of the countries of the South’: UN Chief

Women’s voices must be heard in the battle to save the ocean

Climate emergency: City mayors are ‘world’s first responders’, says UN chief

How data can empower patients to personalize and improve their cancer treatment

New round of bargaining for the 2014 EU budget late in autumn

No better year for the EU’s weak chain links

Shaping Europe’s digital future: op-ed by Ursula von der Leyen, President of the European Commission

German opposition win in Lower Saxony felt all over Europe

Cities are easy prey for cybercriminals. Here’s how they can fight back

Treaty prohibiting nuclear weapons marks first anniversary, but still lacks sufficient numbers to become law

In 2020 Asia will have the world’s largest GDP. Here’s what that means

Iraqis paying an ‘unthinkable price’ to be heard, UN envoy tells politicians in Baghdad

The COP22 is under full deployment while Donald Trump threatens openly to withdraw the US from the Paris agreement

E-Governance: A powerful tool to combat, mitigate and sustainably manage disaster risks

7 ways for businesses to capture the youth dividend

Coronavirus: Commission offers financing to innovative vaccines company CureVac

Privatization of the health sector and the right to receive treatment

These LGBTQI Davos leaders shared their advice on coming out

More funds needed to counter ‘persistent and multi-faceted humanitarian problems’ in Ethiopia

Youth Forum welcomes European Commission proposal to speed up financing for youth employment

International Court of Justice orders Pakistan to review death penalty for Indian accused of spying

Exchanges of medical students and the true understanding of global health issues

‘We are nowhere closer’ to Israeli-Palestinian peace deal, than a year ago, Security Council hears

Future Forces Forum: Prague will be hosting the most important project in the field of Defence and Security

‘Starvation’ now a reality for displaced Syrians stranded in camp near Jordanian border

Look to cities, not nation-states, to solve our biggest challenges

COP25: Developing nation’s strike hard

Top UN official urges Russia and Ukraine to step away from further confrontation at sea

Why exchange programs are essential for the medical students of the 21st century

Ebola: EU announces new funds to strengthen preparedness in Burundi

The hidden downsides of autonomous vehicles – and how to avoid them

3 ways to fix the way we fund humanitarian relief

Sustainable fishing staying afloat in developed world, sinking in poorer regions

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s