Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

Sustainability reporting: five ways companies should prepare

The Cold War had an unintended side effect: It created a European wildlife paradise

Key elements of the EU-China Comprehensive Agreement on Investment

No more lead in PVC to protect public health, say MEPs

European Solidarity Corps: Commission opens new call for project proposals

4 ways to make your wardrobe more sustainable

Constant rise of COVID-19 in Brazil

MWC 2016 LIVE: Mobile World Congress shows off planes, trams and automobiles

What living abroad does to your self-awareness

This year’s Earth Hour is going digital due to the COVID-19 pandemic

‘Repeated attacks’ could close down key hospital in eastern Libya, says WHO

These social entrepreneurs are lighting up Africa

Questions & Answers on the coordination of measures restricting free movement in the European Union related to the coronavirus pandemic

Texting is a daily source of stress for 1/3 of people – are you one of them?

How to stay in shape and step up support for refugees

Who is first (and last) in the race to build a workforce fit for the future?

Civil Liberties Committee endorses EU Digital Covid Certificate

EU Ombudsman must continue push for more transparency in Council and Commission

Women outliving men ‘everywhere’, new UN health agency statistics report shows

Wednesday’s Daily Brief: mental health, conflict prevention, Ebola in Uganda, Sudan protests, child labour

Questions and answers on the EU’s Arctic Strategy

Taxes on polluting fuels are too low to encourage a shift to low-carbon alternatives

Europe plans to send satellites into space to monitor CO2 emissions

Ukraine pays the price for lying between Russia and the EU

4 steps for looking after our mental health during these unsettling times

The missiles fired against Damascus, Syria divided Europe deeply

More beehives and beekeepers thanks to EU support

Urban Waste Water: Commission decides to refer HUNGARY to the Court of Justice over waste water treatment

These are the world’s best business schools

The Internet of Bodies is here. This is how it could change our lives.

This 12-year-old built an underwater robot to fight plastic pollution

This man is sleeping out in the Davos cold to make a point about homelessness

May a parody constitute a copyright infringement? European Court of Justice to give the answer

Transition between education and employment: how the internship culture is threatening the foundations of our education

LIFE Programme: Member States to benefit from quarter of a billion euros of investments in environment, nature and climate action

Human rights breaches in Iran, Egypt and Tanzania

Why David Cameron’s large victory in UK elections will not pursue a ‘Brexit’

The five stages of the Chief Digital Officer – and why they often fail

UN Security Council urged to act against ‘worst-case scenario’ Syria’s war-battered Idlib

EU revengefully shows no mercy to Cameron by demanding a fast and sloppy Brexit now

Mali: ‘Dire’ humanitarian situation, ‘grave’ security concerns challenge fragile peace

Consumers are getting more complex. Brands need to keep up to survive

Moving from a promise made in Sweden towards hope for peace in Yemen

Antimicrobial resistance: how can an intersectoral approach between society and healthcare professionals be developed and applied?

European Commission: Does Apple, Starbucks and Fiat really pay their taxes?

Can I still send mail in the time of coronavirus?

Countries must make teaching profession more financially and intellectually attractive

LGBTQ+: The social evolution of a minority

A Sting Exclusive: “Climate change-the biggest global health threat of the 21st century, yet overlooked in climate negotiations?” IFMSA wonders from COP21 in Paris

What does the future hold for quantum computing? Experts explain

Does upgrading our minds mean losing the spark of genius?

‘Compelling case’ for urgency around global disarmament, UN-led forum told

Do doctors need to know their patients’ sexual orientation and gender identity?

Mental health In Times of a Pandemic: What can each Individual to lessen the Burden.

Statement by the European Parliament ahead of the 10 April Brexit Summit

Palestinian Bedouin community faces demolition after Israeli court ruling, warns UN rights office

Coronavirus: Commission Statement on consulting Member States on proposal to prolong and adjust State aid Temporary Framework

China’s New Normal and Its Relevance to the EU

European Commission adopts new tools for safe exchanges of personal data

For Youth Rights: steps forward for better protection.

More Stings?

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: