Thought AIs could never replace human imagination? Think again

robots imagination

(Craig Sybert, Unsplash)

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Julien Weissenberg, Founder, Artificial Intelligence Scientist, VisualSense


Back in the 1980s, Hans Moravec, an AI scientist, discovered a paradox: What is easy for humans, such as visual or auditory understanding, is hard for machines.

Things have changed since then. Today’s AIs are much better at understanding what they see. It is not that AI has caught up with all of our human visual capabilities, but rather that the technology is developing in different ways.

When we think AI, we think of pure automation. This is not true anymore. Did you think, for example, that AI could never replace portrait photographers? Think again; it doesn’t even need a model. Today we have AIs that can ‘imagine’ – that is, according to the Merriam-Webster definition, form an image of “something not present to the senses or never before wholly perceived in reality”.

The video above shows the results from an AI that has learned to generate photos of people who don’t exist. At a qualitative level, only a few artists are capable of inventing faces with photographic precision.

The secret behind AI imagination

The mechanism that gifts AI with imaginative powers has a name: Generative Adversarial Networks (GAN). GANs were partly inspired by neuroscience research. In essence, GANs consist of two entities which compete against – and learn from – each other: one learns to generate fakes, while another one learns to detect fakes. As the fake detector becomes more effective, so does the fake generator. Neuroscientists have discovered that we use a related mechanism, the actor-critic model, which is believed to be located pretty much in the middle of our brains.

If imagination is no longer a privilege of the human mind, how can we leverage AIs’ imagination? Here is a taste of what’s happening in labs right now.

Turning night into day: let there be GANs

Imagination has a direct application: guessing the representation of a subject in a different way, or in other words, translating an image from one representation to another. For instance, this AI imagines what the sketch of a photograph would look like, or what the colour version of a black and white photograph would look like.

An application of image translation is to help us see the world in a more readable way, or beyond what is visible.

Image: Computer Vision Lab, Department of Information Technology & Electrical Engineering, ETH Zurich, Switzerland

This AI, meanwhile, simulates day from a night picture. This is valuable, as creating self-driving cars that work and can locate themselves precisely in all conditions – day, night, fog, rain, snow and so on – requires a lot of data that covers all scenarios. Collecting large amounts of data in all conditions is practically very difficult, as certain conditions (such as snow) occur very rarely in some areas. Instead of collecting more data, scientists have come up with this night-to-day workaround. This could also lead to better night vision for the military, airplane pilots and human drivers.

 X-ray specs: BodyNet can guess your bodyshape from a photo

Image: Varol et al.

When something is not directly visible, GANs are used to make educated guesses. Take the case of the BodyNet AI (see above), which estimates the body shape of a person given a picture of them fully-clothed. The digital mannequin is useful for designing tailored clothing without either taking measurements by hand or the help of sophisticated body scanners.

And what if we could see through walls? This AI can literally help you track how people move behind walls. Similar to how bats see in the dark, a signal is emitted and what comes back is interpreted. Bats emit ultrasound that are reflected off the surface of nearby objects. Here, it is signals in the WiFi range that are emitted. As WiFi can go through walls but is partly reflected by our human bodies, this signal is interpreted by a deep learning architecture (see video below).

Discovery machines

The ability to make educated guesses is not limited to image generation or translations. Imagination is, in a broader sense, a tool for discovery, and has applications in diverse domains such as cybersecurity or drug design.

Modern cybersecurity tools feature AIs that can detect threats by looking at their characteristics. Researchers have designed a GAN which learns to generate pieces of malignant code that can bypass these cybersecurity detectors. That may sound scary, but the good news is we could also use it to perfect detectors of malignant code – or, if you think about it, sometimes deception can be a good thing, such as when we engineer drugs to fight diseases.

What does it mean for us?

The 4th Industrial Revolution is not just about automation, but about human-machine collaboration and symbiosis. GANs are a turning point in the development of AI, and will help us supercharge our mental capabilities.

They are also a tool with which we can study the mechanisms of imagination and help us to better understand the role of imagination in domains such as translation or discovery. Even though imagination does not equal creativity, it is one of the tools we use to invent new things. What are the missing pieces, yet to be discovered, that will enable us to build machines that can outsmart us in the creative realm as well?

the sting Milestones

Featured Stings

Can we feed everyone without unleashing disaster? Read on

These campaigners want to give a quarter of the UK back to nature

How to build a more resilient and inclusive global system

Stopping antimicrobial resistance would cost just USD 2 per person a year

Syria: Civilians caught in crossfire, UN refugee chief urges Jordan to open its border

Miguel Arias Cañete European Commission

EU should invest more in climate and not sit back on its laurels and watch

Partner countries get €3bn in loans to prop up economies affected by pandemic

Here are five tips to make your message clear in a crowded world

Autonomous vehicles could clog city centres: a lesson from Boston

Banks launch green charter to help shipping reduce its carbon footprint

What is a ‘vaccine passport’ and will you need one the next time you travel?

Migrants, asylum seekers detained in Hungary ‘deliberately deprived of food’: UN human rights office

A new approach to scaling-up renewable power in emerging markets

Think you’re safe at home? Think again. 5 household demons to be mindful about

Syrian refugees in Jordan and Lebanon should be free to earn a living

Migration crisis update: mutual actions and solidarity needed as anti-migrant policies thrive

End ‘cycle of violence’ in Gaza, UN deputy chief tells forum on Palestine

Macro-Financial Assistance: Europe’s way to control Ukraine?

The UK’s River Thames has come back to life – with a seal population to prove it

Commission takes further action to ensure professionals can fully benefit from the Single Market

MEPs push for high ambitions at the COP25 in Madrid

Close to 7,000 evacuated from Syrian towns after enduring nearly 3-year siege

Coronavirus could trigger a hunger pandemic – unless urgent action is taken

Intensifying Negotiations on transatlantic Data Privacy Flows: A Joint Press Statement by European Commissioner for Justice Didier Reynders and U.S. Secretary of Commerce Gina Raimondo

5 Black heroes of the environmental movement

Why digital inclusion must be at the centre of resetting education in Africa

Here’s how we can rethink the way we eat meat

Europe’s richest regions actively seek investment from China’s biggest banks

A Union that strives for more: the first 100 days

Why rich countries are seeing more poverty

Mali just took a huge step towards universal healthcare

Can Europe and the US reverse their nationalist and xenophobic drift? Is the West becoming belligerent?

On the first day of 2019, over 395,000 babies to be born worldwide: UNICEF

3 ways business leaders can build digital trust

First EU collective redress mechanism to protect consumers

FROM THE FIELD: For refugees and migrants in Europe, healthcare’s essential but a challenge to find

GSMA head urges regulators to help Europe regain leadership

EU budget: Commission helps prepare new Cohesion programmes with Regional Competitiveness Index and Eurobarometer

A breath of fresh air: How three disused industrial areas became beautiful parks

New rules to help consumers join forces to seek compensation

Eurogroup: IMF proposes Germany disposes

Launch of Pact for Youth: European Youth Forum calls for real business engagement

We need to measure innovation better. Here’s how

Internet milestone reached, as more than 50 per cent go online: UN telecoms agency

Young activists share four ways to create a more inclusive world

ILO discusses world of work response to global refugee crisis

Tougher defence tools against unfair imports to protect EU jobs and industry

The EU Commission does nothing about the food retailing oligopoly

Do the giant banks ‘tell’ Britain to choose a good soft Brexit and ‘remain’ or else…?

Is Eurozone heading towards a long stagnation?

Euronest: delivering reforms is the best way forward for EU’s Eastern Partners

Gender equality and medicine in the 21st century: an equity unachieved

How we measure stakeholder capitalism will determine our recovery

The European Union’s Balkan Double Standard

Sustainable Development Summit: ‘We must step up our efforts – now’, Guterres declares

Is there a de facto impossibility for the Brexit to kick-start?

World Migratory Bird Day highlights deadly risks of plastic pollution

Migration surge leaves children stranded, begging on Djibouti’s streets

Cross-border cooperation: the EU Interreg programme celebrates 30 years of bringing citizens closer together

2,300 migrant children in Central American ‘caravan’ need protection, UNICEF says

Bringing nuclear test ban treaty into force a ‘central pillar’ of global disarmament push, says UN chief

HPV vaccine: the silver bullet that saves women

Are we at the edge of anti-vaccination health crisis?

Wednesday’s Daily Brief: #NoTobacco Day, China’s economy, family farming, #ClimateAction

More Stings?

Advertising

Speak your Mind Here

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s