‘Losing the battle’: AI hands predators new ways to target children

This article is published in association with European Investment Bank.
(Credit: Unsplash)

This article is published in association with United Nations.


Artificial intelligence (AI) is handing predators and criminal groups new ways to groom, extort and exploit children, while efforts to protect them are failing to keep pace, senior UN officials warned on Thursday.

“We lost the battle on social media because we were lagging behind, and we are now losing the battle on artificial intelligence because we are still lagging behind,” said Dr. Najat Maalla M’jid, the UN Special Representative of the Secretary-General on Violence against Children.

She was speaking during a high-level event in the General Assembly on the risks and opportunities of AI to help end the scourge.

In the past year alone, at least 1.2 million children in 11 countries had their images manipulated into sexually explicit deepfakes, UN Deputy Secretary-General Amina Mohammed told the event at UN Headquarters in New York, citing a recent study by the UN Children’s Fund (UNICEF).

Reports of child sexual abuse material linked to generative AI rose by 1,325 per cent between 2023 and 2024, according to the US National Center for Missing and Exploited Children, said Dr. M’jid, noting that most AI-facilitated crimes against children remain unreported and under prosecuted.

‘Weaponising technology’

Chatbots are being used to gain children’s trust, gather personal information and coerce them into sharing explicit images, she said, while deepfakes made with “nudification” apps are used to humiliate, threaten and exploit them.

Profiling and predictive targeting allow predators, traffickers and criminal groups to reach vulnerable children more easily.

John Trenary who has worked on child exploitation investigations for more than 25 years, said predators have always sought ways of “weaponizing technology to exploit our kids”.

But because AI can scale so efficiently – automate and create wholly synthetic content – its weaponisation is “self-perpetuating”, he warned. As soon as investigators get a handle on one way predators misuse it, “something else comes out”.

Kay Chau of the Tech Coalition – a non-profit alliance focused on child protection – said perpetrators may be using chatbots to facilitate abusive role-play or generate grooming scripts, while agentic AI (systems that can carry out tasks independently) is introducing new risks.

‘Lucia is our agent’

Mariana Rozo-Paz of the Datasphere Initiative recalled working with teenage girls on a digital literacy programme in rural Colombia last year. Asked to draw what the internet looked like, the girls drew a girl named Lucia – their AI agent.

“We talk to Lucia every day,” they told her. “Whenever adults don’t want to answer specific questions, we ask Lucia. She’s always there for us. She has intimate mode, best friend mode.”

‘Proven safe’

“We would never accept a children’s toy being put on the market without proper safety checks, but AI systems are reaching children without the same scrutiny,” Ms. Mohammed said. “We cannot leave their safety to the goodwill of technology companies.”

In July, Secretary-General António Guterres launched the AI Child Safety Pledge. Its aims include making AI systems certifiably safe before they reach children, and zero tolerance of AI-generated child sexual abuse material.

Voluntary approaches by the tech sector are insufficient, Dr. M’jid said, calling for global standards at the core of AI governance, including mandatory child safety and privacy by design.

AI can also help detect abuse material, identify victims and spot early signs of grooming, added the Deputy Secretary-General.

In a World Childhood Foundation study, a young person in Sweden put it this way: “The technology is really cool. But you can tell that the people in charge of controlling it cannot keep up.”

“Children should never have to tell us that the adults responsible for their safety cannot keep up,” said the foundation’s Secretary General, Paula Guillet de Monthoux.

“It is our responsibility to prove that we can.”


Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

Interesting reads

This article is published in association with European Investment Bank.

‘Losing the battle’: AI hands predators new ways to target children

This article is published in association with United Nations. Artificial intelligence (AI) is handing predators and criminal groups new ways to groom, extort and exploit children, while efforts to protect them are failing to keep pace, senior UN officials warned on Thursday. “We lost the battle on social media because we were lagging behind, and […]
© UN News/Laura Quinones UN Climate Conference in Antalya, Türkiye.

COP31 deadlock persists as countries launch new ‘climate reality check’

This article is published in association with United Nations. With the clock running down at COP31 in Antalya, countries on Wednesday launched a new global check on whether climate promises are being kept, even as ministers remained deadlocked over some of the summit’s toughest questions: who pays, how fast the world moves away from fossil […]
© UNOCHA/Viktoriia Andriievska A man enters a bombed building in Kyiv, Ukraine.

Ukraine: Civilian casualties in 2026 already far exceed previous years’ tolls

This article is published in association with United Nations. This year has seen dramatically higher civilian casualties in Ukraine than any other year since the full-scale invasion of the eastern European country by Russia in February 2022, the UN Human Rights Monitoring Mission in Ukraine (HRMMU) said on Tuesday. In October 2026, the number of […]
© UN Climate Change/Kubilay Citfci UN Climate Conference in Antalya, Türkiye.

COP31 enters decisive week as climate talks face political test and AI initiatives gather pace

This article is published in association with United Nations. New international initiatives on artificial intelligence and green industrialization showcased technology’s growing role in climate action, even as negotiators remained deadlocked on finance, fossil fuels and adaptation ahead of the final stretch of the UN talks. Today at COP31 As COP31 entered its second and final […]
UN Social Media/ María Fernández del Moral COP31 press conference to launch the Priorities for Action on AI for Climate Information Integrity.

COP31: New initiative targets AI and reliable climate change information

This article is published in association with United Nations. New guidance has been issued to ensure that people everywhere can obtain credible climate change information from artificial intelligence (AI) and understand how the technology impacts the environment. The Priorities for Action on AI and Climate Information Integrity were launched at the COP31 climate conference in […]
UN News A partially collapsed residential building in the city of Deir al-Balah, Gaza, after residents were evacuated amid heavy rain and strong winds.

Six killed in Israeli airstrike on Gaza’s Nasser Hospital

This article is published in association with United Nations. An Israeli airstrike on Gaza’s Nasser Hospital on Wednesday night killed six people, injured 27 others and caused extensive damage. Ramiz Alakbarov, the UN Special Coordinator for the Middle East Peace Process ad interim, on Thursday said he was deeply alarmed by the attack.” The strike […]
© UN News/Laura Quinones Sunrise over COP31 as participants arrived as early as 5am to avoid traffic closures.

‘Make or bake time’: Guterres urges climate justice pact as leaders gather at COP31

This article is published in association with United Nations. UN chief António Guterres called for a new global climate justice agreement at COP31 on Wednesday, urging governments to tax fossil fuel companies to help countries bearing the brunt of a crisis they did little to cause. His appeal came as world leaders gathered in Antalya […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Gaza winter aid: ‘No more delay’, Fletcher tells governments stalling on support

© UNRWA Children play outside tents in Gaza. This article is published in association with United Nations. The UN’s Emergency Relief Coordinator, Tom Fletcher, expressed deep concern about the deteriorating humanitarian situation in Gaza, as UN member states and partners have been repeatedly delaying sending their support to the Strip. “Foreign Ministers and partners have […]
This article is published in association with United Nations.l student with a strong interest in research and global health.

COP31: Energy transition takes centre stage as countries map path beyond fossil fuels

This article is published in association with United Nations. The global energy transition took centre stage on the second day of COP31, as countries explored how to move away from fossil fuels, accelerate clean energy and overcome financial and infrastructure barriers standing in the way. Today at COP31 Energy and Transport Day at COP31 got […]
UN News Two children stand in a rain-soaked tent in Deir al-Balah, Gaza.

Children among the dead as heavy rains flood tents and shelters in Gaza

This article is published in association with United Nations. An infant reportedly drowned and five Gazans were killed – including three children – when a sand dune collapsed on their tents as the first heavy rains swept across the enclave at the weekend, according to the UN aid coordination office (OCHA). Thousands of families lost […]
© EducAid “Before [this], the difference was huge – I used to carry Anas, and he had to crawl on his hands,” said Anas’s mother.

‘For the first time I have my own chair’: Gaza siblings find new freedom

This article is published in association with United Nations. In Gaza, 10-year-old Anas is one of three siblings born without legs and with only two fingers on each of their hands. They struggle to move around and perform daily activities like eating and writing independently. With funding from the UN’s aid coordination office (OCHA), and […]
© UNICEF A child looks out from a makeshift shelter in Rafah, in the south of the Gaza Strip.

Gunfire damages tents at Rafah displacement site in Gaza, as aid teams prepare for winter storms

This article is published in association with United Nations. Gunfire hit and damaged multiple tents at a displacement site in Gaza’s northern Rafah region on Tuesday, reportedly causing injuries and forcing a humanitarian partner to leave the area, the UN aid coordination office (OCHA) has said. The NGO had been working on flood control ahead […]
© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon..

UN peacekeeping chief warns of ‘security vacuum’ as Blue Helmets leave Lebanon and Western Sahara

© UNIFIL UNIFIL remains a critical stabilising factor in south Lebanon.. This article is published in association with United Nations. The UN’s peacekeeping chief warned on Wednesday that the withdrawal of “Blue Helmets” from Lebanon and Western Sahara risks leaving a dangerous security vacuum, while the Security Council remains divided over what, if anything, should […]
© IOM/Haithm Abdulbaqi Young people in Yemen play football on a sandy pitch.

15 years of ‘almost no progress’ in getting young people moving: WHO

This article is published in association with United Nations. One in four adolescents worldwide reported not getting at least 60 minutes of physical activity on any day in the previous week, according to new global estimates released by the World Health Organization (WHO) on Wednesday. That amounts to some 240 million young people aged 11 […]
© UNICEF/Sultan Mahmu A mother and daughter wade through floodwaters in Feni, southeastern Bangladesh.

COP31 explained: What’s at stake at this year’s UN climate summit?

This article is published in association with United Nations. The world has more tools than ever to tackle climate change, yet millions remain unable to benefit from them. As clean energy technologies advance faster than ever, the challenge facing countries at COP31 is no longer just finding solutions – but making sure everyone can afford […]
© UNICEF/Christina Pashkina A school in Chuhuiv, Ukraine, lies in ruins after being hit by a missile.

Air raid alerts and attacks on schools: the devastating face of education in Ukraine

This article is published in association with United Nations. Ukraine has sustained almost 2,000 attacks on education since the full-scale Russian invasion in 2022, with some 270 this year alone, the UN Children’s Fund (UNICEF) said on Tuesday, a day after a strike at a school being used to distribute aid. Tweet URL Since the […]
© UNICEF/Oleksii Filippov People walk past a war-damaged building in Ukraine.

Ukraine: WFP provides hot meals to Oleshky evacuees as UN pushes to restore power before winter

This article is published in association with United Nations. The UN World Food Programme (WFP) is providing emergency food assistance to more than 400 people who were able to leave the Russian-occupied city of Oleshky, in Ukraine’s Kherson region, during a brief local ceasefire. Many arrived in worrying condition at medical facilities in Kyiv on […]

COP17: Nations chart ‘Yerevan Pathway’ to speed up action for nature

This article is published in association with United Nations. At the halfway mark to 2030, countries meeting in Armenia have agreed a roadmap to accelerate action for nature, after a global review found the world off track to meet its biodiversity targets. Agreement was formalised through the Yerevan Pathway as the UN Biodiversity Conference (COP17) […]
This article is published in association with United Nations.

AI is changing the way we think. The question is whether we’ll notice in time

This article is published in association with United Nations. Artificial intelligence promises to make life easier. With a few keystrokes, it can write emails, summarize reports, generate ideas and answer complex questions in seconds. For many people, it feels like a technological leap on par with the arrival of the internet itself. But according to […]

Why don't you drop your comment here?

Go back up

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe now to keep reading and get access to the full archive.

Continue reading

The European Sting – Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology – europeansting.com