Why AI companies should develop child-friendly toys and how to incentivize them

July 25, 2022 by World Economic Forum Leave a Comment

This article is brought to you thanks to the collaboration of The European Sting with the World Economic Forum.

Author: Karolina La Fors, Generation AI Fellow, World Economic Forum and DesignLab University of Twente, Benjamin Larsen, Project Lead, World Economic Forum

Smart toys are proliferating rapidly across the globe, displaying new risks and opportunities for the youngest generation.
Several emerging regulations set minimum requirements for smart toy manufacturers in areas such as cybersecurity and online safety.
Where regulations may have limitations, initiatives such as the Smart Toy Awards actively incentivize smart toy developers to set children’s wellbeing and developmental needs as their utmost interaction design priority.

AI-enabled smart toys come in an exponentially growing diversity and inhibit the most known social environments of children. The Market Research Future group, for instance, projects that the global market share of such toys will grow by 26% and reach 107.02 billion USD by 2030. Through their growing interaction with children, transferability across contexts, connectivity to other AI-enabled devices, and the ways in which children unconsciously entangle with them, AI-enabled toys regularly impact the upbringing of the youngest generation.

Exposure to online safety risks

Smart toys, as highlighted by the Generation AI Initiative of the World Economic Forum, can exhibit highly positive effects on children’s development when designed responsibly. Complaints received by the Federal Trade Commission (FTC) as well as an investigation of the Norwegian Consumer Organisation and rich scholarly research however also point to the severe impacts that smart toys can have on children’s development.

The non-transparent ways in which some smart toys exchange data for algorithmic analysis with other AI-enabled devices, e.g., through Bluetooth connection, demonstrate how weak cyber security features can violate children’s privacy and jeopardize safety. Smart toys can exacerbate children’s exposure to online safety risks, such as “‘content’ risks (e.g. exposure to harmful or age-inappropriate material); ‘contact’ risks (e.g. exposure to unsolicited contact from adults); ‘conduct’ risks (e.g. cyberbullying); and ‘contract’ risks (e.g. data harvesting, commercial pressure and exhortations to gamble)” as defined by the 5Rights Foundation.

Legal mechanisms internationally govern the proliferation of AI-powered toys and the mitigation of such risks. The EU’s Cyber Security Act poses minimum requirements for smart toy developers, which have to design toys that exhibit strong cybersecurity features when products are marketed in the EU. The European AI Act, which is expected to go into effect in 2024, introduces a four-tiered risk framework to evaluate artificial intelligence technologies and also requires smart toy innovators to assess the impact of their AI systems against ”reasonably foreseeable misuse”. AI-enabled smart toys that are exploitative of children are outright banned by the regulation. The EU’s Digital Services Act also protects youth by banning AI-enabled targeted advertising through profiling children. A U.S. federal law, the Children’s Online Privacy Protection Act (COPPA) sets age-appropriate access criteria and exchange of content on websites as a requirement. The FTC has recently also introduced a cyber security labeling programme to protect consumers from AI system breaches.

Protecting the interest of children and youth

Beyond laws, standards and policy frameworks are also effective in having a positive influence on smart toy developers. The IEEE Standard for an Age-Appropriate Digital Services Framework serves as a robust international means for smart toy companies to comply with. UNICEF’s Policy Guidance on AI for Children offers recommendations for building AI policies and systems that uphold child rights. The World Economic Forum’s AI for Children Toolkit, is another means to encourage companies to innovate responsible AI-powered toys by better protecting the interests of children and youth. While there are laws and measures that govern the diffusion of smart toys, these may fall short to incentivize the innovation of child development oriented products.

UNICEF has provided several case studies on smart toys that display current best practices. Mattel has, for instance, collaborated with ToyTalk to release guidance that addresses parents’ privacy concerns. Parents are enabled to access any recorded data on ToyTalk’s cloud account while being able to delete any information. ToyTalk also participates in the FTC’s KidSafe Seal Program, which is a compliance program for online services that target children.

Diverse AI-enabled toy innovations have, by now, also demonstrated how AI systems can impact children’s development positively. NAO, an educational robot, is a smart toy example that teaches children by enabling them to spot and correct mistakes as part of their interactions and forms of learning. PlayShifu, a startup from India has grown since its establishment in 2016 into a global company of diverse, interactive smart toys which align with educational research, child development and parental needs. ROYBI Robot is a smart companion that introduces kids to technology, math, science, and languages such as English, Mandarin, and Spanish.

The Smart Toy Awards

The Smart Toy Awards, cohosted in 2022 by the World Economic Forum and the Dubai Future Foundation, exemplifies an active means to incentivize smart toy developers to prioritize children’s developmental needs when designing AI-enabled toys across the globe. The Smart Toy Awards offer winners a unique competitive advantage by showcasing how smart toy manufacturers can go beyond legal compliance and offer children and parents safe, nurturing, and playful experiences.

Beyond relevant regulations, the judging criteria for the Smart Toy Awards also rests upon the FIRST principles of the AI for Children Toolkit. The toolkit encourages companies to demonstrate how their toys display fair, inclusive, responsible, safe and transparent characteristics, and it offers actionable guidance for companies, parents and leaders to better grasp the benefits and risks of AI-enabled toys.

Next to children’s rights impact assessments, using the FIRST principles as a requirement for companies to enter the competition, the Smart Toy Awards manifests how the competition can trigger diverse child-friendly smart toy innovations. Winners of the Smart Toy Awards receive an honorary badge that can be used on their products, which may help parents better understand what it takes for a toy to display responsible AI behavior in interaction with children.

Innovation needs to respond to developmental needs and children’s wellbeing

As the influence of AI-enabled smart toys on the youngest generation continues to broaden it is imperative that smart toy innovation is triggered by children’s developmental needs. Companies committed to adopt children-centric governance models on a voluntary basis, will champion not only among AI innovators but most of all among members of the youngest generation and parents.

Discover more from The European Sting - Critical News & Insights on European Politics, Economy, Foreign Affairs, Business & Technology - europeansting.com

Subscribe to get the latest posts sent to your email.

© UN Ukraine The aftermath of a drone attack in a residential area in Kyiv on 12 October.

Ukraine: Residents killed and dozens injured in attacks on Kharkiv and Kyiv

October 14, 2026

This article is published in association with United Nations. Russian attacks in recent days on on Ukraine’s two largest cities have again killed and injured civilians, damaged homes and civilian infrastructure, the UN aid coordination office (OCHA) said on Tuesday. Aid workers and rescuers were on the ground in Kyiv and Kharkiv following aerial strikes that […]

© IOM The war in Sudan has created extreme levels of displacement, both internally and across Sudan’s borders.

‘Efficiency has limits’: UNHCR chief warns refugee protection is buckling under cuts

October 13, 2026

This article is published in association with United Nations. The money is running out faster than needs are growing: with 117 million men, women and children now forced from their homes, the UN refugee agency (UNHCR) has received just $3 billion of the $8.5 billion it needs this year – and its chief, Barham Salih, warns […]

© UNOCHA/Ramatoulaye Moussa Maz A woman walks through a camp for displaced people in Ituri Province in eastern DR Congo, where decades of violence have impacted millions, creating a humanitarian emergency.

Rise in poverty is ‘a wake-up call for the world’, UN development chief says

October 13, 2026

This article is published in association with United Nations. The number of people living in “multidimensional” poverty has risen for the first time in 15 years, reaching 1.2 billion, as families struggle to meet their basic needs. The finding comes in the 2026 update of the global Multidimensional Poverty Index (MPI) published by the United Nations […]

© UNDP Nidaa with the chickens and ducks she raises in Gaza.

Sustaining livelihoods amid crisis in Gaza

October 12, 2026

This article is published in association with United Nations. Nidaa, Hanaa and Hanin have different stories, but share a common thread: the determination to build something of their own and keep it going despite extraordinary challenges facing them in war-ravaged Gaza. Following the devastation of the past three years, productive capacity in Gaza has been severely […]

© UNICEF/Oleksii Filippov A firefighter works on the balcony of a wrecked building in Kyiv, Ukraine.

World News in Brief: Russian attacks continue in Ukraine, Gazans shelter in flood-prone areas, keeping sight of eye health

October 9, 2026

This article is published in association with United Nations. UN human rights chief Volker Türk said on Thursday he was appalled by a wave of attacks that have killed civilians across Ukraine over the past four days. They include a strike on two public buses in Kramatorsk on Thursday, that left at least 30 civilians dead, […]

Ukraine: UN condemns latest attacks and calls for civilian protection

October 8, 2026

This article is published in association with United Nations. The UN Humanitarian Coordinator for Ukraine on Wednesday called for an end to attacks against civilians following further overnight strikes by Russian forces that reportedly killed at least 19 in the Chernihiv Region. Among the dead in Pryluky were five children, three of them babies, according to the […]

© UNICEF-SoP/Crickx People walk down a dusty road in the West Bank carrying belongings.

Israeli demolition in East Jerusalem displaces 69 Palestinians

October 7, 2026

This article is published in association with United Nations. Sixty-nine Palestinians – more than half of them children – were displaced on Tuesday after Israeli authorities green lit the demolition of their residential building in the At Tur area of East Jerusalem, the UN aid coordination office (OCHA) has reported. This is the highest number of […]

‘The clock on AI regulation is ticking’, warns UN rights chief

October 6, 2026

This article is published in association with United Nations. The world is running out of time to put guardrails on artificial intelligence, UN High Commissioner for Human Rights Volker Türk warned Monday, as a “ruthless race” between companies and countries raises concerns about human safety and even humanity’s survival. Speaking in the UK at an AI […]

© UNOCHA/Alina Basiuk A school in Ukraine lies in ruins after being hit by a missile.

Ukraine war ‘a human rights catastrophe’ that must end, says Türk

October 5, 2026

This article is published in association with United Nations. Human Rights The war in Ukraine is a human rights catastrophe that is “growing and intensifying by the week” and threatening an even greater disaster across the region, UN High Commissioner for Human Rights Volker Türk said on Friday. Addressing the Human Rights Council in Geneva, Mr. […]

UN News Massive tent settlement of displaced residents extends along the damaged Gaza coastline.

Palestinians yearn for ‘a return to normal life’, says top Middle East peace envoy

October 2, 2026

This article is published in association with United Nations. The UN is continuing efforts to support Palestinians in Gaza amid major challenges to humanitarian access, reconstruction and the restoration of essential services, according to Ramiz Alakbarov, Acting UN Special Coordinator for the Middle East Peace Process. Speaking to UN News on the margins of the UN […]

©UNIFIL/Tilak Pokharel UNIFIL personnel distribute food kits to displaced families in Saida, Lebanon (file).

Lebanon: One in five children goes to bed hungry, says UNICEF

October 1, 2026

This article is published in association with United Nations. Four in five households in Lebanon struggle to afford basic necessities today, with children increasingly going without food, missing school and being pushed into work as conflict compounds years of economic crisis. “I wanted to buy clothes for my children, but I could not. I also wanted […]

World News in Brief: Deadly Myanmar strikes as Malaysia begins deportations, new emergency funding released, Gaza and West Bank update

September 30, 2026

The UN chief on Tuesday strongly condemned an airstrike that reportedly killed at least 50 people at a market in Myanmar’s Rakhine state and called for those responsible to be held to account. Forces from the military junta reportedly hit Kyauktaw township around midday on Monday, when the market’s more than 200 shops were busy […]

This article is published in association with European Investment Bank.

EU provides €61 million in humanitarian aid amidst rapidly deteriorating situation in Ethiopia

September 29, 2026

This article is brought to you in association with the European Commission. Amid fears of renewed conflict in Northern Ethiopia, the European Union is providing €61 million in humanitarian funding to help the most vulnerable people in Ethiopia affected by conflict, displacement, disease outbreaks and climate-related hazards, including the impact of El Niño. The European Union […]

© UNDP A worker installs solar panels in Lanao del Sur in the Philippines.

From energy crisis to energy transition: How renewables are reshaping energy security

September 29, 2026

This article is published in association with United Nations. The continuing conflict in the Middle East is disrupting global energy markets and pushing up fuel prices, with knock-on effects far beyond the region. For Francesco La Camera, Director-General of the International Renewable Energy Agency (IRENA), the crisis is also reshaping how the world understands the phrase […]

Countries adopted on Saturday a new global blueprint for tackling rapidly evolving forms of crime, as the UN’s largest gathering on crime prevention and criminal justice opened in Abu Dhabi with a call for stronger international cooperation. The Abu Dhabi Declaration was adopted by acclamation at the opening of the 15th United Nations Congress on Crime Prevention and Criminal Justice, bringing governments together around challenges ranging from cybercrime and fraud to the growing criminal exploitation of digital technology. The Declaration highlights an increasingly complex landscape in which services, infrastructure and technology can be exploited by criminals, including emerging trends described as “crime as a service” and “violence as a service”. At the same time, countries committed to making greater use of technology themselves, including by digitalizing justice systems and harnessing artificial intelligence in criminal justice responses. The Declaration stresses that safeguards must accompany those changes, including human oversight, transparency, due process and data protection. ‘Justice cannot be a privilege’ In a video message to the Congress, UN Deputy Secretary-General Amina Mohammed said the meeting was taking place at a time of profound change. “Justice cannot be a privilege. It must protect every person, uphold every person’s rights and leave no one behind,” said Ms. Mohamed. “This Congress is an opportunity to renew our shared commitment to justice and the rule of law, and to translate that commitment into action.” Countries are already being encouraged to put the Declaration into practice through the voluntary Pledge4Justice initiative, under which participating governments are announcing concrete, time-bound actions on crime prevention and criminal justice through 2031. The Abu Dhabi National Exhibition Centre with its curved glass tower and surrounding buildings reflected in calm water at dusk. UNODC The Abu Dhabi National Exhibition Centre where the 15th UN Crime Congress is set to take place. From Kyoto to Abu Dhabi Opening the Congress, UN Office on Drugs and Crime (UNODC) Executive Director Monica Juma framed the gathering as both a response to a changing criminal landscape and a test of international cooperation. “Today, the world convenes in Abu Dhabi to reaffirm that the rule of law and criminal justice are essential to the safety and security of people and the planet,” said Ms. Juma. “At a time when confidence in multilateralism is faltering, let Abu Dhabi be a testament to international cooperation.” Five years after the previous Congress in Kyoto, Japan, Ms. Juma said the world had reached another “inflection point”, with technology and artificial intelligence advancing at extraordinary speed. The same platforms connecting billions of people can also connect criminals, she warned, while digital currencies can conceal illicit profits and digital tools can be used to deceive, manipulate and exploit. Technology, she argued, is not simply accelerating crime but changing its character, while organized criminal networks increasingly exploit weaknesses across borders and institutions. Tweet URL Protecting people as the ‘north star’ Behind those broad trends, Ms. Juma urged delegates to focus on the people most exposed to harm, including children recruited by gangs, women facing violence at home or online, people unable to obtain legal assistance and young people lured into scam networks with promises of a better future. “Protecting these people must be the measure against which we judge our efforts over the coming week,” she said. “It must be our north star.” She called for laws and institutions capable of keeping pace with changing threats, greater access to justice and legal aid, and technology that serves as “a force for good” rather than an accelerator of harm. And while welcoming the Abu Dhabi Declaration as a starting point, Ms. Juma stressed that its impact would ultimately depend on implementation. A week focused on justice Hosted by the United Arab Emirates, the Congress runs through 1 October under the theme Protecting People and Planet in the Digital Age. Some 119 countries are represented, alongside more than 40 justice ministers and other senior officials, with over 5,100 participants from governments, civil society, academia and the private sector. Plenary meetings, workshops, side events and exhibitions will run throughout the session. Organizers are also billing this as the most youth-inclusive Crime Congress yet. Young people are participating in workshops, contributing to follow-up efforts and taking part in a dedicated Youth Lab and art exhibition, following a Youth Forum held ahead of the Congress on 24 and 25 September. UNODC serves as secretariat of the Congress and will support implementation of the Abu Dhabi Declaration.

Countries adopt global blueprint to tackle fast-evolving crime in digital age

September 28, 2026

This article is published in association with United Nations. Countries adopted on Saturday a new global blueprint for tackling rapidly evolving forms of crime, as the UN’s largest gathering on crime prevention and criminal justice opened in Abu Dhabi with a call for stronger international cooperation. The Abu Dhabi Declaration was adopted by acclamation at the […]

United Nations President Mahmoud Abbas of the State of Palestine addresses the General Debate of the UN General Assembly’s 81st session.

Palestinian existence under threat, Abbas tells UN, warning of ‘another Nakba’

September 25, 2026

This article is published in association with United Nations. Israeli policies now threaten “the very life and existence of the Palestinian people on their homeland”, Palestinian President Mahmoud Abbas told the UN General Assembly on Thursday, urging the world not to allow “another Nakba”. Mr. Abbas addressed the Assembly’s annual debate via pre-recorded video after his […]

© UNICEF/Oleksii Filippov A rescue worker stands outside a residential building in Kyiv’s Solomianskyi district that was severely damaged during a massive overnight attack on the city.

World News in Brief: ‘New intensity’ to Russian attacks on Ukraine, Yemen, Gaza and Colombia updates

September 25, 2026

This article is published in association with United Nations. Russian armed forces have carried out repeated attacks across Ukraine over the past several days, killing and injuring civilians and damaging homes, hospitals, shops and workplaces, UN human rights monitors said on Thursday. The attacks have involved ballistic and cruise missiles, drones and guided aerial bombs. Between […]

UN Photo/Loey Felipe President Volodymyr Zelenskyy of Ukraine addresses the General Debate of the UN General Assembly’s 81st session.

Zelenskyy urges stronger pressure on Russia, warns war’s impact is spreading beyond Ukraine

September 24, 2026

This article is published in association with United Nations. Ukrainian President Volodymyr Zelenskyy on Wednesday called for intensified pressure on Russia to end its war against Ukraine, arguing that Moscow continues to incur massive losses while prolonging a conflict whose consequences are increasingly being felt far beyond the battlefield. Addressing the UN General Assembly’s annual debate, […]

UN Photo/Loey Felipe President Donald Trump of the United States addresses the General Debate of the UN General Assembly’s 81st session.

Trump defends military action against Iran, Venezuela, and calls for rebrand of AI

September 23, 2026

This article is published in association with United Nations. US President Donald Trump used his address to the UN General Assembly on Tuesday to defend recent military action against Iran, urging countries to maintain economic pressure on Tehran – and declaring that he now faces a choice between making a deal, or taking far more drastic […]