On the eve of the United Nations' first Global Dialogue on AI Governance, a coalition of more than 100 international organisations—including Amnesty International and Save the Children—has issued a joint call for governments to make artificial intelligence safe for children. The group, coordinated by the children's rights organisation 5Rights Foundation, argues that current regulatory approaches are failing minors by intervening only after harm has occurred.
In a statement released Monday, the coalition warns that AI is already causing real damage to children, pointing to a surge in lawsuits against companies such as Character Technologies and OpenAI. These cases centre on the effects of "companion" chatbots designed to simulate ongoing emotional relationships, which critics say are marketed as safe for children without adequate warnings about psychological risks.
Targeting Business Models, Not Just Content
The coalition's message is blunt: governments should focus on the business models driving the problem rather than merely policing content. "Children have given us a clear diagnosis of the problem," said Leanda Barrington-Leach, 5Rights' executive director. "They aren't asking us to block AI innovation, but it shouldn't be a case of cleaning up the mess after harm has happened either."
The group outlines ten specific measures it wants governments to adopt. These include requiring companies to prove AI systems are safe for children before they are released, imposing financial penalties on firms whose products violate children's rights, banning design features that exploit children's psychological vulnerabilities, and outlawing the commercial use of children's images, voices, and biometric data.
Importantly, the coalition argues that no new legislation is necessary to achieve these goals. Instead, it calls for enforcement of commitments governments have already made under the UN Convention on the Rights of the Child and the UN's Global Digital Compact—a framework that obliges states to uphold international law and human rights online.
The timing of the appeal is significant. The UN summit in Geneva this week marks the first time the international body has convened a dedicated forum on AI governance, reflecting growing concern across Europe and beyond about the technology's societal impact. European Union lawmakers are already advancing the AI Act, which includes provisions for high-risk systems, but critics say it lacks specific safeguards for minors.
In Brussels, the European Commission has been under pressure from child rights advocates to strengthen the AI Act's provisions on age-appropriate design and transparency. The 5Rights-led coalition's call adds weight to those demands, particularly as the EU prepares to finalise its regulatory framework later this year.
Across the continent, national governments are also grappling with the issue. In France, the Conseil d'État has been examining the legality of AI-driven surveillance tools in schools, while Germany's Bundestag has held hearings on the psychological effects of chatbots on teenagers. The UK's Information Commissioner's Office has already fined several tech firms for failing to protect children's data under the Age Appropriate Design Code.
The coalition's emphasis on enforcement rather than new laws reflects a pragmatic assessment of the political landscape. With the UN summit expected to produce only a non-binding declaration, the real test will be whether member states—from Paris to Tallinn—translate existing commitments into concrete action.
As Barrington-Leach put it: "The tools are already in place. What's missing is the political will to use them."
