French President Emmanuel Macron has called for artificial intelligence to be banned in any context where it could harm the mental health of minors. Speaking to the French daily Les Echos on Monday, Macron said that "if there is a risk for children with certain uses of AI, then it must be banned." He stressed that AI should not become a "Wild West," and that restrictions are necessary when applications "threaten" the "mental health or the brain" of young people.
The comments come as France prepares to adopt a charter on AI safety at the Paris Peace Forum. A committee of experts is due to present recommendations to Macron on Tuesday, focusing on protections against AI—an area that remains less studied than the impact of social media. The charter, which is "intended to inform national and European legislative debates," will bring together major players including US-based OpenAI and Anthropic, according to the Élysée.
Pre-market audits and certification
Under the proposed framework, companies would commit to independent evaluations of generative AI systems before they are released, as well as granting access to their models' data. Macron said firms would accept "the principle of a pre-audit and pre-certification, with a prior review of the models before putting them in children's hands." This approach aims to create a safety net before products reach vulnerable users.
Macron also framed the initiative as a stepping stone for broader regulation. "We are going to advance European regulation and push for the Americans, the Canadians, and others to do as we do," he said. "We are in the process of creating the beginnings of frontier AI regulation." He identified three categories of danger that need addressing: threats to children, democratic security, and major national security issues.
The French president convened a videoconference with around 50 heads of state and government, representatives of international organisations, companies, and researchers to discuss collective security risks posed by AI. Participants included the prime ministers of Britain, Canada, Norway, the Netherlands, and Japan, as well as the CEOs of OpenAI, Anthropic, Mistral, and Microsoft. In a post on X, Macron said, "The diagnosis is shared. We must act together."
Diverging global approaches
The announcement comes at a time when regulatory approaches to AI are diverging sharply between the United States, the European Union, and China. The EU is holding its first summit of national AI ministers on Friday in Dublin under the Irish rotating presidency. The meeting aims to help member states agree on a new path for AI regulation and to kickstart the bloc's sluggish economic growth.
Macron's push for AI restrictions on child safety aligns with his broader efforts to regulate digital spaces. He has previously advocated for banning certain social networks for under-15s in France. The new charter, however, goes further by targeting the underlying AI systems that power many of these platforms.
While the charter is voluntary, it could set a precedent for mandatory rules. The EU's AI Act, which entered into force last year, already imposes obligations on high-risk AI systems, but Macron's initiative seeks to address gaps specifically related to children. The French president's stance has drawn attention from tech companies, which are wary of stricter oversight but may see the charter as a way to shape future regulation.
Critics argue that voluntary measures may not be enough to protect children, especially given the rapid pace of AI development. However, supporters see the charter as a pragmatic first step toward international norms. The involvement of major US firms suggests a willingness to engage with European standards, even as Washington pursues a lighter-touch approach.
Macron's comments also come amid domestic tensions, with French students escalating protests over government reforms. The AI charter may be seen as an attempt to project leadership on a global issue while addressing concerns closer to home.
As the EU prepares for its Dublin summit, the question of how to balance innovation with protection remains central. Macron's call for bans where children are at risk could influence the bloc's next legislative steps. For now, the charter represents a collaborative effort to establish guardrails, but its effectiveness will depend on enforcement and international cooperation.
With the Paris Peace Forum set to adopt the charter, all eyes will be on whether other nations follow France's lead. The coming months will reveal whether this initiative translates into binding rules or remains a symbolic gesture.
