Government envoys gathered in Geneva on Monday for a pivotal week of talks on the future of autonomous weapons, with the possibility of launching formal negotiations toward new international rules. The meeting, part of the Convention on Certain Conventional Weapons, will test whether the world's powers can agree on limits for machines that can select and engage targets without human intervention.
UN Secretary-General António Guterres and Pope Leo XIV have both framed the issue in stark terms: allowing machines to make life-and-death decisions would cross a fundamental ethical line. The pope, in his first encyclical in May, denounced a "culture of power" driving the AI race and said it is not permissible to entrust decisions about life and death to remote AI systems. Guterres has set a deadline this year for launching talks toward regulation.
Advocacy groups argue that the moment for action is now, before autonomous systems become fully operational. "We're at a pivotal point now, where it's an experimentation phase. We're seeing some cases here, some cases there, but not full operationalisation," said Anna Hehir, head of military AI governance at the Future of Life Institute. "It will be a lot harder to regulate and create rules when these systems have already been in use for many years."
While armed drones that can independently strike targets have reportedly been used in select instances in conflict zones like Ukraine and the Middle East, a widespread rollout has not yet occurred. The fear of rogue machines causing civilian casualties has dominated years of discussion, but those talks have produced no binding restrictions.
Divisions among major powers
The United States and Russia, long-time rivals, are both wary of constraints on their ability to develop and deploy advanced military AI. They argue that any restrictions could hamper their technological edge in an increasingly competitive arms race. Russia's Foreign Ministry spokeswoman, Maria Zakharova, told reporters on Wednesday that Moscow wants "organisational matters" resolved first and a process "free from politicization," calling talks on restrictions "premature."
Under the convention's rules, decisions require consensus, meaning a single country can block an agreement. That gives the US and Russia significant leverage, and any eventual deal would likely reflect the lowest common denominator. Another sticking point is the duration of any negotiating mandate.
Proponents of a new treaty point to precedent: governments have already agreed to ban blinding lasers. Last month, seven countries—Austria, Belgium, Brazil, Ireland, Mexico, New Zealand and Panama—submitted a proposal to launch negotiations on a legally binding agreement on autonomous weapons at this conference.
The International Committee of the Red Cross has also weighed in. On Friday, its president, Mirjana Spoljaric, said in a statement: "States must act to ensure the future of warfare is not handed over to machines." The Stop Killer Robots campaign says 130 countries support new international rules.
Activists have taken their message to the streets, running advertisements in Berlin, London and Paris subways to highlight public support for reining in autonomous weapons. The campaign has also drawn attention to the broader implications of AI in warfare, a topic that has been explored at events like Lisbon's Web Summit, where humanoid robots and AI agents were on display.
The outcome of this week's talks remains uncertain. While most countries support launching negotiations, the resistance of key military powers could delay or dilute any agreement. As the conference unfolds, the world will be watching whether diplomats can translate ethical concerns into concrete rules—or whether the future of warfare will be left to machines.


