The European Union, the Philippines and the Centre for the Study of Existential Risk at theUniversity of Cambridge will be hosting a discussion under Topic 6 of the CCW GGE onEmerging Technologies in the Area of Lethal Autonomous Weapons Systems indicativetimetable, on the potential risks inherent in the use of autonomous weapons systems inweapon systems, and the need for mitigation and confidence building. Particularly thepanel will focus on factors ripe for leading to unintended technological and geopoliticalconsequences and escalation, without suitable frameworks in place. In the context of increasing debates regarding the development and associated regulationof artificial intelligence and other forms of autonomy, there have been satellite discussionsimplicating the immediate fall-out and wider political potential for conflict and retaliation. While subjects of unpredictability, targeting, meaningful human control and theapplications of International Law, including International Humanitarian Law, arefundamental, it is significant to acknowledge two further threats. These are, in the politicalrealm, asymmetric power responses, and in the technological, multi-agent triggering.
The risk of unintended consequences of localised false positives, exponential error, swarmsor any perceived hostility is great and the response to any of these must be measured andcontained. Further, the asymmetry of power and ability to develop these technologies mustbe recognised in the potential to lean into the use of existing conventional weapons(including the possibility of deferring to unlawful methods) as well as cyber-attacks onnational critical infrastructure as countermeasures. The failure to address these issues havedirect repercussions on trust and confidence building.
The purpose of this panel is to explore the potential risks, which are less considered, andhow they might be mitigated. After the presentations given by panellists, the floor will beopen for questions and comments from the floor.
Speakers
Opening remarks: Marketa Homolkova (European Union)
Panel
- Jonelle John S. Domingo (Moderator), Philippines
- Stuart Russell, Centre for the Study of Existential Risk at the University of Cambridge
- Taniel Yusef, Centre for the Study of Existential Risk at the University of Cambridge
- Anna Hehir, Future of Life Institute
