Can a Machine Decide Who Lives and Who Dies? The ICRC on Autonomous Weapons, AI, and Human Responsibility

Article thumbnail

Sursă foto: Pixabay.com

An interview conducted by Dr. Adrian Leonard Mociulschi

Following the recent joint appeal by the United Nations (UN) and the International Committee of the Red Cross (ICRC), which warned of the risks associated with autonomous weapons and called for new international rules governing their use, the debate over the role of Artificial Intelligence in future warfare has returned to the forefront of the international agenda. As military systems capable of selecting and engaging targets with increasing levels of autonomy become a reality, governments, international organizations, and international humanitarian law experts are debating the limits that should be imposed on these technologies.

Georgia Hinds is a Legal Adviser at the International Committee of the Red Cross (ICRC), where she works on issues related to international humanitarian law, emerging technologies, and autonomous weapon systems. In the interview below, she explains why the ICRC believes certain autonomous weapons should be prohibited and why others must be subject to strict limitations in order to preserve human control and responsibility over the use of force.

Adrian Leonard Mociulschi: The International Committee of the Red Cross and the United Nations have warned that humanity is approaching a “moral red line” as autonomous weapon systems become increasingly capable of targeting human beings without direct human intervention. At the heart of this debate lies the principle that decisions involving human life and death should remain subject to human judgment and responsibility.

Why is maintaining meaningful human control over autonomous weapon systems and the use of force essential from the perspective of human dignity, moral responsibility, and international humanitarian law?

Georgia Hinds: Maintaining human control over the use of force is essential for compliance with the law. International humanitarian law requires that when people use weapons, they need to be able to anticipate, control and limit the effects of those weapons. Autonomous weapons make this more difficult; the details of who or what will be targeted, or where or when strikes will occur will depend on how the system’s sensors are triggered by environmental inputs, which can change rapidly in armed conflict.

This doesn’t necessarily mean that humans need to directly control a weapon itself at all times. But it does mean that certain types of autonomous weapons will never be compliant, and so must be prohibited — in particular ones that function in unpredictable ways, for example an autonomous weapon that relies on complex and opaque artificial intelligence (a “black box”) and operates in ways that can’t be anticipated or explained. Then, for other autonomous weapons, commanders and operators must set strict limits on the operating parameters — including restricting the types of targets, and the area and time of operation, and ensuring the ability for deactivation — to maintain control over how force is ultimately applied.

There are also serious ethical concerns with the prospect of effectively delegating life or death decisions to machines. The killing of humans based on a machine process would simultaneously undermine the human agency of the person using force and the human dignity of the person against whom force is used.

Adrian Leonard Mociulschi: Your remarks highlight the importance of preserving human judgment and responsibility in decisions involving the use of force. Yet the development of artificial intelligence, robotics, and autonomous weapon systems is progressing faster than many existing legal and governance frameworks. At the same time, international humanitarian law has long provided essential protections for civilians and limits on the conduct of warfare.

Why does the ICRC believe that new international rules on autonomous weapon systems are urgently needed, and what humanitarian risks does the organization associate with a reduced human role in targeting and attack decisions?

Georgia Hinds: Existing international humanitarian law does already regulate and constrain the use of autonomous weapons. For example, it already prohibits autonomous weapons that would be inherently indiscriminate. However, the ICRC considers that these existing rules do not hold all the answers to the humanitarian, legal and ethical questions raised by autonomous weapons. We have seen, with discussions under the Convention on Certain Conventional Weapons over the last decade, that States hold different views about exactly how international humanitarian law applies to set limits and requirements for the design and use of autonomous weapons. So we are convinced that new rules are urgently needed to give clarity in this regard, and to address wider humanitarian risks and fundamental ethical concerns.

New, legally binding rules would offer the benefits of legal certainty and stability. These systems are already being developed and deployed, and the arms race to incorporate greater autonomy in weapon systems is well underway. Without clear, specific rules, these developments may give rise to practices that erode the protections that IHL and the principles of humanity provide to the victims of war.

The ICRC has identified AWS as one of the most concerning applications of AI in warfare due to their humanitarian, legal, and ethical implications. These systems increase the risks of conflict escalation, harm to civilians, and violations of IHL. Without timely action, their proliferation will make them harder to regulate and increase the likelihood of misuse by non-state actors or criminal organizations.

The ICRC and the UN are calling for a legally binding instrument to prohibit systems that are inherently unpredictable or designed to target humans directly and to restrict others to ensure compliance with IHL. The Seventh Review Conference of the Convention on Certain Conventional Weapons (CCW), to be held in November 2026, presents a critical opportunity for states to begin negotiations on such an instrument. States must act now to ensure future generations inherit a world where the use of force remains under human judgment and accountability.

Adrian Leonard Mociulschi: The need for new international rules raises a broader question about the future relationship between technology and humanity. Artificial intelligence offers significant opportunities in fields such as medicine, disaster response, scientific research, and humanitarian action. Yet the same technological advances can also increase the autonomy of military systems and reshape the conduct of armed conflict.

Looking ahead, what principles should guide the relationship between artificial intelligence, autonomous weapon systems, and humanity so that technological innovation serves human security while preserving human agency, accountability, dignity, and respect for international humanitarian law?

Georgia Hinds: The ICRC has a long history of examining the impact of new technologies of warfare. Throughout the 20th century, we engaged with the realities of poison gas after the horrors of WWI, with incendiary weapons, with cluster munitions, with anti-personnel mines.

Whenever a new technology has appeared on the battlefield, there have been voices arguing that it will actually make war “more humane”, less lethal or more precise. As an example, when chemical weapons were first developed, some people said they would be a more merciful means of incapacitation.

However, the qualities advertised in new technologies have led not to precision, distinction and precaution, but to acceleration, amplification and escalation of destruction, with appalling results for civilians. If we contemplate many of the ongoing conflicts today, which involve the technologically sophisticated weapons, we are not seeing better outcomes for civilians – we are seeing widespread and unacceptable devastation.

These lessons mean that we must now assess the weaponisation of AI, and claims that it will reduce civilian harm, with a measure of sobriety. The ICRC emphasizes the need for a human-centred approach to military AI, one that focuses on the people who may be affected by these technologies, and on ensuring that the people using AI in military operations can comply with their legal and ethical obligations. Human control and judgement must be preserved in all decisions that pose risks to the life and dignity of people affected by armed conflict. Technological innovation must serve humanity, not endanger it.

Adrian Leonard Mociulschi: Thank you for your time and for sharing your perspective with the readers of ȘTIRIPESURSE.RO. We would also like to thank the International Committee of the Red Cross (ICRC) for its support in facilitating this interview on one of the most significant ethical, legal, and technological challenges of the 21st century.

Beyond Conclusions

The debate over autonomous weapons is not only about the future of technology, but also about the limits societies are willing to accept when it comes to the use of force. From the ICRC's perspective, maintaining human control and responsibility over decisions involving life and death is essential to protecting human dignity and ensuring respect for international humanitarian law in the age of Artificial Intelligence.

An interview conducted by Dr. Adrian Leonard Mociulsc

Google News
Explorează subiectul
București
Temperatură9°C
Variabil
România
Vânt3km/h
Citește
mai multe
Articole Similare
Parteneri