AI自主性武器系統在國際法上適用之研析

An Analysis on the Application of AI Autonomous Weapon System in International Law

林昕璇(Lin, Hsin-Hsuan)

自主性武器系統 ； 人工智慧 ； 特定常規武器公約 ； 國家責任 ； 限制無過失責任 ； Autonomous Weapon Systems ； AI ； Convention on Certain Conventional Weapons (CCW) ； State Responsibility ； Limited Strict Liability

軍法專刊

67卷4期（2021 / 08 / 01）

20 - 44

繁體中文

自主性武器系統及其管制規範體系，向來是國際人道法領域頗為棘手的議題。軍用無人系統因其零傷亡及對複雜任務的良好適應性，已被視為是近年的革命性武器，一旦廣泛使用將明顯改變現有的武裝衝突型態，甚至改變攻伐的本質。本文試圖聚焦日益仰賴巨量數據與演算法所驅動之自主性武器系統挑戰國際法秩序，提出四項觀察及評價：（一）演算法驅動之武器運作，恐會導致「自主性」意涵之認定產生浮動性；（二）武器系統可能誤判軍事目標，乃至科學證據的可信賴性與可解釋性存疑；尤有進者（三）人工智慧參與之自主性武器系統，如何符合日內瓦公約及其附加議定書規定意旨；（四）如何釐清國家責任成立與否的解釋論疑義，也是附帶衍生難題。本文主張自主性武器系統之研發與擴散，隨著AI的問世，為各國發展科技軍事武器及國際人道法帶來巨幅轉變，其內涵似非既有國際法規範及特定常規武器公約所能完整詮釋。基此，本文主張以限制無過失責任作為國家責任的主觀歸責門檻，透過此一高度歸責門檻之設定，期能敦促國家對AI新興科技軍事武器的使用更加審慎以對。

Autonomous Weapon Systems and their regulative systems have been knotty issues in the field of international humanitarian law. In recent years, unmanned military systems have been regarded as revolutionary arms due to their abilities for zero-casualty warfare and complex tasks. If deployed extensively, the systems would not only greatly change current forms of armed conflict, but also reshape the essence of military attacks. With growing dependency on big data and algorithms, autonomous weapon systems are challenging international law and order; this article unpacks the challenges by focusing on the following aspects: 1) Algorithm-driven weapons would cause the defining of ＂autonomy＂ to fluctuate. 2) The weapon systems could potentially misjudge military targets; and the scientific evidence's reliability and explainability remain doubtful. 3) Under this circumstance, how could AI-based autonomous weapon systems comply with the Geneva Conventions and the additional protocols? 4) Furthermore, this would lead to derivative difficulties to determine as well as to clarify state responsibilities. To sum up, the burgeoning and proliferation of autonomous weapon systems, catalyzed by AI, have profoundly impacted both domestic military technology development and international humanitarian law. However, this impact, in my view, seems unable to be appropriately interpreted and tackled by the existing international legal regulations and the Convention on Certain Conventional Weapons. Thus, in order to urge the state to exploit the emerging AI-based weapons more prudently, I argue in favor of limited strict liability as an approach to establish a set of subjective imputation criteria for state responsibility.

1. 林韋仲,廖宗聖(2019)。致命自主武器發展之國際法管制。台灣國際法學刊，15(2)，12-13。
   連結：
2. 林韋仲,廖宗聖(2019)。致命自主武器發展之國際法管制。台灣國際法學刊，15(2)，26-28。
   連結：
3. 簡銘儀(2019)。論武裝衝突時軍事目標之選定。軍法專刊，65(6)，74。
   連結：
4. GGE on lethal autonomous weapons systems, available at〈https://dig.watch/process/gge-laws〉, last visited 21 May, 2021
5. United States Air Force Unmanned Aircraft Systems Flight Plan 2009-2047, 18 May, 2009, available at〈https://fas.org/irp/program/collect/uas_2009.pdf〉, last visited 21 May, 2021.
6. (2018).,未出版
7. Protocol Additional to the Geneva Conventions of 12 August 1949, and relating to the Protection of Victims of International Armed Conflicts (Protocol I), 8 June 1977. (hereinafter Additional Protocol 1)-art.48., 52 (2), 51 (5). article 36
8. Losing Humanity: The Case Against Killer Robots, 19 Nov 2012, Harvard University Human Rights Watch, available at〈https://reliefweb.int/report/world/losing-humanity-case-against-killer-robots〉, last visited 21 May, 2021
9. (2019).,未出版
10. 美國國防部2012年有關自主性武器系統之第3000.09號指令（DoD Directive 3000.09）art. 4.a (2) & art. 4.a (3) art. 4.a.(1). Kelley M. Sayler, Defense Primer: U.S. Policy on Lethal Autonomous Weapon Systems, (Updated December 1, 2020), CRS Report, available at〈https://crsreports.congress.gov/product/pdf/IF/IF11150〉, last visited Mar. 18, 2021
11. Armed Activities on the Territory of the Congo (Democratic Republic of Congo v. Uganda), Judgment, ICJ Reports 2005, para. 118, available at〈https://www.icj-cij.org/public/files/case-related/116/116-20051219-JUD-01-00-EN.pdf〉, last visited 21 May, 2021
12. Department of Defense Directive Number 3000.09 (hereinafter DoDD 3000.09), available at〈https://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodd/300009p.pdf.〉, last visited Mar. 15, 2021.
13. Report of the 2017 Group of Governmental Experts on Lethal Autonomous Weapons Systems (LAWS), Annex2, (Updated Dec, 22, 2017), undocs, available at〈https://undocs.org/pdf?symbol=en/CCW/GGE.1/2017/3〉, last visited 21 May, 2021
14. THE LAW OF ARMED CONFLICT IN 2040.Oxford University Press:New York.
15. Ali, Salahudin(2020).Coming to a Battlefield Near you: Quantum computing, Artificail Intelligence & Machine Learning’s Impact on Proportionality.Santa Clara J. Int’l L.,18(1),23-26.
16. Arend, Anthony Clark,Beck, Robert J.(1993).International Law And The Use Of Force.Routledge, 2nd ed..
17. Arkin, Ronald(2010).The Case for Ethical Autonomy in Unmanned Systems.J. MIL. ETHICS,9(4),332-341.
18. Ashley, Kevin D.(2017).Artificial Intelligence and Legal Analytics: New Tools for Law Practice in the Digital Age.Cambridge UP.
19. Atherton, Kelsey. “When big data went to war - and lost A multibillion dollar project reveals the limits of data in a bureaucracy.” POLITICO, Oct. 2017,〈https://www.politico.com/agenda/story/2017/10/11/counteried-warfare-data-project-000541/〉, last visited 21 May, 2021
20. Berman, Emily(2018).A government of laws and Not of Machine.B.U.L. REV.,98,1277+1284-1290.
21. Berman, Emily(2018).A government of laws and Not of Machine.B.U.L. REV.,98,1277+1284-1290.
22. Bhuta(ed.)(2016).Autonomous Weapons Systems.Cambridge UP.
23. Crootof, Rebecca(2016).Accountability for Autonomous Weapons.U. PA. L. REV.,164(6),1347-1402.
24. Deeks, Ashley(2018).Predicting Enemies.VA. L. REV.,104(8),1529+1547-1563+1575-1576.
25. Deeks, Ashley(2019).Machine Learning, Artificial Intelligence, and the Use of Force by States.J. Nat’l Sec. L. & Pol’y,10(1),11-14.
26. Deeks, Ashley(2014).An International Legal Framework for Surveillance.VA. J. INT’L L.,55,291.
27. Ferguson, Andrew Gutjrie(2015).Big data and Predictive Reasonable Suspicion.U. PA. L. REV.,163(2),327+353-376.
28. Sydney J. Freedberg JR, “Artificial Stupidity: Fumbling The Handoff From AI To Human Control”, (Updated JUNE 05, 2017), BREAKING DEFENCE, available at〈https://breakingdefense.com/2017/06/artificial-stupidity-fumbling-the-handoff/〉, last visited 19 January, 2021.
29. Fuzaylova, Elizabeth.War Torts, Autonomous Weapon Systems, and Liability: Why a Limited Strict Liability Tort Regime Should Be Implemented.CARDOZO LAW REVIEW,40(3),1349-1350+1357+1359+1362-1363+1366.
30. Gardam, Judith Gail(1993).Proportionality and Force in International Law.AM. J. INT. LAW,87(3),391-413.
31. Glaser, Charles L..The Security Dilemma Revisited.World Politics,50(1),171-201.
32. Goldsmith, J. L.,Posner, E. A.(1999).A Theory of Customary International Law.U. CHI. L. REV.,66(4),1113-1177.
33. Haner, Justin,Garcia, Denise(2019).The Artificial intelligence Arms Race: Trends and World Leaders in Autonomous Weapons Development.Global Policy,10(3),332-333.
34. Herz, John H..The Security Dilemma in International Relations: Background and Present Problems.International Relations,17(4),411-416.
35. Horowitz, Michael C.(2016).Why Words Matter: The Real World Consequences of Defining Autonomous Weapons Systems.TEMP. INT’L & COMP. L. J.,30,85.
36. Huq, Aziz Z.,Cuéllar, Mariano-Florentino(2019).NYU Annual Survey of American Law, Public Law Working PaperNYU Annual Survey of American Law, Public Law Working Paper,未出版
37. Kunz, Josef L.(1953).The Nature of Customary International Law.AM. J. INT. LAW,47(4),665-667.
38. Lee, Peter(2017).Armed Drones: Automation, Autonomy and Ethical Decision-Making.The Political Economy of Robots- Prospects for Prosperity and Peace in the Automated 21st Centry,Palgrave Macmillan, Cham:
39. Manjikian, Mary(2017).Conflict, Cohesion, and Comrades in Arms: Social Implications of Robotics in the Military.The Political Economy of Robots- Prospects for Prosperity and Peace in the Automated 21st Centry,Palgrave Macmillan, Cham:
40. Margulies, Peter(2020).,未出版
41. Milanovic, Marko(2015).Human Rights Treaties and Foreign Surveillance: Privacy in the Digital Age.HAR. INT’L L. J.,56(1),81-146.
42. Roff, Heather. “Autonomous or ‘Semi’ Autonomous Weapons? A Distinction Without Difference.” Huffington Post blog, Jan. 2015,〈http://www.huffingtonpost.co/eather-rof/utonomous-or-semi-autono_b_6487268.html〉, last visited 21 May, 2021.
43. Roff, Heather M.(2014).The strategic robot problem: Lethal autonomous weapons in war.J. MIL. ETHICS,13(3),212+215-220.
44. Schmitt, Michael N.(1998).Computer network attack and the use of force in international law: thoughts on a normative framework.COLUM. J. TRANSNAT,37,885.
45. Sparrow, Robert(2016).Robots and Respect: Assessing the Case Against Autonomous Weapon Systems.Ethics & International Affairs,30(1),93-116.
46. Surber, Regina. “Artificial Intelligence: Autonomous Technology (AT), Lethal Autonomous Weapons Systems (LAWS) and Peace Time Threats.” ICT for Peace Foundation, Feb. 2018. available at〈https://ict4peace.org/activities/artificial-intelligence-autonomous-technology-at-lethal-autonomous-weapons-systems-laws-andpeace-time-threats〉, last visited 21 May, 2021.
47. UNIDIR, Increasing Transparency, Oversight and Accountability of Armed Unmanned Aerial Vehicles, available at〈https://unidir.org/publication/increasing-transparency-oversight-and-accountability-armed-unmannedaerial-vehicles〉, last visited 12 June, 2021
48. Wallach, W.,Allen, C.(2013).Framing robot arms control.Ethics and information technology,15(2),125-135.
49. Waxman, Matthew C.(ed.)(2020).Virginia Public Law and Legal Theory Research PaperVirginia Public Law and Legal Theory Research Paper,未出版
50. Zacher, Lech W.(2017).TECHNOLOGY, SOCIETY AND SUSTAINABILITY: SELECTED CONCEPTS, Issue and Cases.Springer.
51. 姜皇池(2013)。論廣大興號爭端菲國所違反國際法與國家責任問題。月旦法學雜誌，221，78-79。
52. 譚偉恩(2019)。AI時代的國際關係：只有更聰明，沒有最聰明，但誰呢？。全球政治評論，65，10-11。

1. 周伯翰(2022)。AI發明的專利適格性與進步性之研究。高大法學論叢，17(2)，95-99+101。
2. (2024)。AI自主性武器系統之國際規範秩序：省思與前瞻。遠景基金會季刊，25(1)，65-134。