PDF(504 KB)
Technical Countermeasures for Security Risks of Artificial General Intelligence
Yuqing Liu, Yuhuai Zhang, Peiqi Duan, Boxin Shi, Zhaofei Yu, Tiejun Huang, Wen Gao
PDF(504 KB)
PDF(504 KB)
Technical Countermeasures for Security Risks of Artificial General Intelligence
Human beings might face significant security risks after entering into the artificial general intelligence (AGI) era. By summarizing the difference between AGI and traditional artificial intelligence, we analyze the sources of the security risks of AGI from the aspects of model uninterpretability, unreliability of algorithms and hardware, and uncontrollability over autonomous consciousness. Moreover, we propose a security risk assessment system for AGI from the aspects of ability, motivation, and behavior. Subsequently, we discuss the defense countermeasures in the research and application stages. In the research stage, theoretical verification should be improved to develop interpretable models, the basic values of AGI should be rigorously constrained, and technologies should be standardized. In the application stage, man-made risks should be prevented, motivations should be selected for AGI, and human values should be given to AGI. Furthermore, it is necessary to strengthen international cooperation and the education of AGI professionals, to well prepare for the unknown coming era of AGI.
artificial general intelligence (AGI) / security risk / risk assessment / coping strategy
| [[1]] |
陈俊波, 高杨帆. 系统论视角下的人工智能与人类智能 [J]. 自然 辩证法研究, 2019, 35(9): 99–104. Chen J B, Gao Y F. Artificial intelligence and human intelligence from the perspective of system theory [J]. Studies in Dialectics of Nature, 2019, 35(9): 99–104.
|
| [[2]] |
黄铁军, 余肇飞, 刘怡俊. 类脑机的思想与体系结构综述 [J]. 计 算机研究与发展, 2019, 56(6): 1133–1148. Huang T J, Yu Z F, Liu Y J. Brain-like machine: Thought and architecture [J]. Journal of Computer Research and Development, 2019, 56(6): 1133–1148.
|
| [[3]] |
张钹. 走向真正的人工智能 [J]. 卫星与网络, 2018 (6): 24–27. Zhang B. Towards the real artificial intelligence [J]. Satellite & Network, 2018 (6): 24–27.
|
| [[4]] |
徐宗本 . AI与数学 “融通共进 ” 迈向自主智能时代 [EB/ OL]. (2020-06-08)[2021-02-15]. http://news.sciencenet.cn/ htmlnews/2020/6/441057.shtm. Xu Z B. AI and math go together towards the era of autonomous intelligence [EB/OL]. (2020-06-08)[2021-02-15]. http://news. sciencenet.cn/htmlnews/2020/6/441057.shtm.
|
| [[5]] |
周志华. 关于强人工智能 [J]. 中国计算机学会通讯, 2018, 14(1): 45–46. Zhou Z H. Views on artificial general intelligence [J]. Communication of the CCF, 2018, 14(1): 45–46.
|
| [[6]] |
黄铁军. 也谈强人工智能 [J]. 中国计算机学会通讯, 2018, 14(2): 47–48. Huang T J. Different views on artificial general intelligence [J]. Communication of the CCF, 2018, 14(2): 47–48.
|
| [[7]] |
Amodei D, Olah C, Steinhardt J, et al. Concrete problems in AI safety [EB/OL]. (2016-07-25)[2021-02-15]. https://arxiv.org/ abs/1606.06565.
|
| [[8]] |
Congress of the United States. H.R.5356-National security commission artificial intelligence act of 2018 [EB/OL]. (2018-03-20) [2021-02-15]. https://www.congress.org/bill/115th-congress/housebill/5356.
|
| [[9]] |
中国信息通信研究院. 全球人工智能治理体系报告 [EB/ OL]. (2020-12-30)[2021-02-15]. https://pdf.dfcfw.com/pdf/H3_ AP202012301445361107_1.pdf?1609356816000.pdf. China Academy of Information and Communications Technology. Global AI governance report [EB/OL]. (2020-12-30)[2021-02- 15]. https://pdf.dfcfw.com/pdf/H3_AP202012301445361107_1. pdf?1609356816000.pdf.
|
| [[10]] |
金晶, 秦浩, 戴朝霞. 美国人工智能安全顶层战略及重点机构研 发现状 [J]. 网信军民融合, 2020 (5): 45–48. Jin J, Qin H, Dai Z X. Top-level strategy of artificial intelligence security and the research status of key institutions in the United States [J]. Civil-Military Integration on Cyberspace, 2020 (5): 45–48.
|
| [[11]] |
Whyte C. Deepfake news: AI-enabled disinformation as a multilevel public policy challenge [J]. Journal of Cyber Policy, 2020, 5(2): 1–19.
|
| [[12]] |
Goodfellow I, Pouget-Abadie J, Mirza M, et al. Generative adversarial networks [J]. Advances in Neural Information Processing Systems, 2014, 3(11): 2672–2680.
|
| [[13]] |
Bau D, Zhu J Y, Wulff J, et al. Seeing what a GAN cannot generate [C]. Seoul: 2019 IEEE/CVF International Conference on Computer Vision, 2019.
|
| [[14]] |
Huang T J. Imitating the brain with neurocomputer a “new” way towards artificial general intelligence [J]. International Journal of Automation and Computing, 2017, 14(5): 520–531.
|
| [[15]] |
曲晶, 张绿云. 国外火箭发射及故障情况统计分析 [J].中国航天, 2016 (2): 13–18. Qu J, Zhang L Y. Statistical analysis of foreign rocket launch and failure [J]. Aerospace China, 2016 (2): 13–18.
|
| [[16]] |
邢会强. 证券期货市场高频交易的法律监管框架研究 [J]. 中国 法学, 2016 (5): 156–177. Xing H Q. Research on the legal regulatory framework of high frequency trading in securities and futures market [J]. China Legal Science, 2016 (5): 156–177.
|
| [[17]] |
Tegmark M. Life 3.0: Being human in the age of artificial intelligence [M]. New York: Penguin Random House LLC, 2017.
|
| [[18]] |
Bostrom N. Superintelligence: Paths, dangers, strategies [M]. Oxford: Oxford University Press, 2015.
|
| [[19]] |
Vilalta R, Drissi Y. A perspective view and survey of meta-learning [J]. Artificial Intelligence Review, 2002, 18(2): 77–95.
|
| [[20]] |
李旭嵘, 纪守领, 吴春明, 等. 深度伪造与检测技术综述 [J]. 软件 学报, 2021, 32(2): 496–518. Li X R, Ji S L, Wu C M, et al. Survey on deepfakes and detection techniques [J]. Journal of Software, 2021, 32(2): 496–518.
|
| [[21]] |
Asimov I. I, robot [M]. Louisville: Spectra Press and Promotions, 2004.
|
| [[22]] |
黄铁军. 人类能制造出“超级大脑”吗？ [N]. 中华读书报, 2015- 01-07(5). Huang T J. Can human build “super brain”? [N]. China Reading Weekly, 2015-01-07(5).
|
| [[23]] |
中华人民共和国科学技术部. 欧洲25国签署《人工智能合作宣 言》 [EB/OL]. (2018-07-18)[2021-02-15]. http://www.most.gov.cn/ gnwkjdt/201807/t20180718_140708.htm. Ministry of Science and Technology of the People’s Republic of China. 25 European countries sign the Declaration on Artificial Intelligence Cooperation [EB/OL]. (2018-07-18)[2021-02-15]. http://www.most.gov.cn/gnwkjdt/201807/t20180718_140708.htm.
|
/
| 〈 |
|
〉 |
AI Summary
