Construction of Safety Risk Assessment Framework for Generative Artificial Intelligence Systems

Zewei Li , Jiayin Qi , Binxing Fang

Strategic Study of CAE ›› : 1 -17.

PDF (788KB)
Strategic Study of CAE ›› :1 -17. DOI: 10.15302/J-SSCAE-2025.09.026
research-article
Construction of Safety Risk Assessment Framework for Generative Artificial Intelligence Systems
Author information +
History +
PDF (788KB)

Abstract

The rapid evolution of generative artificial intelligence (GenAI) has given rise to new safety challenges, making it urgent to develop risk assessment frameworks that can support precise governance. Drawing on the stressor‒exposure‒effect analytical paradigm grounded in ecological risk theory, this study conceptualizes GenAI as a stressor within a sociotechnical ecosystem and proposes a safety risk assessment framework comprising three core dimensions: algorithmic fidelity, technological dominance, and administrative governance capacity. It further develops a preliminary system of assessment indicators, providing a basis for translating the theoretical framework into an operational measurement tool. Within this framework, algorithmic fidelity is subdivided into cognitive fidelity (including both backward-looking and forward-looking fidelity) and affective fidelity. Technological dominance considers the penetration of infrastructure and the degree of user acceptance or reliance, while the administrative governance capacity is used to assess the macro-level regulatory capacity of governing authorities based on the policy arrangement approach. Taking clinical decision support in healthcare as an example, this study conducts an exploratory application of the proposed GenAI safety risk assessment framework. The analysis preliminarily illustrates the importance of backward-looking generative fidelity and informal penetration risk in specific contexts, as well as the framework's application logic and potential applicability. The study further discusses directions for methodological innovation and breakthroughs in future GenAI safety risk governance, including the construction of dynamic and computable models of risk evolution, development of intelligent and adaptive assessment and validation technologies, and promotion of scenario-oriented modular and differentiated assessment. Overall, the proposed safety risk assessment framework helps characterize the formation mechanisms and transmission pathways of GenAI risks, providing theoretical support and modular assessment tools for differentiated risk research across diverse application scenarios.

Keywords

generative artificial intelligence / safety risk assessment / sociotechnical ecosystem / algorithmic fidelity / technological dominance / administrative governance capacity

Cite this article

Download citation ▾
Zewei Li, Jiayin Qi, Binxing Fang. Construction of Safety Risk Assessment Framework for Generative Artificial Intelligence Systems. Strategic Study of CAE 1-17 DOI:10.15302/J-SSCAE-2025.09.026

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

Funding project: Chinese Academy of Engineering project "Research on the National Guardrails and Governance Framework for Large Model Regulation"(2025-XZ-08)

Major Project of Philosophy and Social Sciences Research of the Ministry of Education(24JZD040)

The National Natural Science Foundation of China Project(72293583)

PDF (788KB)

0

Accesses

0

Citation

Detail

Sections
Recommended

/