The rapid development of artificial intelligence (AI) industry is accompanied by various social ethical risks, and the consequences of these risks have gradually emerged. Allowing humans to securely enjoy the major benefits of AI technology has become an important task of AI supervision. In this article, we first analyze the focus issues of AI ethics, including the distribution of machine and human rights, social trust crisis of AI, security of data and algorithms, as well as confirmation of rights and attribution of liability. Subsequently, we summarize the development paths and policy status of AI industry in China and abroad, and analyze the demand for AI ethical supervision in China from multiple dimensions. Furthermore, we suggest that the supervision scope of AI should be extended in a staged manner based on the technical progress of AI. To create better global development opportunities for China’s AI industry, a multi-dimensional supervision framework that combines ethics, law, and policy should be established, a sufficient social discussion space should be provided for all stakeholders to participate in public discussion on AI security, scientific and technological ethics supervision organizations of multiple levels should be improved in an orderly manner, and China should actively participate in the formulation of AI international rules.