The integration, open accessing of healthcare data, and the use of artificial intelligence to organize and analyze fragmented medical information can improve medical and health services, promote the level of rational government decision-making, and reduce the inequality in the allocation of medical and health resources. This paper summarizes the current status of technologies and applications of artificial intelligence in the field of medical information semantic fusion and in the field of image analysis, and analyzes current problems and challenges. The first is the standardized representation and structural integration of medical information to merge national and widely-used clinical terminologies, which is key to realizing auxiliary diagnosis based on ‘big data’ artificial intelligent. The second is the use of massive medical knowledge to construct an intelligent diagnosis and treatment model with the ability to combine multimodal data analysis and structured knowledge reasoning. Thus, we propose a national-level healthcare open data cloud platform that can help open up new data markets, improve the integration of healthcare data, and provide the new service of knowledge discovery and services. We also suggest to establish some basic industry standards for medical and health information, to strengthen the research and development of domestic medical devices, to promote the development of intelligent medical devices and smart wearable devices, and to guide the industry to open up new markets on the combination of artificial intelligence and medical devices.