This paper systematically reviews the trends of soil fertility of arable land in China and puts forwards that the soil fertility improvement of arable land in China should realize the strategic change from single application of chemical fertilizer to the combined application of organic and inorganic fertilizers, combine cultivation with preservation to maintain soil fertility, and implement spatial differentiation control. Moreover, this paper summarizes the ways to improve the soil fertility of arable land in China, including increasing the application of organic fertilizer, promoting straw returning to the field, resuming and promoting green manure cultivation, improving the farming conditions, and optimizing the layout of agroforestry networks. At last, this paper proposes policy suggestions of implementing high-standard farmland construction projects, soil improvement and restoration projects, grass-crop rotation projects, straw returning projects, and livestock and poultry manure application projects.