Under the background of sports power, in order to improve the quality and efficiency of public physical education teaching in universities in Anhui province, the idea of optimizing public physical education teaching in universities under the background of sports power is proposed and put into practice. Change the traditional teaching mode, improve the infrastructure, strengthen the moral education, reasonably arrange the curriculum, set up the correct physical education view, and optimize the teaching mode of public physical education in colleges and universities in Anhui Province. To improve the teaching quality and efficiency of public physical education in colleges and universities in Anhui Province, it still needs colleges and universities to further increase the content of sports culture, enrich the teaching connotation and supervise the teaching quality.