In response to the COVID-19 pandemic and the Ministry of Education's call on "class-suspended but still learning", major colleges and universities have conducted online teaching in an orderly manner with the postponing the start of school. This large-scale online teaching is facing many challenges, and it brings a rare opportunity to promote the informatization of education and teaching. How to ensure the effect of online teaching and improve the quality of talent training are important issues that need to be resolved in the current online teaching process. Course evaluation is an important means to measure the effect of online courses, and it is also an important factor influencing the quality of teaching. The quality of course evaluation is directly related to the quality of talent training. This article analyzes the current problems of online curriculum evaluation in colleges and universities. Taking the organic chemistry professional course as an example, it proposes improvement strategies from the aspects of concepts, directions, methods and contents of online curriculum assessment and evaluation, intending to provide theoretical basis and practical cases for online teaching in colleges and universities.