The in-depth promotion of education informatization has put forward the demand for specialization and systematization in the assessment of English teaching effectiveness in colleges and universities. This paper introduces the adaptive CS algorithm (ACS algorithm) to optimize the clustering center, makes up for the defects that the original K-means clustering algorithm is easily affected by the initial clustering center and easily falls into the local optimum, and proposes the K-means clustering algorithm based on the improved cuckoo search algorithm (ACS-Kmeans). Applying this algorithm to deal with the data related to English teaching in colleges and universities, combining the characteristics of English teaching in colleges and universities, designing the corresponding programming algorithm and fitness function, and establishing the clustering algorithm for English teaching data in colleges and universities. According to the teaching data clustered by the algorithm, the evaluation indexes of teaching effect of English in colleges and universities are initially proposed. Combined with the opinions of experts, the evaluation system of English teaching effectiveness in colleges and universities is finally established, which contains 4 first-level indicators and 12 second-level indicators. Calculating the weights of the index system, the weight of “teaching plan” in the first-level index is 0.4181, which means that the improvement and optimization of English teaching effectiveness in colleges and universities should pay more attention to the design and arrangement of the teaching plan.