The booming development of digital technology has prompted computer graphics to become the driving factor of interactive art design. In this paper, through 3D modeling optimization and geometric modeling technology, we construct a virtual environment interaction model, combining light and shadow mode and VR interaction, etc., to realize the optimization of interactive design. Starting from the image noise, lack of contrast and visualization needs in interactive art design, image smoothing, contrast enhancement and pseudo-color enhancement techniques are used to improve the image quality and enhance the interactive art expression. The method based on computer graphics processing is applied to the actual interactive art design practice to verify the advantages of the method. The results show that the signal-to-noise ratio of the pre-processed images is between 20% and 55%, which is within the range of high-definition standards. In the quantitative comparison, the four index values of NIQE, PIQE, PSNR and SSIM of this paper’s method are the lowest among the seven method comparisons. The final score in subjective comparison is 4.2698, which is higher than the comparison methods. The percentage of users who are very satisfied and satisfied with the quality of generated images and interactive realism are 73.62% and 76.21% respectively. The method of this paper can effectively improve the quality of interactive art and enhance the sense of user experience.