In recent years, "big data" has become a realistic background that we cannot ignore, and it is closely related to all aspects of people's survival and life. As a new perspective and method for people to understand the world, big data is an important window for people to gain a new understanding of things and create new value. How colleges and universities study the effectiveness of physical exercise in improving the state of mind under the background of big data has become a new topic worthy of our research. This article is based on the working concepts of collaboration, sharing, openness, and equality of college students' physical exercise in the context of big data, combined with the working mechanism of multiple data platforms and the work content combined with the Internet, and puts forward the practical aspects of college students' perceptions obstacles, behavioral cues and self-efficacy are used to evaluate the effectiveness of physical exercise in improving the state of mind of college students, that is, to explore the effectiveness of physical and mental health of college students on the basis of data analysis. Mainly use questionnaire survey method, psychological measurement method, mathematical statistics method, comparative analysis method and other research methods to carry out related research on the health belief, mood state and physical exercise habits of college students in this city, through correlation and regression analysis between different dimensions. Experimental studies have shown that the physical exercise habits of college students are very poor, and only 18.3% of them have exercise habit. There is also a linear relationship between college students' exercise health beliefs and physical exercise habits, and behavioral cues and self-efficacy are positive predictors of physical exercise habits.