To achieve automatic diagnosis of plant diseases and improve the image recognition accuracy of plant diseases, two kinds of grape diseases (grape downy mildew and grape powdery mildew) and two kinds of wheat diseases (wheat stripe rust and wheat leaf rust) were selected as research objects, and the image recognition of the diseases was conducted based on image processing and pattern recognition. After image preprocessing including image compression, image cropping and image denoising, K_means clustering algorithm was used to segment the disease images, and then 21 color features, 4 shape features and 25 texture features were extracted from the images. Backpropagation (BP) networks were used as the classifiers to identify grape diseases and wheat diseases, respectively. The results showed that identification of the diseases could be effectively achieved using BP networks. While the dimensions of the feature data were not reduced by using principal component analysis (PCA), the optimal recognition results for grape diseases were obtained as the fitting accuracy and the prediction accuracy were both 100%, and that for wheat diseases were obtained as the fitting accuracy and the prediction accuracy were both 100%. While the dimensions of the feature data were reduced by using PCA, the optimal recognition result for grape diseases was obtained as the fitting accuracy was 100% and the prediction accuracy was 97.14%, and that for wheat diseases was obtained as the fitting accuracy and the prediction accuracy were both 100%.