Abstract: Stripe rust has posed a serious threat to the wheat yield in recent years. It is crucial to breed the wheat varieties resistant to stripe rust. However, the identification of resistance is single and inefficient in traditional breeding. In this study, an efficient identification was proposed to determine the different resistance grades to the stripe rust using the time series of vegetation index response to wheat canopy. An unmanned aerial vehicle (UAV) was utilized to collect multi-temporal spectral images of the canopy in the naturally occurring breeding populations of colony wheat (600 samples in total, 516 genotypes). Six sensitive features were screened for the severity of stripe rust disease using Random Forest and ReliefF algorithms: normalized pigment chlorophyll index (NPCI), woebbecke index (WI), chlorophyll index rededge (CIrededge), (green atmospherically resistant index GARI), normalized difference vi (NDVI), and chlorophyll index green (CIgreen). These indices were verified as sensitive features. The severity of stripe rust disease incidence was dynamically characterized using the time series of these indices in the test population. The support vector machine (SVM) was used to establish a classification model for the severity grade of stripe rust disease, according to the sensitive features. There was a very small difference in the performance of the test set and the unscreened original features, indicating the effectiveness of the screened sensitive features. The time series of six sensitive traits was observed in the samples of different resistance grades. It was found that there were no significant differences in the CIgreen and CIrededge among the samples with the different resistance grades. This indicated that the saamples were not applicable to categorize the resistance grades to stripe rust. The differences exhibited by GARI, NDVI, NPCI and WI were used to classify the resistance grades to stripe rust. General machine learning cannot capture the smaller differences of feature variation in the samples with the different resistance grades. Therefore, an improved mode was proposed to extract the features from two-dimensional images that transformed vegetation index time series, in order to realize the classification of stripe rust resistance grade. Four time-series vegetation indices (NPCI, GARI, NDVI, and WI) were better distinguished the different disease resistance grades among the sensitive features, and then used to generate the Gramian Angular Summation Field (GASF) images by the Gramian Angular Field. Data augmentation was performed on the dataset to equalize the number of samples in each resistance grade. Each dataset had a total of 1 040 samples, and was then divided into four grades of stripe rust resistance, where each grade contained 260 sample images, while each dataset was divided into training, validation, and testing sets in the ratio of 6:2:2. DenseNet121 model was separately trained using each dataset, in order to classify the various stripe rust resistance. A better performance was achieved in the classification models with the GASF_NPCI and GASF_WI as the input features, compared with the GASF_GARI and GASF_NDVI. The model with the GASF_NPCI as a feature was slightly less effective in distinguishing the samples with the resistance grades R and MR, where the precision and recall were relatively low. There was no difference in the models with the GASF_WI for the precision and recall of the samples that predicted each stripe rust resistance grade. In the F1 scores of the test set, the different vegetation indices on the resistance grades of stripe rust in colony wheat were ranked in the order of NPCI, WI, GARI, NDVI. The classification model with the GASF_NPCI was the most effective in the test set, with an F1 score of up to 0.833. There was a better distinction of differences in the stripe rust resistance grades among different varieties (lines) of population wheat. The grades of wheat stripe rust resistance were fully identified using time series of spectral vegetation index. Meanwhile, the finding can also provide a strong reference for the disease resistance breeding of crops.