Abstract: To effectively improve the accuracy of speech emotion recognition in intelligent man-machine harmonious interaction, a method of speech emotion recognition was proposed based on decision tree and an improved SVM mixed model. This method can avoid the tree unbounded generalization error, more the number of classifiers and other shortcomings, while taking advantage of SVM-KNN mixed model to avoid constrained optimization problems and improve the recognition efficiency. In this paper, six basic emotions were identified, including sadness, joy, anger, disgust, surprise, fear. Experimental results show that this method can effectively identify six basic emotions. Compared with the traditional support vector machine and artificial neural network method, this method can get higher recognition accuracy, better stability, strong practicability and generalization ability.