Parallel Shared Hidden Layers Auto-encoder as a Cross-Corpus Transfer Learning Approach for Unsupervised Persian Speech Emotion Recognition

Document Type : Original Research Paper


1 Department of Electrical and Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran.

2 Department of Electrical and Computer Engineering, Science and research Branch, tehran, Iran

3 Associate Professor, Speech Processing Laboratory, Department of Computer Engineering, Sharif University of Technology, Tehran, Iran


Detecting emotions from speech is one of the challenging topics in speech signal processing, especially in low resource languages. Extracting common features between the training and testing set, using an unsupervised method, can solve the inconsistency difficulty between training and test data. In this study, a new auto-encoder based structure is proposed as a new unsupervised method for domain adaptation. To this end, the proposed structure is made of shared encoders to learn common feature representations, shared across the source and the target domain datasets to minimize the discrepancy between them. In order to evaluate the performance of the proposed method, five generally available databases in different languages were used as training and testing datasets. Results on various scenarios demonstrated that the proposed method improves the classification performance significantly compared to the baseline and state-of-the-art unsupervised domain adaptation methods for emotional speech recognition. As an example, the proposed method improved the emotion recognition rate in the Persian emotional speech dataset (PESD) by 8% compared to cross-corpus training when the source training set is EMOVO.


Articles in Press, Accepted Manuscript
Available Online from 14 May 2021
  • Receive Date: 24 April 2021
  • Revise Date: 14 May 2021
  • Accept Date: 14 May 2021