DOU Weibei
|
- Professor
- Name (Simplified Chinese):DOU Weibei
- Name (English):DOU Weibei
- Business Address:清华大学罗姆楼4-102
- Contact Information:Email: douwb@tsinghua.edu.cn； Tel: 010-62781703
- Degree:Doctoral degree
- Professional Title:Professor
- Alma Mater:电子科技大学学士、法国雷恩大学硕士、法国卡昂大学博士
- Teacher College:DZGCX
Contact Information
- ZipCode：
- Fax：
- PostalAddress：
- OfficePhone：
- Email：
- Selected Publications
MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels
Release time:2021-12-25 Hits:
- Impact Factor:10.506
- DOI number:10.1109/TAFFC.2019.2945322
- Journal:IEEE Transactions on Affective Computing
- Place of Publication:UNITED STATES
- Key Words:emotional speech, Mandarin, dataset, distal labels, proximal labels, tonal speech, emotion intensities
- Abstract:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has therefore many applications. In this paper, we propose an emotional tonal speech dataset, Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art datasets which only focused on perceived emotions, MES-P includes not only perceived emotions (proximal labels) but also intended emotions (distal labels), to make it possible to study human emotional intelligence, i.e. emotion expression/understanding ability, and emotional misunderstandings in real life. Furthermore, MES-P also captures a main feature of tonal languages, and provides emotional speech samples matching the tonal distribution in real life Mandarin. MES-P dataset also features emotion intensity variations, by introducing both moderate and intense versions for joy, anger, and sadness, in addition to neutral. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. High consistency between the speakers’ emotional intentions and the listeners’ perceptions is also proved by Cohen’s Kappa coefficients. Finally, extensive experiments are carried out as a baseline on MES-P for automatic emotion recognition and with comparison to human emotion intelligence.
- Co-author:Ying Chen, Weibei Dou, Zhi Tao, Liming Chen, Yu Pan, Weibei Dou,Huiuwen Luo, Yunxiang Ge, Shuyu Yan, Quan Xu, Yuanyuan Tu, Yanqing Xiao, Qiong Wu, Zhuozhao Zheng, Hongliang Zhao
- First Author:Zhongzhe Xiao,Yueheng Wang
- Indexed by:Journal paper
- Correspondence Author:Yu Pan, Weibei Dou
- ISSN No.:1949-3045
- Translation or Not:no
- Date of Publication:2018-08-30