个人信息Personal Information
教授
教师英文名称:DOU Weibei
教师拼音名称:douweibei
办公地点:清华大学罗姆楼4-102
联系方式:Email: douwb@tsinghua.edu.cn; Tel: 010-62781703
学位:博士学位
毕业院校:电子科技大学学士、法国雷恩大学硕士、法国卡昂大学博士
MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels
点击次数:
影响因子:10.506
DOI码:10.1109/TAFFC.2019.2945322
发表刊物:IEEE Transactions on Affective Computing
刊物所在地:UNITED STATES
关键字:emotional speech, Mandarin, dataset, distal labels, proximal labels, tonal speech, emotion intensities
摘要:Emotion shapes all aspects of our interpersonal and intellectual experiences. Its automatic analysis has therefore many applications. In this paper, we propose an emotional tonal speech dataset, Mandarin Chinese Emotional Speech Dataset - Portrayed (MES-P), with both distal and proximal labels. In contrast with state of the art datasets which only focused on perceived emotions, MES-P includes not only perceived emotions (proximal labels) but also intended emotions (distal labels), to make it possible to study human emotional intelligence, i.e. emotion expression/understanding ability, and emotional misunderstandings in real life. Furthermore, MES-P also captures a main feature of tonal languages, and provides emotional speech samples matching the tonal distribution in real life Mandarin. MES-P dataset also features emotion intensity variations, by introducing both moderate and intense versions for joy, anger, and sadness, in addition to neutral. Ratings of the collected speech samples are made in valence-arousal space through continuous coordinate locations, resulting in an emotional distribution pattern in 2D VA space. High consistency between the speakers’ emotional intentions and the listeners’ perceptions is also proved by Cohen’s Kappa coefficients. Finally, extensive experiments are carried out as a baseline on MES-P for automatic emotion recognition and with comparison to human emotion intelligence.
合写作者:Ying Chen, Weibei Dou, Zhi Tao, Liming Chen, Yu Pan, Weibei Dou,Huiuwen Luo, Yunxiang Ge, Shuyu Yan, Quan Xu, Yuanyuan Tu, Yanqing Xiao, Qiong Wu, Zhuozhao Zheng, Hongliang Zhao
第一作者:Zhongzhe Xiao,Yueheng Wang
论文类型:期刊论文
通讯作者:Yu Pan, Weibei Dou
ISSN号:1949-3045
是否译文:否
发表时间:2018-08-30